Stack Overflow
Stack Overflow

Questions tagged [kimono]

UPDATE: KimonoLabs was acquired by Palantir in early 2016, and no longer supports this product. Kimono is a web-scraping tool by KimonoLabs that turns any data on the web into an API. The user selects data from a web page, and Kimono builds a model of the data. Kimono then provides that data in an API, and revisits the original page periodically to keep the API up-to-date.

Kimono has announced that it will shut down the service on february 29 2016

Kimono is a web-scraping tool by Kimono Labs that turns any data on the web into an API. Using Kimono's browser extension, you define the sites and objects (CSS selectors) you want to crawl. Output formats include JSON, CSV and RSS.

Kimono Labs hosts the crawls and the results. It also supplies API keys and links to the API for a number of commonly used web app frameworks:

  • Curl
  • jQuery
  • Node.js
  • PHP
  • Python 2
  • Python 3
  • Ruby
  • R
  • Go

Crawl scheduling and myriad config options are available. As of the writing of this tag wiki, the Kimono API is in beta.

Further reading

Kimono About

48 questions
0
votes
1 answer

kimono pagination error with Amazon

I am trying to scrape Amazon result pages using Kimono. For instance I type "Sony" on Amazon.co.uk search engine and want to scrape the results to get product names. I am able to do it for one page but I'd like to scrape multiple pages using…
Florent
  • 1
  • 1
0
votes
1 answer

Dropdown selection in url?

I'm not sure if this is the best place to ask this but I figured I would give it a try. I'm trying to scrape some data off of this website: https://www.numberfire.com/nba/fantasy/full-fantasy-basketball-projections using Kimono Labs. However, I want…
user2688054
  • 19
  • 4
0
votes
1 answer

Kimono get data from element

I'm currently scraping a page using Kimono and I've been unable to select element and get any data from it. In particularly I'm looking for element. I have also tried to get full html and then parse it in app. In that case api just…
Klemen
  • 11
  • 3
0
votes
1 answer

If I logout of Kimono, will my APIs 'in progress' STOP

I have an API currently running (manual crawl), i.e. with status 'in progress', and according to my estimation, it's going to take 10 hours to complete. I am therefore asking myself whether the API will continue to run on Kimono's servers if I…
Olivier
  • 607
  • 1
  • 6
  • 21
0
votes
1 answer

Nested API structure with Kimono

There is a site that I want to convert to an API with Kimono and it has the following structure (I mean visually, not markup-vise): CATEGORY 1: Product 1: PRICE Product 2: PRICE Product 3: PRICE ... CATEGORY 2: Product 1: PRICE Product 2:…
marchello
  • 2,016
  • 3
  • 29
  • 39
0
votes
2 answers

sort jquery result alphabetically

I am trying to make a dynamic list of my blog posts. I need the list to be displayed alphabetically. The current code is working okay, but gave me a chronological list. How can I arrange my list alphabetically. Current code is given below. It is for…
Nesi
  • 286
  • 2
  • 15
0
votes
1 answer

Has anyone gotten Kimono meta APIs to combine results from multiple APIs?

The documentation describes a meta collection as a combination of 2 (or more) different APIs... By default, a meta API endpoint returns all data from all of its sub-APIs, organized by collection. But, what I find is that it does not do this. It…
Elvn
  • 3,021
  • 1
  • 14
  • 27
0
votes
2 answers

How do you use the Kimono RESTful API to update parameters?

Specifically I am looking to update the URLs that are to be scraped. Documentation can be found here: https://www.kimonolabs.com/apidocs#SetCrawlUrls Unfortunately my knowledge about cURL and RESTful APIs is limited to say the least. My most recent…
fwho
  • 248
  • 2
  • 14
0
votes
1 answer

How to scrape whole table( instead of first ten rows) from website with Kimono Labs

Im using Kimono labs to create an Api to scrape the data in this table from this website, however the website by default shows the first 10 rows only instead of all rows, so my api provides me with only 10 rows. Is there a way to make it parse all…
RedEagle
  • 2,358
  • 3
  • 13
  • 18
0
votes
2 answers

Regex append a string end of a URL

I am using Kimono Labs to scrape a bunch of websites. I'd like to append "/critic-reviews" to the end of a url Kimono allows regex only in this format - /^()(.*?)()$/ I have a bunch of URLs in this representative format…
Greatest Ever
  • 11
0
votes
1 answer

Add category to json output in Kimonolabs with javascript

I have Json output file in Kimonolabs lookin like this { "name": "text", "results": { "collection1": [ { "title": { "href": "link", "text": "text" }, "description": "text", "author": "text", "index": 1, "url":…
Nilz
  • 3
  • 2
0
votes
3 answers

Scrape data every day on the same page and increment a Google Drive document

I didn't manage to achieve a scheduled content scraping with Kimono Labs. Here is what I intended to do: scrape a movie ranking which is published every day on a specific page and increment the data to an existing Google Sheet. In fact there would…
Khazd0rf
  • 1
  • 2
0
votes
1 answer

Kimono Labs CSV Download

I have made a Kimono Labs scrape, however when downloading to a CSV file the file skips blank cells which makes the data time consuming to tidy up. Can someone advise how the data can be dowloaded to CSV and keep column format.
Nickt
  • 1
0
votes
1 answer

How to make Kimono Labs not skip blank table cells?

I've made a Kimono Labs scraper to grab data from this website which has a few tables with empty cells. Rather than returning that empty cell, the scraper is returning the next value down the list, so the values in the rows don't correspond to…
Michael Dean
  • 1
  • 1
0
votes
1 answer

CSS selector select by div class attributes

I am trying to get the url component of this div class but I seem to be unable to fetch that specific…
Wraithseeker
  • 1,884
  • 2
  • 19
  • 34
1 2
3
4