Stack Overflow
Stack Overflow

Questions tagged [kimono]

UPDATE: KimonoLabs was acquired by Palantir in early 2016, and no longer supports this product. Kimono is a web-scraping tool by KimonoLabs that turns any data on the web into an API. The user selects data from a web page, and Kimono builds a model of the data. Kimono then provides that data in an API, and revisits the original page periodically to keep the API up-to-date.

Kimono has announced that it will shut down the service on february 29 2016

Kimono is a web-scraping tool by Kimono Labs that turns any data on the web into an API. Using Kimono's browser extension, you define the sites and objects (CSS selectors) you want to crawl. Output formats include JSON, CSV and RSS.

Kimono Labs hosts the crawls and the results. It also supplies API keys and links to the API for a number of commonly used web app frameworks:

  • Curl
  • jQuery
  • Node.js
  • PHP
  • Python 2
  • Python 3
  • Ruby
  • R
  • Go

Crawl scheduling and myriad config options are available. As of the writing of this tag wiki, the Kimono API is in beta.

Further reading

Kimono About

48 questions
1
vote
1 answer

Regular expressions in Kimonolabs

Kimonolabs have three part regular expression which looks like this: /^()(.*?)()$/ First part is what preceeds desired text, middle part is the text you want and the third part is what follows desired text. The text I have is "[USA] John Doe" So I…
maxav
  • 11
  • 1
0
votes
1 answer

Kimono Desktop's payload url and index fields missing

With the Kimono Web, in the crawled payload there was always url and index field in every source URL JSON. But with the desktop, these fields are missing and my product was totally depends on it. I'm browsing the source codes of Kimono Desktop but I…
sercanov
  • 31
  • 4
0
votes
1 answer

Kimono - Can't scrape more than 25 pages

When doing an API on Chrome Kimono Extension it only let me to choose 25 pages to scrap, even if I choose 100, 500 or 1000 on Kimono Desktop it only scrapes 25 pages... help please.
Eduardo
  • 1
  • 2
0
votes
2 answers

Kimono - troubleshooting login in windows 10

I am new to Kimono and though I know it will no longer be supported, I am considering it since it is free and appears to be very intuitive. I was just running through the tutorials and when it told me to save the scraper it brought be to a login…
Joel
  • 11
  • 5
0
votes
1 answer

Kimono Desktop rss and autorun

I dont See that anyone already asked for this so 1.: Is there any way to Autorun like in online Kimono the tasks 2.: Did anyone get link to rss running? It seams to runs on http://localhost:3000 but when i Access it on ie, ff ore chrome i just…
user3359132
  • 3
  • 2
0
votes
3 answers

Are there any Kimonolabs alternatives?

Recently kimonolabs announced they will be shutting down which is a major let down as my app heavily relies on this service in terms of getting data. It's really dissapointing that they're just shutting this service. I've been using import.io in the…
Tunds
  • 1,804
  • 2
  • 15
  • 30
0
votes
1 answer

scraping results not limited according to the passed parameters - kimonolabs

i've tried to add the parameters "kimoffset" and "kimlimit" to the source url of my api, but this doesn't limit and/or shift the scraped results my api's source url: …
pinale
  • 2,060
  • 6
  • 38
  • 72
0
votes
1 answer

Kimono Regular Expressions for pagination

I'm trying to use kimono to paginate a URL. I don't like to ask for help, but this time I really tried for myself without effort. I tried to read about Regular expressions, and also I searched in forums with no effort. I wrote to the Kimono…
lio89
  • 115
  • 1
  • 12
0
votes
2 answers

Kimono: Function to modify data, explode string and add new a new property

I'm using Kimono to extract some data and create an API: { "name": "site update", "count": 4, "frequency": "Manual Crawl", "version": 1, "newdata": true, "lastrunstatus": "success", "thisversionstatus": "success", "thisversionrun":…
Peter
  • 79
  • 12
0
votes
1 answer

Kimono Scrape Remains "In Progress"

I am having issues with Kimono Labs. Every scrape I run will run indefinitely without throwing an error or completing. Occasionally, the scrapes will randomly start working days in the future without any changes on my behalf - only to fail a few…
Joshua Schwager
  • 1
  • 1
0
votes
0 answers

Remove Last Sentence From KimonoLabs Body Result

I am scraping content with KimonoLabs and one I have scraped the body of an article I would like to remove the last sentence in the body. Here is an attachment of the body I am trying to remove the last sentance from. I'm not so great with vanilla…
Evan
  • 1
0
votes
1 answer

Kimono labs - extracting data from a page that scrolls

I am trying to extract data from a research platform, the first x number of responses show on the page but when I try and scroll down the page to teach Kimono to extract the other responses it cant seem them thus just provides the first…
user3177441
  • 1
  • 2
0
votes
0 answers

How to call RSS modified kimono API on demand?

As you can see in the help (goo.gl/JMlJgV) this is an ondemand call to obtain a JSON output: http://kimonolabs.com/api/json/ondemand{API_ID}?apikey={YOUR_API_KEY} This is for XML:…
aborruso
  • 4,938
  • 3
  • 23
  • 40
0
votes
1 answer

Getting a 'Undefined' list in JSON response

The JSON I'm requesting is an array within an array (I think) and looks like this: "results": { "collection1": [ { "Inches": "1\"", "Resort": "Keystone", "index": 1, "url":…
user1757452
  • 61
  • 5
0
votes
1 answer

Email Alerts Not Working in Kimono

The email alert I setup did not notify me when new data was added. I can see the new data on the site, but the email never came through. I have even checked my spam and nothing is there.
m.jensen427
  • 1
  • 1
1
2
3 4