0

Recently kimonolabs announced they will be shutting down which is a major let down as my app heavily relies on this service in terms of getting data. It's really dissapointing that they're just shutting this service. I've been using import.io in the mean time but it's no where near the standard of kimono and is missing some features.

I was wondering if there are any services that are similar to kimono that have the following features:

  • Scheduled crawls i.e. schedule a crawl every 24 hours or Alternatively you can call a link to update the latest data for a crawl.
  • Bulk or single url crawls i.e. Enter a list or a single url to scrape.
  • Call a link to get the results from the crawl in JSON.
  • Use a single api key to make a call for the api.
  • It's free for most of these features.

Alternatively i may be tempted to create my own it's just that i don't want to increase my dev time learning Node.js or Python which is why i'm asking this question.

Tunds
  • 1,804
  • 2
  • 15
  • 30

3 Answers3

1

Update : December, 2018 - Agenty is generally available now

If you are looking for desktop app, Data Scraping Studio has the same plus more feature as in Kimono. Or you may install it on a windows server to make your own Kimono++ exact alternative

enter image description here

FYI : We also have plan to launch hosted solution and REST API by April, 2016

You may see more details on website (www.datascraping.co) now Agenty.com

Disclosure : I'm one of the founding member

Priyanka Rathee
  • 1,077
  • 2
  • 13
  • 19
  • I was looking at this but there's no mac apps or a way to make api calls to get data. Also i don't have a lot of experience setting it up on a server so i'd like this to be done for me. – Tunds Feb 24 '16 at 08:11
  • Also what will you be launching? Kimono++ or this data scraping tool – Tunds Feb 24 '16 at 08:12
  • Hi Tunds, The only feature you are missing from that list, in import.io, is scheduled extraction. I'd be happy to show you how to switch a feature flag on to enable that feature in import, and how to use the rest of the features if you like. If you drop me a PM. Or email support@import.io and ask about scheduling a chained API and Bulk Extraction. – CavemanDan Feb 24 '16 at 10:27
  • Mac app is not in plan right now. But we will be launching the hosted solution where you can login and start/schedule the extraction like Kimono and can also use REST API to make api calls. – Priyanka Rathee Feb 24 '16 at 11:54
  • @PrinceRathee Sweet could you send me a PM or do you have any dates as to when you think this will launch? – Tunds Feb 27 '16 at 11:15
  • @Tunds Didn't decided the exact date yet, but most probably 1st week of April 2016. you may signup on datascraping.co and all user will get email when launched. – Priyanka Rathee Feb 27 '16 at 12:24
  • @PrinceRathee Sweet thanks for that mate :) – Tunds Feb 27 '16 at 12:30
1

Disclosure: I work at Scrapinghub, creators of Portia.

Portia, an open source, visual scraping tool that allows you to scrape by pointing and clicking on the web page you are trying to get data from.

There is a hosted version at Scrapy cloud, you can create an account for free and get:

  • schedule your Portia Spiders through both Scrapy Cloud web UI and API.
  • fetch items using API
  • Use scrapy plugins (for example perform incremental crawls, download images to s3, etc).
  • and others.

Here you can see Portia in action

[Edit] You can also port your kimonolabs project to portia automatically with this tool

Joaquin Sargiotto
  • 1,646
  • 13
  • 12
0

My team and I are working on a very similar tool and we will launch it soon. Here is more about it:

Automatio is Web Automation Tool which you can use to scrape data from any website in very easy way.

Some of the features are:

  • Previewing scrapped data in different formats, like CSV, JSON, RSS, and API. There is download option as well.

  • Generating widgets from same data and getting iframe output to display on your website.

  • Visualizing data with different chart types.

  • Supports regular pagination and infinite scroll

  • Scheduling and looping tasks

  • Integration with other platforms

If you are interested you can signup for early access here https://automatio.co

Check few videos to see it in action:

Plavookac
  • 410
  • 9
  • 24