How to scrape whole table( instead of first ten rows) from website with Kimono Labs

Question

Im using Kimono labs to create an Api to scrape the data in this table from this website, however the website by default shows the first 10 rows only instead of all rows, so my api provides me with only 10 rows. Is there a way to make it parse all the table rows?

-- and that's one of the columns css selector

div.dataTables_wrapper > table.display.dataTable > tbody > tr > td:nth-child(2).table_number

Did [this](https://help.kimonolabs.com/hc/en-us/articles/203274990-Crawl-pages-via-following-a-next-page-or-more-link) not work? Why? — leo60228, Sep 02 '15 at 16:16
Im not sure if I should feel dumb or think of you as a hero. Thank you! Can you post this as an answer so I can accept it? — RedEagle, Sep 02 '15 at 21:55

score 0 · Accepted Answer · answered Sep 03 '15 at 12:30

Haven't tried, but you really really should Google first. Found this: https://help.kimonolabs.com/hc/en-us/articles/203274990-Crawl-pages-via-following-a-next-page-or-more-link (from comment, you said to post as an answer)

In case the link goes dead:

Finish your API for the first page.
Click in the toolbar.
Click the next page/more link on the page. It should be highlighted gray.
When you save, select the maximum number of pages.

How to scrape whole table( instead of first ten rows) from website with Kimono Labs

1 Answers1