ScraperWiki: How to save html so it only gets loaded once

Question

When I execute a scraper, it loads the url using this method:

$html = scraperWiki::scrape("foo.html");

So every time I add new code to the scraper and want to try it, it loads again the html, which takes a fair amount of time.

Is there anyway to save the $html so it's only loaded the first time?

score 2 · Accepted Answer · edited Jun 10 '21 at 14:15

2

As said on FAQ at docs and help section of scraper wiki site:

Yes, but all files are temporary.

I suggest you save the file(HTML or wherever is) with functions fopen/fwrite as you are using PHP.

edited Jun 10 '21 at 14:15

answered Oct 15 '12 at 22:25

lucaspirola

1 Answers1