Is there a good library/package to do web scraping using Scheme (preferably Racket)?
e.g. a Scheme equivalent of mechanize?
Asked
Active
Viewed 2,234 times
8
-
Valid HTML (read XML) can be easily parsed into S-expressions. – leppie Apr 05 '13 at 16:21
-
Right, but what about submitting html forms, navigating links, etc.? – abeln Apr 05 '13 at 16:23
-
I am sure Racket has some http-client / web-client libraries. – leppie Apr 05 '13 at 16:24
-
1I haven't yet found a good mechanize-style library for Racket. – dyoo Apr 05 '13 at 17:19
-
What about a "not-so-good" one? ;) – abeln Apr 05 '13 at 17:22
1 Answers
8
I've used a combination of the Racket net/url library, the html-parsing package, and SXML (especially sxpath, for XPath queries). Actually, I wrote some wrappers around net/url that make it slightly easier to use, IMO.
When I've needed to handle cookies, I've called out to the curl command instead of using net/url.
Ryan Culpepper
- 10,495
- 4
- 31
- 30