0

I'm looking for a web service, browser extension, or anything else that directly extracts any and all semantic data contained in a given web page, as long as that semantic data is following any of the myriad of modern standards used for embedding semantic information inside web pages. Somehow I couldn't find anything that works. I could find many 'semantic crawlers' but no tool that just shows what semantic data you have at hand on a given web page.

I'd be very glad getting pointers to any such tool, if one exists out there. I can't fathom how people debug or develop their semantic harvesters without it.......

I listed some of the relevant standards as the tags for this question (see question's tags which usually show here below) but this list is not to be taken as exhaustive.

Thanks!

matanster
  • 15,072
  • 19
  • 88
  • 167

3 Answers3

3

For some good starting points, you might consider:

Sindice is perhaps the most general of these, most of the others focus on RDFa (my own bias, sorry). Your choice might depend a bit on what you consider semantic data (e.g. do you want HTML5 semantics like <title> to count? For just RDFa I have found Apache's Any23 best for my needs, with nice API, flexible formats and accurate extraction.

Good question though, I'd be curious to see what tools others most recommend. W3C has a longer list that may be slightly dated.

cboettig
  • 12,377
  • 13
  • 70
  • 113
  • Thanks @cboettig, I'm learning those. It seems Sindice is a semantic search engine (and a very convenient one as far as I can see first off) rather than something where semantic data can be extracted from a specified url or html, although maybe there's some clever way to make it also do the later(?). Those are great resources and I'm learning them more carefully now. Thanks! – matanster May 30 '13 at 09:04
  • As an aside, I will probably post a similar question about open-source code for parsing out the same, although some of these tools here are possibly already relying on just that. – matanster May 30 '13 at 11:47
  • 1
    @matt Sindice has an inspector tool, sorry I didn't provide a direct link: http://inspector.sindice.com/ It's not as robust/thorough as the Any23.org in my experience. Correct, it also has a semantic search engine. – cboettig May 30 '13 at 19:57
  • inspector.sindice.com does so far seem to be one of the best in terms of usage experience - very responsive and has many of the necessary conveniences included. Thanks for clarifying! – matanster May 31 '13 at 18:35
1

Yandex has tool for validating embedded semantic markup as well. There is some doc available also. It works with microdata, schema.org, opengraph, rdfa, microformats. Not just with microformats, as you may conclude from title :)

If you're looking for opensource tools there is mighty library RDFLib on Github. It does a lot and parsing in particular.

The library contains parsers and serializers for RDF/XML, N3, NTriples, N-Quads, Turtle, TriX, RDFa and Microdata.

ajax
  • 1,896
  • 15
  • 8
0

For RDF data, there is Tim Berners-Lee’s Tabulator. A browser available as web app (resp. FLOSS JavaScript) and Firefox add-on. Howver, it seems no longer to be maintained (?).

For RDFa, there is the Firefox add-on RDFa Developer.

For RDF files linked in the page’s head, there is the Firefox-addon Semantic Radar.

Another Firefox add-on is OpenLink Data Explorer.

unor
  • 92,415
  • 26
  • 211
  • 360
  • I've used OpenLink Data Explorer's Chrome extension before, and within my limitations couldn't figure what it's doing, not to mention I found its presentation style somewhat intriguing... Maybe it's just me..... I'm still learning the relationships between all those standards and formats, which is a topic for orthogonal research for me. – matanster May 31 '13 at 18:54