5

I am developing an Android app that pulls information from a Wikia page and displays it in the app. I currently am pulling all Categories to navigate and have my app set up to display the page in a WebView but I would like to just pull the info and format myself instead of cheapening it by passing to WebView.

What I am using to get the text is: http://scottlandminecraft.wikia.com/api.php?format=xml&action=query&titles=ZackScott&prop=revisions&rvprop=content

My problem is the text comes back in a big clump, does anyone have any ideas as to how to get this more formatted so I could parse from tags or am I wasing my time trying to find that? If so would it be better to find a way to parse the text I need by going from identifiers in the text this pulls, or is there a better way?

Thank you for your input and time.

kikurself
  • 153
  • 1
  • 10
  • 1
    I don't see what you call "big clump". It's an XML document containing the wikitext of the page - just what your api call requests for. What data are you after, the rendered HTML? – Bergi Mar 28 '13 at 14:05
  • The "big clump" I was referring to is the mass of text that I pull when I do this, It gets all of the text that I want from the page but its not very organized, I just wasn't sure if there is a better way to pull the text that would make it easier to parse with XML or if I should go with another format and then parse from that, like the others that have posted here have given me excellent options to parse from HTML. – kikurself Mar 28 '13 at 15:13
  • Do you want the wikisyntax parse tree? Do you want the plain wikitext, not wrapped in xml? – Bergi Mar 29 '13 at 13:46

3 Answers3

11

The easiest way, if you don't want to parse the wiki markup yourself, is to retrieve the parsed HTML version of the page and then process it using an HTML parser (like jsoup, as recommended by Hasham).

Besides just scraping the normal wiki user interface (which will give you the page HTML wrapped in the navigation skin), there are two ways of getting the HTML text of a MediaWiki page:

  1. use the API with action=parse, which will return the page HTML wrapped in a MediaWiki API XML (or JSON / YAML / etc.) response, like this:

  2. or use the main index.php script with action=render, which will return just the page HTML:

Ps. Since you mention sections in your question, let me note that the action=parse API module can return information about the sections on the page using prop=sections (or even prop=sections|text). For an example, see this API query:

Ilmari Karonen
  • 49,047
  • 9
  • 93
  • 153
3

The content is formatted using wiki syntax. You can render it in HTML using a Java engine called Bliki.

http://code.google.com/p/gwtwiki/

http://code.google.com/p/gwtwiki/wiki/Mediawiki2HTML

Bliki is not thought for Android. You need it to compile it. It seems it can be done:

https://groups.google.com/forum/?fromgroups=#!topic/bliki/LNsmnEEZEV4

Alexis Dufrenoy
  • 11,784
  • 12
  • 82
  • 124
1

If you want to parse the html document then Jsoup is the choice.

Hasham
  • 455
  • 4
  • 11