missing characters with xmlpullparser

Question

I'm parsing some file with XmlPullParser in Android Everything goes fine except for some especial HTML characters on the text like this:

&iacute; it should be í
&eacute; it should be é

but they are missing on the Strings I extract:

cami&oacute;n it should be camión  and I get camin

and the same with other similar characters.

I don't know exactly where the problem is, if it's on xmlpullparser.getText() or on Java String

How can I solve this?

It seems something related to character encoding. Could you confirm what encoding you are using? — kosa, Feb 29 '12 at 19:11
I'm using UTF-8 it should be anything else since UTF-8 is the default character encoding of xmlpullparser — butelo, Feb 29 '12 at 19:22
see if this link helps http://stackoverflow.com/questions/5976375/xmlpullparser-on-special-characters it seems ISO-8859-1 worked for this guy, but not sure. Give a try. — kosa, Feb 29 '12 at 19:26

score 1 · Answer 1 · answered Mar 01 '12 at 08:53

I found a solution but it's expensive in terms of app size and performance so please let me now if something is wrong or could be done a better way or less steps.

first get a String from the file. pseudo code:
```
 String content = File to string;
```

http://snippets.dzone.com/posts/show/1335

Import commons-lang3-3.1.jar to your project from Apache commons. Feed that string for unescape Html characters:
```
 String output =   StringEscapeUtils.unescapeHtml4(content);
```
Feed that unescaped string to your XmlPullParser:
```
xpp.setInput( new StringReader (output) );
```

And that's it.

score 0 · Answer 2 · edited May 23 '17 at 12:21

0

As far as HTML unescaping is concerned, it seems that someone were using Html.fromHtml, which comes built-in with the Android platform. Application size-wise, this could be a proper solution; however, performance-wise you may need to do a bit of profiling, since apparently Apache Commons unescaping is reported to be much faster that the Android built-in alternative.

edited May 23 '17 at 12:21

Community

1
1

answered Mar 01 '12 at 09:36

Giulio Piancastelli

15,368
5
42
62

I tried that and didn't work. Maybe I can remove unneeded methods from apache library and make it thinner – butelo Mar 01 '12 at 10:20

score 0 · Accepted Answer · answered Mar 24 '12 at 01:17

The problem is that plain XML does not have HTML entities. é is not defined for XML. You either have to use an HTML parser (as in the above suggestions) or else translate the entities yourself in XmlPullParser.

Your loop would have to be run by nextToken() and not next(); You would have to respond to XmlPullParser.ENTITY_REF

Of course if you can change your input file to encode the characters directly in utf-8 or iso-8859-1 instead of using HTML entities, that would work too.

missing characters with xmlpullparser

3 Answers3