Read raw file with unicode characters

Question

I have a file in the /res/raw (R.raw.test) folder with the following content:

This is a Tésêt

I want to read it into a string. My current code is:

public static String readRawTextFile(Context ctx, int resId) {
    InputStream inputStream = ctx.getResources().openRawResource(resId);

    InputStreamReader inputreader;
    try {
        inputreader = new InputStreamReader(inputStream, "UTF-8");
    } catch (UnsupportedEncodingException e1) {
        e1.printStackTrace();
        return null;
    }
    BufferedReader buffreader = new BufferedReader(inputreader);
    String line;
    StringBuilder text = new StringBuilder();

    try {
        while ((line = buffreader.readLine()) != null) {
            text.append(line);
            text.append('\n');
        }
    } catch (IOException e) {
        return null;
    }
    return text.toString();
}

But the string returned is:

This is a T�s�t

How can I solve this? Thanks

Where are you seeing `This is a T�s�t`? Console, Logfile, GUI, HTML page, somewhere else? — jlordo, Jan 15 '13 at 10:05
How did you solve this? Could you please share your solution? @Addev — yahya, Jan 20 '14 at 14:00

score 2 · Accepted Answer · answered Jan 15 '13 at 10:04

2

Your code seems OK. String returned is OK also except that you're trying to view it in viewer not supporting UTF-8. I've run your code from groovyConsole which is UNICODE aware and it displays UTF-8 string perfectly.

answered Jan 15 '13 at 10:04

Archer

5,073
8
50
96

I'm putting the text in a TextView and the result is the same =( – Addev Jan 15 '13 at 11:00

score 1 · Answer 2 · answered Jan 15 '13 at 10:09

1

First of all, you need to determine the encoding of the file /res/raw

If on UNIX, you may type following commands

file /res/raw

And then specify the proper encoding in

inputreader = new InputStreamReader(inputStream, "UTF-8");

answered Jan 15 '13 at 10:09

fwu

359
2
10

score 1 · Answer 3 · edited Jun 06 '16 at 15:11

Hi i would try something like this:

StringBuilder str = new StringBuilder();
File file = new File("c:\\some_file.txt");
FileInputStream is = new FileInputStream(file);
Reader reader = new InputStreamReader(is, "UTF-8");
while(true){
    int ch = reader.read();
    if(ch < 0){
      break;
    }
    str.append((char)ch);
}
String myString = str.toString();

If you want to write just use InputStreamWriter with FileOutputStream and setup right Encoding... it works like charm...

I hope i could help :-)

score 1 · Answer 4 · answered Jan 13 '15 at 13:02

1

I had a file that also gave me an output similar to 'This is a T�s�t', and for me, setting the charsetName to UTF-16 did the trick

answered Jan 13 '15 at 13:02

galaxigirl

2,390
2
20
29

Read raw file with unicode characters

4 Answers4

Linked