MongoDB special characters

Question

I have inserted a init file into MongoDB:

db.User.insert({ "_id" : ObjectId("5589929b887dc1fdb501cdba"), "_class" : "com.smartinnotec.aposoft.dao.domain.User", "title" : "DI.", ... "address" : { "_id" : null, ... "country" : "Österreich" }})

And if I invoke this entry with db.User.find(), than I get the following:

{ "_id" : ObjectId("5589929b887dc1fdb501cdba"), "_class" : "com.smartinnotec.aposoft.dao.domain.User", "title" : "DI.", ... "address" : { "_id" : null, ... "country" : "ï¿½sterreich" } }

The word with special characters "ï¿½sterreich is not correct.

Does anybody have any idea what I can do in mongodb in order to solve this problem?

I use v3.0.7 too. I try your codes there is no any weird situation. I wnat to ask the same question with Rabee's; "Are you getting this result from the mongo console ?". Because MongoDB stores the data in BSON form as UTF8 encoded. The changing may occured immediate before the sending to MongoDB. Good luck.. — efkan, Dec 10 '15 at 08:48
Have you Linux language packages installed? Especially the one for the language your string in? — Constantin Guay, Dec 10 '15 at 20:42
So where this problem is happening? Where the insert query is running from? — Amir, Dec 14 '15 at 22:34
The console that you are printing your results to, is trying to represent single byte characters(`UTF-8`) in `UTF-16` or some other multi-byte character set. You need to change the console settings to display characters in `UTF-8` format. — BatScream, Dec 15 '15 at 06:51
@user3318489: Yes. You should use UTF 8 version rather than using HTML codes. It will be useful while making queries too. When you want to search convert it to UTF-8 and then search. Check my answer. — Somnath Muluk, Dec 15 '15 at 17:06

score 7 · Answer 1 · answered Dec 15 '15 at 09:55

JSON and BSON can only encode / decode valid UTF-8 strings, if your data (included input) is not UTF-8 you need to convert it before passing it to any JSON dependent system, like this:

$string = iconv('UTF-8', 'UTF-8//IGNORE', $string); // or
$string = iconv('UTF-8', 'UTF-8//TRANSLIT', $string); // or even
$string = iconv('UTF-8', 'UTF-8//TRANSLIT//IGNORE', $string); // not sure how this behaves

Personally I prefer the first option, see the iconv() manual page. Other alternatives include:

mb_convert_encoding()

mb_convert_encoding("Österreich", "UTF-8", "ISO-8859-1");

utf8_encode(utf8_decode($string))

You should always make sure your strings are UTF-8 encoded, even the user-submitted one.

score 4 · Accepted Answer · edited May 23 '17 at 12:19

Guess so you can use the HTML Codes inside a string

Code:

You can use &ouml ; to save the spl char in db.

db.User.insert({ "_id" : ObjectId("5589929b887dc1fdb501cdba"), "_class" : "com.smartinnotec.aposoft.dao.domain.User", "title" : "DI.", ... "address" : { "_id" : null, ... "country" : "&ouml;sterreich" }})

And on invoking this entry with db.User.find(),you will get the following:

{ "_id" : ObjectId("5589929b887dc1fdb501cdba"), "_class" : "com.smartinnotec.aposoft.dao.domain.User", "title" : "DI.", ... "address" : { "_id" : null, ... "country" : "Österreich" } }

Reference:

http://www.starr.net/is/type/htmlcodes.html

Replace multiple characters in a string in javascript

Hope this helps.

MongoDB special characters

2 Answers2