How to get rid all strange characters that can't get into mysql from a string in vb.net

Question

I have a problem with strange character.

In mysql this character cause error Incorrect string value: '\xF0\x9F\x92\x80'

Samples of these characters are from https://foursquare.com/v/shabushi-%E0%B8%8A%E0%B8%B2%E0%B8%9A%E0%B8%8A/4b72452cf964a5203c762de3

Say I want to analyze data from the web and found some strange character

how to remove this character ??

The occurance is rare.

In fact, how to know all characters that may be problematic for mysql and remove that? I am not saying escapeable characers. I am saying characters that are neither numeric, alphabeth, or chinese scripts, or punctuation. Characters that's totally bizarre.

How do I get rid of that from a string?

Ignacio Vazquez-Abrams · Accepted Answer · 2012-03-14T12:28:21.333

1

Older versions of MySQL can't deal with characters outside the BMP; upgrade your MySQL to at least 5.5 and set the column to use the utf8mb4 charset.

edited Mar 14 '12 at 12:28

answered Mar 14 '12 at 05:21

Ignacio Vazquez-Abrams

776,304
153
1,341
1,358

what is bmp? I am just curious. – user4951 Mar 30 '12 at 05:38
The [Basic Multilingual Plane](http://en.wikipedia.org/wiki/Plane_%28Unicode%29#Basic_Multilingual_Plane), where all Unicode codepoints fit in 16 bits, and all UTF-8 encodings use 3 or fewer bytes. – Ignacio Vazquez-Abrams Mar 30 '12 at 05:52
so you mean all those are characters outside BMP? – user4951 Mar 30 '12 at 06:00
Not all, but certainly some of them. That's why you get a 4-byte "Incorrect string value". – Ignacio Vazquez-Abrams Mar 30 '12 at 12:25

How to get rid all strange characters that can't get into mysql from a string in vb.net

1 Answers1