Stack Overflow
Stack Overflow

Questions tagged [utf8mb4]

Unlike its `utf8` encoding, MySQL’s `utf8mb4` encoding offers full Unicode support (including four-byte UTF-8-encoded symbols).

Unlike its utf8 encoding, MySQL’s utf8mb4 encoding offers full Unicode support (including four-byte UTF-8-encoded symbols).

The utf8mb4 character set is useful because nowadays we need support for storing not only language characters but also symbols, newly introduced emojis, and so on.

utf8mb4 has been available since MySQL 5.5.3 (released March 2010).

A nice read on How to support full Unicode in MySQL databases by Mathias Bynens can also shed some light on this.

More information about the utf8mb4 character set may be found on the official MySQL Documentation.

398 questions
1
vote
1 answer

How to encode international strings with emoticons and special characters for storing in database

I want to use a API from a game and store the player and clan names in a local database. The names can contain all sorts of characters and emoticons. Here are just a few examples I found: ⭐ яαℓαηι نکل 窝猫 鐵擊道遊隊 ❤✖❤♠️♦️♣️✖ I use python for reading…
Jack O'Neill
  • 1,032
  • 2
  • 19
  • 34
1
vote
1 answer

In PHP7, what's the best way to sanitize UTF8 character containing filenames?

We run a site where users upload image files. When these files are produced on Mac, sometimes they have UTF-8 characters in the file names (Since mac uses UTF-8 as its file system character set). When PHP7 code receives these files, we have to store…
DrDamnit
  • 4,736
  • 4
  • 23
  • 38
1
vote
1 answer

High CPU on MySQL after running CONVERT_TO_CHARACTER_SET

After running the following command on a SQL database, the CPU usage has shot up to 100%. Queries can be taking upwards of 60 seconds. Here is the command: ALTER TABLE database_splishuser CONVERT TO CHARACTER SET utf8mb4; Does using the CONVERT TO…
wellthatssomething
  • 155
  • 1
  • 10
1
vote
2 answers

How to avoid b' and UTF-8 literals in MySQL using Python 3

I'm a bit of a novice. So I'm trying to parse html pages and put the contents in a column in MySQL, however I can't seem to get the actual foreign characters to appear, such as instead of á I get xc3xa1. My table has utf8mb4 as its character set and…
HenryAD
  • 87
  • 1
  • 8
1
vote
1 answer

MYSQL database encoding, mix of latin1 and utf-8

I have an older MYSQL 5.6.34 database that was created several years ago (not by me). I've taken one of the databases and started building tables in it for use in my applications when I noticed some of the other tables have a latin1 encoding. Then…
ItsPronounced
  • 5,475
  • 13
  • 47
  • 86
1
vote
1 answer

I can't load Spanish/German special characters

Installed mysql-installer-community-8.0.11.0.msi this week, on a Windows 10 machine and am stuck loading Spanish names. A row with Reynaldo Cantú fails with loader message: ERROR 1300 (HY000) at line 4: Invalid utf8mb4 character string: 'Reynaldo…
DanR
  • 9
  • 5
1
vote
2 answers

PHP 7 & Doctrine 2.4.3 : Changing column charset from utf8 to utf8mb4

I'm working on a project using Doctrine 2.4.3 with a MySQL 5.7.21 database with utf8 as default charset. Recently, I've been looking to implement emoji support. To overcome MySQL's limitation of 3 bytes for utf8, I need to change the columns that…
Gummy
  • 156
  • 3
  • 17
1
vote
0 answers

into mysql database not working

I am trying to insert an emoji () into mysql database. When I insert it from php code it inserts as ????. And when I try to copy and paste it into phpmyadmin the following error occurs: Warning: #1366 Incorrect string value: '\xF0\x9F\x98\x8D' for…
Dan
  • 103
  • 1
  • 13
1
vote
0 answers

ios - comparing strings with emoji character

I have updated my server side code to store utf8mb4 type. In ios I send "[[UIDevice currentDevice] name]" to server by converting to (NSMutableData *)[dataStr dataUsingEncoding:NSUTF8StringEncoding] Now when I get back list of devices, I need to…
Durgaprasad
  • 1,910
  • 2
  • 25
  • 44
1
vote
1 answer

MySQL CHARACTER SET utf8mb4 VARCHAR length

Spent the last few days looking for any gotcha's converting from the various supported MySQL charsets to using utf8mb4. It seems as though the largest problem most people face is that the 4-byte characters mean that the max length for InnoDB…
Mike Pearson
  • 79
  • 1
  • 5
1
vote
0 answers

On what mysqlnd version utf8mb4_unicode_520_ci introduced?

I'm aware that: utf8mb4 require Mysql 5.5.3+ or Mysqlnd 5.0.9+ utf8mb4_unicode_520_ci require Mysql 5.6+ I have Mysqlnd 5.0.12 and it's support utf8mb4_unicode_520_ci. I'm curious to know on what Mysqlnd version is utf8mb4_unicode_520_ci…
qaharmdz
  • 232
  • 1
  • 2
  • 7
1
vote
0 answers

MySQL InnoDB tables don't accept Emoji's with utf8mb4 encoding

I have been trying to get my DB to accept Emoji's by following steps from this tutorial as it appears to be the one that is linked to the most. https://mathiasbynens.be/notes/mysql-utf8mb4 Even with a test DB I can't get this to work and so far I…
Paul
  • 328
  • 1
  • 5
  • 17
1
vote
1 answer

mysql utf8mb4 doesn't seem to recognize some emojis like

You can see that 'bio' column is set to UTF-8 Unicode (utf8mb4) But when I put <- these two into 'bio' column, it's somehow saved as ????... There are some emojis which can be recognized and saved well such as ❌ . Does utf8mb4 cover every emoji…
kispi
  • 185
  • 1
  • 12
1
vote
1 answer

Mysql2::Error Can't initialize character set utf8mb4 (path: /usr/share/mysql/charsets/)

In my Rails 4.2 app I stumbled on strange issue. I had to switch mysql encoding to utf8mb4 (to allow Emoji in posts). I've updated MySql to 5.7, altered tabels etc. Updated database.yml with: encoding: utf8mb4 collation:…
rolkos
  • 342
  • 3
  • 15
1
vote
1 answer

MySQL utf8mb4 unicode (Smiles)

So, today i was faced with the problem: SQL request: INSERT INTO `sample` (`lol`) VALUES (''); Response: Error Code: 1366. Incorrect string value: '\xF0\x9F\x91\x88' for column 'lol' at row 1 Collation: mysql> SHOW VARIABLES WHERE Variable_name…
Anton Shadrin
  • 97
  • 8
1 2 3
…
26 27