PostgreSQL csv import from a MySQL csv export?

Question

Will it work?

MySQL export:

SELECT * INTO OUTFILE 'C:/data.csv'
FIELDS TERMINATED BY '\t' OPTIONALLY ENCLOSED BY '"'
ESCAPED BY '\\'
LINES TERMINATED BY '\n'
FROM table;

PostgreSQL:

COPY table FROM 'C:/data.csv' WITH DELIMITER AS '\t' NULL AS '\\N' CSV

There is missing columns for some reason. So I believe there is problem in delimiter. Am I correct, what can I do? I can inspect row with cause error below. But which characters I must look for?

ERROR:  missing data for column "Column21"
CONTEXT:  COPY table, line 88219: ...

So at 88219 line contain sting with escaped quote: " ... \" ... " Seems like postgres fail to unquote this. Is there special option for this? — FirstTimePoster, Sep 20 '11 at 12:06

score 16 · Accepted Answer · edited Dec 16 '22 at 16:13

16

As mentioned by @knitti postgres need to know escape character: ESCAPE '\'
OPTIONALLY ENCLOSED BY '"' is bad format for csv. It's better to force quoting.

Full code:

mysql 5.5.15:

SELECT *
INTO OUTFILE 'C:/data.csv'
FIELDS TERMINATED BY '\t' ENCLOSED BY '"' ESCAPED BY '\\'
LINES TERMINATED BY '\n'
FROM table;

postgres 9.0.3:

COPY table FROM 'C:/data.csv' WITH DELIMITER AS E'\t' NULL AS '\\N' ESCAPE E'\\' CSV

edited Dec 16 '22 at 16:13

vitalyster

4,980
3
19
27

answered Sep 21 '11 at 06:38

FirstTimePoster

251
2
9

Just what I was looking for my friend! – Henley Dec 01 '12 at 04:21
I needed to escape the delimiter as E'\t' for the above to work – Zabuzzman Feb 20 '16 at 15:31

knitti · Answer 2 · 2011-09-20T13:59:59.517

0

Default quote character in PostgreSQL is double-quote, but the documentation says, you can use any single one-byte-character. Try adding

ESCAPE '\\'

edited Sep 20 '11 at 13:59

answered Sep 20 '11 at 13:47

knitti

6,817
31
42

PostgreSQL csv import from a MySQL csv export?

2 Answers2

Linked