Split a big postgres table into multiple csv

Question

I am using following psql query to connect to a remote host and split a big table into multiple csv files.

psql -h xx -p xx -U xx -d xx -c "\COPY (select * from table) TO program 'split --lines 1000' (format csv)

I am not getting what mistake I am making here.

Note: there is a double quote missing at the end of the line. — wildplasser, Feb 12 '20 at 11:40
While I think Jim Jones answer is cleaner, your command also worked for me once I added the missing double quote at the end. — jjanes, Feb 12 '20 at 16:24

score 3 · Accepted Answer · answered Feb 12 '20 at 12:29

3

Have you tried using STDOUT?

$ psql -d db -c "COPY (SELECT * FROM t) TO STDOUT CSV " | split -1000

answered Feb 12 '20 at 12:29

Jim Jones

Can I give a sql query file as an input here like this. `psql -d db -c "COPY ($( – rshar Feb 12 '20 at 12:49
You have to use -f to pass a file, but it already needs to have a COPY command in it – Jim Jones Feb 12 '20 at 13:01
It worked without -f. But will have a look.. Thanks – rshar Feb 12 '20 at 13:02

1 Answers1