Questions tagged [pgloader]
75 questions
0
votes
1 answer
Transferring data from MYSQL database to PostgreSQL
I have a MYSQL database(db_mysql) whose data I want to transfer to another PostgreSQL database(db_psql) which is initially empty.
I tried using the command pgloader mysql://root@localhost/db_mysql pgsql:///db_psql from the terminal(also using…

Jitesh Malipeddi
- 2,150
- 3
- 17
- 37
0
votes
0 answers
trouble handling strings with three or more '0' using pgloader
I am loading large .csv files into a database and want to use pgloader because it is able to skip and log erroneous records. However I frequently get
ERROR PostgreSQL Database error 22021: invalid byte sequence for encoding "UTF8": 0x00
Which I…

Mangobae
- 13
- 3
0
votes
0 answers
pgloader quote handling problems when create table for default values
I'm trying migrate my DB from maria DB to PGSQL.
I have a script file
LOAD DATABASE
FROM mysql://user:pass@server/mysql-db
INTO postgresql://user:pass@server:port/pg-db;
After running I'm getting some log and error:
2019-02-10T12:50:58.837000Z…

user3340188
- 31
- 4
0
votes
0 answers
Failed to connect to pgsql at :UNIX (port 5432): The value of CL-POSTGRES::USER is NIL, which is not of type STRING
I use a docker image (docker pull ubuntu), I installed postgresql via apt-get and then want to run the following script:
LOAD CSV
FROM 'geneset.csv' (a,b,c,d,e,f,g)
INTO postgresql:///genedb?csv (a,b,c,d,e,f,g)
WITH truncate,
…

j35t3r
- 1,254
- 2
- 19
- 53
0
votes
0 answers
What encoding to use to represent DBF (CDX) indexes
I am trying to extract data from several FoxPro tables using an open-source solution. There are several .dbf tables and associated .cdx indexes. The trouble I have is that two of the columns in the tables are made up of characters which are not…

Lorem Ipsum
- 4,020
- 4
- 41
- 67
0
votes
2 answers
postgresql - pgloader - quotes handling
I am new to postgresql and just starting to use it. I am trying to load a file into a table and facing some issues.
Sample data - the file file1.RPT contains data in the below format
"Bharath"|Kumar|Krishnan
abc"|def|ghi
…

Bharath
- 56
- 1
- 5
0
votes
2 answers
pgloader not importing data from MySQL to Postgres
I tried the following command and it returns no errors but the data is not imported in my postgres database.
Database is already created in Postgres.
pgloader mysql://user:password@localhost/mydb postgresql://user:password@localhost/mydb
This is…

Ghias
- 133
- 3
- 18
0
votes
1 answer
How can I resolve this constraint error when trying to load only data via pgloader?
I have the following .load file
LOAD DATABASE
FROM mysql://user:password@remotelocation/mydbname
INTO postgresql://user@localhost/dbname
WITH data only,truncate, workers = 8, concurrency = 1
SET maintenance_work_mem to '128MB',
…

asteriskTheServer
- 167
- 1
- 10
0
votes
1 answer
Is it possible to insert and replace rows with pgloader?
My use case is the following: I have data coming from a csv file and I need to load it into a table (so far so good, nothing new here). It might happen that same data is sent with updated columns, in which case I would like to try to insert and…

ktulinho
- 3,870
- 9
- 28
- 35
0
votes
1 answer
"Unable to load any of the alternatives" while installing pgloader
I am currently trying to install pgloader (v.3.3.1) on a RedHat Enterprise Linux 6 machine.
I have downloaded the tar.gz and extracted the files. As required, I use
make
while in the directory in order to build the program.
Installing pgloader…

Kadaztrof
- 13
- 5
0
votes
1 answer
pgloader: Unable move data from MYSQL to postgres
I installed pgloader using the following command on Ubuntu.
$ apt-get install pgloader
When I try to move a sample db from mysql to postgrs with the following commands
createdb pagila
pgloader mysql://mysqlusr:password@localhost/sampledb…

Brian
- 11
- 4
0
votes
0 answers
Rails: missing indexes when converting sqlite file into postgres db with pgloader
For my rails application, I'm converting a local sqlite3 file into a postgres database with pgloader.
To do this, I created a postgres database
createdb my_database_development
and I create a pgload command file
load database
from…

sjbuysse
- 3,872
- 7
- 25
- 37
0
votes
2 answers
Install Pgloader in Cent OS 6.7
I'm trying to install pgloader on centOS 6.7 (64 bits)
Steps
wget http://pgsql.tapoueh.org/pgloader/pgloader-3.0.98-21.el6.x86_64.rpm
rpm -Uvh pgloader-3.0.98-21.el6.x86_64.rpm
Result
-Uvh pgloader-3.0.98-21.el6.x86_64.rpm: unknown option
How…

code-8
- 54,650
- 106
- 352
- 604
0
votes
1 answer
pgloader cannot import while using TARGET COLUMNS
I am having a hard time getting pgloader to work while trying to use the TARGET COLUMNS optional arguments.
LOAD CSV
FROM INLINE
HAVING FIELDS
(
npi,
…

Nick H
- 245
- 2
- 13
-1
votes
2 answers
How to migrate 'current' mysql timestamp value to postgreSQL
I have Mysql DB that contains
table 'tariff' with field
start_date DATETIME DEFAULT (current_timestamp() + interval 10 year),
And when I try to migrate database to postgreSQL using pgloader i get error
ERROR Database error 0A000: value "current"…

uBaH
- 169
- 1
- 12