Stack Overflow
Stack Overflow

Questions tagged [pgloader]

75 questions
2
votes
1 answer

Converting NULL and '0000-00-00 00:00:00' to Non-NULL Using PGLoader MySQL to Postgres

When using pgloader to move tables from MySQL to Postgres, one issue I'm running into is certain source MySQL tables can contain either NULL or 0000-00-00 00:00:00 values in the datetime fields, and conversion on some of those columns is proving to…
Sena Heydari
  • 63
  • 6
2
votes
1 answer

Import a delimited file with field values containing an escaped delimiter

Given a delimited file in the following format fields delimited by a pipe char | text fields are unquoted some text field values contain an escaped pipe \|, an escaped line feed \\n or escaped carriage return \\r 1|text containing the pipe \|…
peterm
  • 91,357
  • 15
  • 148
  • 157
2
votes
1 answer

Can pgloader exclude specific columns in a MySQL table?

I am using a loading file with pgloader and there is a particularly problematic table in my MySQL database with malformed datetimes. I want to just skip that column during the migration. How can I do this in a loading file? Something like: LOAD…
medley56
  • 1,181
  • 1
  • 14
  • 29
2
votes
0 answers

Using pgloader to insert array values

So I have a Django DB Model as such: class Film(models.Model): title = ArrayField(models.CharField(default='', max_length=600), blank=True, null=True) likes = models.IntegerField(default=0, null=True) dislikes =…
Leo Khachatorians
  • 21
  • 1
2
votes
1 answer

Pgloader -- How to load constant while using load csv

I am using pgloader to load file into Tables. I need to load constant (ie, field not provided by the csv) but I do not succeed. my configuration looks like : LOAD CSV FROM './file.csv' HAVING FIELDS (a, b, c) INTO…
Julien
  • 77
  • 5
2
votes
1 answer

How to import empty strings as null values from CSV file - using pgloader?

I am using pgloader to import from a .csv file which has empty strings in double quotes. A sample line is 12334,0,"MAIL","CA","","Sanfransisco","TX","","","" After a successful import, the fields that has double quotes ("") are shown as two single…
Jehoshuah
  • 671
  • 2
  • 9
  • 20
1
vote
2 answers

Mysql to postgres Migration pgloader "ERROR mysql: 76 fell through ECASE expression"

While I try to migrate my MySQL Databse to a Postgres database. I Face the Following Error. How can I solve this?
GanesH RahuL
  • 431
  • 5
  • 16
1
vote
0 answers

Mysql to postgres Migration pgloader not working - No data imported No Errors

I tried the following command and it returns no errors but the data is not imported in my postgres database. Database is already created in Postgres. pgloader mysql://user:password@127.0.0.1/db_name…
GanesH RahuL
  • 431
  • 5
  • 16
1
vote
1 answer

pgloader not able to load Spanish Language characters

pgloader is failing to load Spanish language characters sets in PostgreSQL. Are there any settings in PostgreSQL and/or pgloader that need to be enabled before trying to transfer the data?
Bharat
  • 2,409
  • 6
  • 32
  • 57
1
vote
0 answers

migrating data from mysql to postgres pgloader IRONCLAD::SIMPLE-OCTET-VECTOR

I am migrating data from MySQL to Postgres using pgloader. My script works fine on my local machine. But as I am running pgloader to prod database it's giving me following error The value of SEQUENCE is "?;JAExN[^F#yZ:O_o3Mj...", which is not of…
Amar
  • 6,874
  • 4
  • 25
  • 23
1
vote
0 answers

Migration issue from mysql to postgresql using pgloader

While migrating from MySql to PostgreSQL it giving error- INFO: Control stack guard page unprotected Control stack guard page temporarily disabled: proceed with caution pgloader mysql://root:root@localhost/opdb1…
Rahul
  • 101
  • 1
  • 2
1
vote
0 answers

pgLoader connects but then hangs when connected to pgPool and not directly

So I am implementing HA on PostgreSQL 11. I have 2 VMs, and I am using pgPool to manage it. So far so good. Now, on the original DB1 VM I also had a few CSV files getting loaded using pgLoader. If I point pgLoader directly to the DB1 or 2 box it…
AstarAndy
  • 121
  • 1
  • 8
1
vote
0 answers

How to skip or modify an index in pgloader?

I have a MySQL database with a FULLTEXT index that I wish to port to Postgres. When I create a Postgres database using pgloader, the index in Postgres becomes this: "idx_33441_ibtsearchidx" gin (to_tsvector('simple'::regconfig, keywords)) Now, the…
Ray Toal
  • 86,166
  • 18
  • 182
  • 232
1
vote
0 answers

pgloader mysql to Postgres command line exclude table

I have the following command that works. pgloader --root-dir /tmp/ --with "batch rows = 500" --cast "type datetime to timestamp drop not null using zero-dates-to-null" --cast "type tinyint to smallint drop typemod" --cast "type timestamp to…
DAO
  • 41
  • 5
1
vote
0 answers

What type should I use for a python list for pgloader with postgresql?

My database looks like this: id standard_name organism pmid category_code sub_category_code members_ezid 0 AAANWWTGC_UNKNOWN Homo sapiens 15735639 C3 TFT ["4208", "481"] And then I want to execute the following file by pgloader csv.load to load…
j35t3r
  • 1,254
  • 2
  • 19
  • 53
1
2
3 4 5