Stack Overflow
Stack Overflow

Questions tagged [pgloader]

75 questions
1
vote
1 answer

Postgresql Encoding Issue Using tsearch With Thai Text After Conversion from MariaDB using Pgloader

I am trying to convert a MySQL UTF8mb4 database which contains both Thai and English to Postgresql. This appears to go well until I try and add tsearch. Let me outline the steps taken. Install this Thai parser…
gordonbanderson
  • 221
  • 2
  • 5
1
vote
2 answers

How to parse CSV with pgloader or PostgreSQL copy when there's a \n (line break) inside double quotes?

I have a csv line like this: "aaa"|"bbb"|"ccc"|"dddd eeeee" I want to import this data using pgloader (http://pgloader.io/) or PostgreSQL COPY (https://www.postgresql.org/docs/9.6/static/sql-copy.html). My issue here is the fact tha according to…
Jonathas Pacífico
  • 668
  • 9
  • 18
1
vote
1 answer

Load data into Postgres from MySQL

I have a database hosted on Amazon RDS. I am developing a Rails application with primary database as PostgreSQL. The Postgres database needs to be updated with data from RDS. I need to pull records from MySQL and then load it into Postgres. Also,…
nishant
  • 896
  • 1
  • 8
  • 27
1
vote
1 answer

Postgres-pgloader-transformation in columns

Loading flat file to postgres table.I need to do few transformations while reading the file and load it. Like -->Check for characters, if it is present, default some value. Reg_Exp can be used in oracle. How the functions can be called in below…
Raja
  • 507
  • 1
  • 6
  • 24
0
votes
0 answers

PGLOADER migrating from MariaDB to PostGRE hangs error "table or database name 'untitled folder'"

I seems that pgloader is not migrating my database. it hangs after the connection after waiting a long time I ctl + c and it brings error below and no return to shell An unhandled error condition has been signalled: Interactive interrupt at…
Sam
  • 1,557
  • 3
  • 26
  • 51
0
votes
0 answers

Error while parsing load file in Pgloader

I'm trying to migrate MySql db to Postgres by Pgloader using docker-container. I've create separate config file from_mysql_to_postgre.load: LOAD DATABASE FROM mysql://xxx INTO postgresql://yyy WITH data only, workers = 8, concurrency =…
Timothy
  • 584
  • 3
  • 14
0
votes
0 answers

KABOOM! UNDEFINED-COLUMN: Database error 42703: column does not exist

I am having a very difficult time getting pgloader to convert a mysql to postgres on one specific database. I get the following error message when running pgloader [root@38AA08C pgsql]# pgloader pg_load 2023-06-21T03:13:59.006000+01:00 LOG pgloader…
Richard PB
  • 55
  • 1
  • 4
0
votes
0 answers

pgloader: Migrate SQL Server database to PostgreSQL: How to filter by scheme?

I'm learning pgloader. I want to migrate a database in SQL Server to PostgreSQL but only certain schemas. In the documentation, I have noted the following: including only table names like 'GlobalAccount' in schema 'dbo' Following this example, I…
Juan Solo
  • 359
  • 1
  • 5
  • 17
0
votes
0 answers

How do you build pgloader from source using "make pgloader"?

I am trying to migrate a MySQL db to Postgres. From what I've read online, it seems like pgloader is the best tool for this. Background: I installed pgloader with apt-get, but ran into an error when running the migration: $ pgloader…
coniferous
  • 67
  • 8
0
votes
0 answers

PGLoader overload mysql default CAST

In my case scenario, I have to migrate a database from MySQL to Postgres, for our backend whose schema is managed by a liquibase script (this is a spring/hibernate project). The schema is created by Liquibase, so I'm only moving the data. The…
Baylej
  • 53
  • 7
0
votes
0 answers

pgloader - invalid input syntax for type integer

This is my first time with pgloader, I'm trying to load a CSV file to my ddbb, and I'm receiving an error that I can't solve. This is my code: LOAD CSV FROM 'csvload.csv' WITH ENCODING UTF-8 HAVING FIELDS ( id, …
user68481
  • 9
  • 2
0
votes
0 answers

Postgres to postgres pgloader MATERIALIZE VIEWS

I'm trying to understand the docs https://pgloader.readthedocs.io/en/latest/ref/pgsql.html#materialize-views. How would I make a command file for pgloader that would use this. What I have is load database from pgsql://user:test@127.0.0.1:8081/db…
eemilk
  • 1,375
  • 13
  • 17
0
votes
0 answers

Issue in pgloader in version postgres Version 14

Error - Pgloader 19 fell through ECASE expression wanted one of (0 2 3 4 5 6 7 8) Current version - pgloder version 3.6.2 Postgres Version -14 It working in 12 version successfully
SamirMjs
  • 1
  • 2
0
votes
0 answers

Check successfull cronjob/pgloader

im using crontab on a server to run a shell script which uses pgloader to load data into a postgresql everyday and i have bitbucket pipeline with a python script that runs every week, but i want the bitbucket pipeline only to run if the cronjob was…
Teatimeman
  • 41
  • 4
0
votes
0 answers

pgLoader Error multiple threads accessing the same hash-table?

I'm trying to migrate from mysql 5.7 to Postgres 14 with this command pgloader mysql://root:pass@host/db postgresql://supabase_admin:pass@localhost:5433/db but I get this error 2022-11-16T12:56:50.633053-05:00 ERROR A thread failed with error:…
Humzaa Omar
  • 53
  • 1
  • 4
1 2
3
4 5