Questions tagged [logical-decoding]

9 questions
3
votes
1 answer

What is the difference between Wal2json and Pgoutput?

We are working on building a ETL pipeline. And I have come across these two plugins for postgres to capture the writes and deletes of the table. Can someone please explain the differences between Wal2json and Pgoutput? What are the pros/cons and…
1
vote
1 answer

How to use exported snapshot in Postgres replication slot

I'm using the EXPORT_SNAPSHOT option documented here when creating a postgres logical replication slot. The documentation states that 'export, which is the default, will export the snapshot for use in other sessions. This option can't be used inside…
Jessica
  • 721
  • 1
  • 6
  • 13
1
vote
1 answer

Proper standby status update in streaming replication protocol

Question is about streaming replication protocol. Which is extremely simple, and was made for physical replication and is capable of: Sending server status > Primary keepalive message Receiving replica status > Standby status update Send WAL data >…
ubombi
  • 1,115
  • 2
  • 15
  • 30
1
vote
1 answer

How to do logical replication on cascading standby server on postgres?

Is it possible to enable logical replication on standby server which is in cascading replication mode?
1
vote
3 answers

PostgresQL: Is an entire transaction always written to a replication slot?

I have created a replication slot: SELECT * FROM pg_create_logical_replication_slot('boxoffice_slot', 'test_decoding'); Each step in a transaction has its own row in a replication slot. Here is an example: lsn | xid | …
malexanders
  • 3,203
  • 5
  • 26
  • 46
0
votes
0 answers

Encoding 0 to 255(1 Byte) range of 10 different values into 3 Byte length value and retrive it to original values

I need to solve the problem: I have 10 different bytes(2^8) and each byte value range is 0 to 255. It needs to encode into 3- bytes(2^24) length. Later I need to retrieve the original values from encoded 3-byte values. I tried Cantor and Szuszik…
0
votes
0 answers

How to interpret executable binary file

All these files without extension in Unix and the '.exe' in Windows are great ways to keep programs static; what I'm looking for is an interpretation of its binary content. I mean not to decode the content but to group it in a reliable manner.
0
votes
1 answer

Logical decoding - postgres - multiple output formats

I have been trying to build a pipeline using logical decoding of postgres. However, I am a little confused. Please find below the questions I have I have established a pub-sub and I can see the data flowing between the 2 servers. However, I haven't…
0
votes
1 answer

What is the best way to read from PgQ to Apache Kafka?

I want to capture data changes from few tables in a huge PostgreSQL database. Initially I planned to use the logical decoding feature with Debezium. But this solution has significant overhead since it's necessary to decode the entire WAL. Another…