Questions tagged [pgbackrest]

pgBackRest aims to be a reliable, easy-to-use backup and restore solution that can seamlessly scale up to the largest databases and workloads by utilizing algorithms that are optimized for database-specific requirements.

pgBackRest is a way to get reliable scalable backup and restore of PostgreSQL databases. It has several features including:

  • Parallel Backup & Restore using algorithms like lz4 and zstd.
  • Local or Remote Operation using a custom protocol; can use TLS/SSH with minimal configuration
  • Multiple Repositories allow, for example, a local repository with minimal retention for fast restores and a remote repository with a longer retention for redundancy
  • Full, Incremental, & Differential Backups which are not susceptible to the time resolution issues of rsync
  • Backup Rotation & Archive Expiration; the WAL archive can be maintained for all backups or strictly for the most recent backups
  • Backup Integrity where checksums are calculated for every file in the backup and rechecked during a restore or verify
  • Page Checksums can validate the checksums for every file that is copied during a backup
  • Backup Resume from the point where it was stopped
  • Streaming Compression & Checksums while files are being copied to the repository
  • Delta Restore to speed processing enormously
  • Parallel, Asynchronous WAL Push & Get
  • Tablespace & Link Support are fully supported and on restore tablespaces can be remapped to any location
  • S3, Azure, and GCS Compatible Object Store Support
  • Encryption
  • Compatibility with ten versions of PostgreSQL
27 questions
0
votes
0 answers

TimescaleDB archiving with retention policy

I’m looking at archiving data with TimescaleDB. Typically, I want to have TimescaleDB running on a box with little disk space and continuously archive it to an S3 bucket. To do so, I’m using pgBackRest. The issue is I have a data retention policy on…
0
votes
0 answers

Pgbackrest error "a timeline switch has occurred"

I use Crunchy Postgres on openshift 4.10. There are some scheduled backup with pgbackrest. Today I got some error Pods with below messages: Error Pod 1 time="2023-03-16T01:00:02Z" level=info msg="crunchy-pgbackrest…
Eric
  • 11
  • 2
0
votes
1 answer

Error when using TLS server with pgBackRest : [113] No route to host

I´m trying to implement the TLS server feature available with pgBackRest to use a secure connection between the DB server and the repo server, replacing the previous SSH passwordless setup (that was working fine). After following the online…
rook
  • 5
  • 2
0
votes
2 answers

Solutions for restarting Postgres when pg_wal full

This question is a follow up on a previous question I posted about efficient ways to max up Postgres pg_wal directory (for training purposes) : How to bloat pg_wal?. I'm now wondering what are the possible solutions for getting a Postgres server up…
rook
  • 5
  • 2
0
votes
1 answer

PGBACKREST: Local backup works but remote backup to S3 FAILS

I am setting up pgbackrest to save wal archives to S3. I have two machines. When I used to take backup on the localhost, I am able to save it to S3. However, when I initiate backup from 'backup server' it fails. Backup server…
Swaym
  • 11
  • 4
0
votes
1 answer

how to get a clean array as output

As input I have: [ { "backup": [ { "timestamp": { "start": 1642144383, "stop": 1642144386 }, "info": { "size": 1200934840}, "type": "full" }, { "timestamp": {"start": 1642144388, "stop": …
user123664
0
votes
2 answers

how to denormalise this json structure

I have a json formatted overview of backups, generated using pgbackrest. For simplicity I removed a lot of clutter so the main structures remain. The list can contain multiple backup structures, I reduced here to just 1 for simplicity. [ { …
user123664
0
votes
1 answer

Errors when recovering postgres cluster with pgbackrest from s3

I want to test restore cluster using backup from s3 via pgbackrest I have: OpenShift 4.7 PGO Image Tag: centos8-13.2-4.6.2 Postgres Version 13 How to reproduce: Step1: I install crunchy operator and create cluster: pgo create cluster example-db \ …
0
votes
1 answer

PgBackRest backup multiple clusters in mutliple S3 bucket

I manage 3 PostgreSQL clusters each composed of a Leader node and two Replicas. I have to use PgBackRest to manage these backups. PgBackRest runs on its own node. However, reading the documentation it seems that the concept of Stanza exists to…
Salvatore D'angelo
  • 1,019
  • 3
  • 14
  • 39
0
votes
1 answer

Boot backup image of server when postgres replication configured

I am running a server in Linode. I am backing up to a s3 type server using pgbackrest. Streaming backup. Linode takes a complete image of my server. I am spinning up a server using a backup image to test a linux upgrade. My concern is that Postgres…
Kevin Gill
  • 407
  • 1
  • 5
  • 14
0
votes
1 answer

pg_wal is taking a lot of disk space

I have installed postgres in a containerized environment using docker-compose, for that I have used this docker image crunchydata/crunchy-postgres-gis:centos7-11.5-2.4.2, all was running right till I realized that PG_DIR/pg_wal is taking a lot of…
Khalil Meg
  • 731
  • 10
  • 14
0
votes
1 answer

ERROR: [050]: unable to acquire lock on file '/tmp/pgbackrest/demo-archive.lock': Permission denied

I have been trying to load data incrementally in postgres on linux(ubuntu) from the source (https://access.crunchydata.com/documentation/pgbackrest/2.00/pdf/backrest.pdf) while I am trying to create a stanza I am getting the following error. As I am…
1
2