Stack Overflow
Stack Overflow

Questions tagged [wal-e]

wal-e is a PostgreSQL backup tool to simplify management of continuous archiving of WAL segments

The project home page: https://github.com/wal-e/wal-e

13 questions
3
votes
1 answer

Physically recover heroku postgresql database

Heroku makes clear in its documentation and in its blog that it stores postgres database physical backups (that's binary copies of the database cluster files) in S3 using its software called wal-e. Does somebody know if there is a way for the final…
Waiting for Dev...
  • 12,629
  • 5
  • 47
  • 57
2
votes
1 answer

Error Converting Docker Commands to docker-compose.yml

When trying to translate the following 2 docker commands into a docker-compose.yml using Compose version 3 docker run​ \ --name timescaledb \ --network timescaledb-net \ -e POSTGRES_PASSWORD=insecure \ -e…
Nyxynyx
  • 61,411
  • 155
  • 482
  • 830
2
votes
1 answer

wal-e/wal-g any benefit for simple backup and restore via S3

I'm using AWS RDS and have a need to replicate "database_a" in an RDS instance to "database_a" in a different RDS instance. The replication only needs to be once every 24 hours. I'm currently solving this with pg_dump and pg_restore but am…
rix
  • 10,104
  • 14
  • 65
  • 92
2
votes
1 answer

Running command line results in module not found as user postgres

Im trying to run a package wal-e which I have installed as user root with sudo python3 -m pip install wal-e[aws,azure,google,swift]. I can run this command perfectly as user root using envdir /etc/wal-e.d/env wal-e backup-fetch…
Andrew Graham-Yooll
  • 2,148
  • 4
  • 24
  • 49
2
votes
0 answers

wal-e backup-push not terminating (waiting for required WAL segments to be archived)

Trying to setup wal-e for postgres. Following various tutorials and I'm at a point to finally do a first backup of a clean 9.6 postgres install. Followed some tutorials and finally read to do an initial wal-e backup-push, as follows: sudo -u…
Geert-Jan
  • 18,623
  • 16
  • 75
  • 137
1
vote
0 answers

Index corrupted after restore PostgreSQL database

We use WAL-E to backup and restore a PostgreSQL database (version 9.5.13), We found that a few indexes (not all) were broken after restored, most of them are related to String type fields. For example, using analyze explain we can see the following…
Paul Zeng
  • 11
  • 2
1
vote
1 answer

Securely transferring data from Postgres to Amazon S3 using WAL-E

I want to use WAL-E to backup my PostgreSQL data to Amazon S3. I am trying to determine if the data is encrypted in transit from Postgres to S3 using SSL/TLS but the documentation is not entirely clear on this point. I see WAL-E uses boto library…
Marco Di Cesare
  • 133
  • 2
  • 7
0
votes
1 answer

Docker network disconnect

I'm following this guide on how to set up docker with timescale/wale for continuous archiving. https://docs.timescale.com/timescaledb/latest/how-to-guides/backup-and-restore/docker-and-wale/#run-the-timescaledb-container-in-docker Everything runs as…
Nicole Staline
  • 557
  • 4
  • 15
0
votes
1 answer

Wal-e: unable to to push backups - permission error

We get the following error when we try to push backup using wal-e: 2020-07-16T21:18:55Z ([ExtendedTarInfo(submitted_path='/var/lib/postgres)> failed with…
gvalmon
  • 938
  • 5
  • 18
0
votes
1 answer

Python: Permission denied error while setting up archive database

I was setting up scheduled backup of my postgresql database on my server using wal-e. I was following this link. (Just have a look at the article from Step 3) When I execute the below command after initial setup . sudo -u postgres /usr/bin/envdir…
Umesh Malhotra
  • 967
  • 1
  • 10
  • 25
0
votes
1 answer

Postgresql: How to take incremental backup with wal-e

I am new to postgresql. I've connected to my demo database with psycopg2 and inserted data with python faker. I want to take incremental backup with the tool WAL-E and want to see how it actually works. But the few tutorials aren't helping that much…
Proteeti Prova
  • 1,079
  • 4
  • 25
  • 49
0
votes
1 answer

wal-e backup-push error on Azure

I am getting the following error on executing the backup-push command: # envdir /etc/wal-e.d/env wal-e backup-push /var/lib/postgresql/9.5/main wal_e.main INFO MSG: starting WAL-E DETAIL: The subcommand is "backup-push". STRUCTURED:…
user3068649
  • 411
  • 3
  • 13
0
votes
2 answers

WAL-E: Cannot restart postgresql after backup-fetch

This is on Ubuntu 14.04 LTS EDIT: WAL-E installed using pip, with secret keys managed by envdir, according to the instructions https://gist.github.com/elithrar/8682235 and https://github.com/wal-e/wal-e#dependencies. I am trying to restore a…
zugzwang
  • 293
  • 3
  • 10