Questions tagged [duplicity]

duplicity is an open source software to backup data incrementally in an encrypted format. It can save/upload the backup to local or remote destination. It is written in python and uses librsync.

104 questions
2
votes
0 answers

Duplicity "add-only" incremental backup

I have a large duplicity backup stored in a server that would be too slow and costly to fully restore, but I want to perform an incremental backup of a relatively small amount of data that was missing from the initial backup. I already have the…
Caian
  • 121
  • 1
2
votes
0 answers

Identify which volumes are needed for duplicity restore

Background I've been running Duplicity backup with the --s3-use-glacier option, and I'd like to restore a single file. I'm running the command duplicity restore --file-to-restore myfile.txt boto3+s3://mybucket/myprefix localdir As expected, I…
KQS
  • 121
  • 2
2
votes
1 answer

How can I remove a particular directory from a duplicity backup archive without affecting the rest of the backups, to save space?

Due to some really buggy software that likes to write its own backup files to its working area even when that it disabled, duplicity has backed up those backups resulting in several hundred GBs of useless data in its archives (I use duplicity to…
john01dav
  • 441
  • 1
  • 4
  • 8
1
vote
1 answer

Where does duplicity store the key that it creates?

I started a backup via duplicity without giving it any options. I haven't created any GPG keys myself, so when I ran duplicity, it asked me for a passphrase, then created a key, and successfully backed-up (to BackBlaze B2) with encryption and…
1
vote
2 answers

Duplicity error: BackendException: ssh connection to SERVER_IP:22 failed

This used to work just fine until I had to change the server ip. I can sftp to the server. I can also run a simple python code using paramiko to connect to sftp, and it works ok. But when I run duplicity, it fails: Duplicity error: BackendException:…
rlcabral
  • 183
  • 1
  • 1
  • 6
1
vote
1 answer

Have Duplicity use user's persistent gpg session when performing full filesystem backup?

I'm trying to set up automatic, full filesystem backups on my local system using Duplicity. I do not want to have to enter my password for it to encrypt a volume: what if I am not at the computer and the backup stalls? I absolutely do not want to be…
Kevin Smith
  • 151
  • 1
  • 4
1
vote
1 answer

Why is posix.lstat taking such a long time? (duplicity backing up of 9p virtio filesystem)

I have a filesystem mounted with 9p virtio through KVM, and am backing it up using duplicity to a remote SSH server. I' m trying to speed up the backup process, which seems unreasonably slow to me. The source size is 20GB in 107.651 files, which are…
jjakob
  • 51
  • 1
  • 5
1
vote
1 answer

duplicity s3 backup from centos

I'm trying to backup server data to S3 but getting no success. Below is the script which I run to start backup on S3. I have create a user using IAM and have granted all permissions to the user. #!/bin/bash export AWS_ACCESS_KEY_ID="access key…
maqsimum
  • 61
  • 6
1
vote
1 answer

Restore from Amazon S3 with dupy - duplicity on a new machine

I am trying to restore a full backup in a new machine but it seems that is not working. I installed my pgp's and secret keys. Also I copied my project from duply but when I run duply test restore /tmp/test/ I got that: --- Start running command…
gerardribas
  • 121
  • 5
1
vote
1 answer

Using duplicity in a disaster recovery scenario

I am using duplicity for backups on my Debian servers. I have successfully backed up and restored files using duplicity. In my backup script, I have /usr/bin/dpkg --get-selections > /installed_packages_ so that I can backup the package…
AWippler
  • 1,065
  • 1
  • 12
  • 32
1
vote
0 answers

Duplicity -> S3 backup failing with "[Errno 105] No buffer space available"

I have a nightly script on my Ubuntu 10.04 VPS which uses duplicity (0.6.24) to run incremental, encrypted backups to Amazon S3. This script had been working until a month or so ago when it started failing with errors like the following: Upload…
Greg
  • 239
  • 1
  • 12
1
vote
1 answer

Faster picking of files from a tar archive

We've got a collection of servers that we're backing up using Duplicity. We're trying to build some functionality for our staff so that they can select a file and view the available versions for restore. Duplicity stores its metadata in tar files…
Sammitch
  • 2,111
  • 1
  • 21
  • 35
1
vote
0 answers

Duplicity: is it possible to restore files from a backup that has not been updated in six months?

I need files from an old server that ran a daily duplicity backup and was deactivated six months ago. The backup files are store in an Amazon S3 bucket and the last backup was made about six months ago. When I try to restore it using duplicity, It…
cfragni
  • 11
  • 3
1
vote
2 answers

duplicity sftp backup encryption

I'm very new to linux and I am running difficulties with duplicity. I am currently trying to create a backup script using duplicity and backing up over sftp and I am not sure if I am already encrypting the backup. The following is the code I'm…
bash-
  • 797
  • 2
  • 6
  • 10
1
vote
1 answer

Duplicity fails on Too many open files?

I'm using Duply on top of Duplicity but apparently it fails (after 10 min on 100% cpu) on gnupg --- Start running command BKP 21:10:58.679 --- NcFTP version is 3.2.2 Reading globbing filelist /root/.duply/offsite/exclude Local and Remote metadata…
Paté
  • 115
  • 1
  • 5