Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [amazon-glacier]

Amazon Glacier is a low-cost storage service that provides secure and durable storage for data archiving and backup.

49 questions
2
votes
1 answer

AWS Glacier inventory is either wrong or asynchronous?

Using Boto3, I uploaded 12 files to Amazon's Glacier last night at 21:43 EST. I received ArchiveID's for all 12 files, so I assume they uploaded correctly. According the the AWS management console, the most recent inventory was run at 02:53 EST…
Nertskull
  • 141
  • 5
2
votes
1 answer

AWS Glacier archives auto deletion

Is it possible to delete old archives from the vault automatically somehow? For example I want to delete old archives which are older than 160 days.
Vasiliy Plotnikov
  • 31
  • 1
2
votes
1 answer

How best to structure Glacier backups?

I'm planning to back up multiple websites to Glacier at midnight each day. My current system is to create a tar.gz of the whole of /var/www (i.e. all the sites), and to copy that to a different server. I'm assuming I would use these backups if the…
Rich Bradshaw
  • 177
  • 1
  • 8
2
votes
1 answer

Using pv with a Python script: monitoring progress when uploading to AWS Glacier using the boto glacier utility

I am looking to use boto's glacier command line tool to upload data to AWS Glacier. I'd like to monitor the progress of my upload. Normally I use pv to monitor progress. I've perused the code of the glacier tool to see whether it reads data from…
Dmitry Minkovsky
  • 557
  • 3
  • 9
  • 22
2
votes
1 answer

S3 PUT directly to glacier

This AWS post from 2018 makes it sound like it should be possible to make S3 style PUT requests to create archives in glacier now: I'm interpreting that to mean that you could use the s3 CLI or sdk interactions for uploading files, rather than the…
Ben Pennell
  • 123
  • 1
  • 4
1
vote
1 answer

If I already have files in an S3 bucket in the Glacier storage class, what happens if I apply a bucket policy to move to Glacier after 1 day?

We have a pre-existing S3 bucket that we are looking to add a lifecycle policy to in order to move large files in S3 standard to Glacier. The bucket already contains items with the Glacier storage class (changed manually via console). How does the…
definitelynotarobot
  • 11
  • 1
1
vote
3 answers

How to automatically archive AWS S3 whole buckets to S3 Glacier?

I'm required to archive around 200 AWS S3 buckets to S3 Glacier and I would like to do it automatically but I can't find how it can be done with aws-cli. The only method I found, is through AWS UI... to go to each bucket manually and within it, to…
Itai Ganot
  • 10,644
  • 29
  • 93
  • 146
1
vote
1 answer

Minimum AWS policy actions required for retrieving Glacier files through S3?

I'm trying to create a policy for an IAM account that will allow an employee to have full read permissions for our S3 (lifecycled to Glacier) buckets, with no unnecessary write abilities as to avoid any kind of damage to our backups. This version…
Cyanara
  • 123
  • 1
  • 11
1
vote
2 answers

CloudBerry Backup (Linux) to Amazon Glacier

With the sunset of CrashPlan I'm exploring different options for backup; Cloudberry with Amazon Glacier seems like a good option. I've been able to set up my Windows machine to backup locally and to the Glacier without issues, but can't seem to find…
Nick
  • 113
  • 2
1
vote
1 answer

AWS Glacier for backups with Vault Lock, but still removable in extreme cases

My company maintains data for a number of large corporate customers. The data is everything in the company, and loss of the data would probably mean losing all our customers. This means I ideally need a backup strategy that really secures the data…
Claude
  • 196
  • 1
  • 3
1
vote
0 answers

Is it possible to choose the Amazon Glacier Vault when backing up from Synology NAS?

I am using Amazon Glacier Backup on a Synology NAS (rackstation). But the Synology backup software for glacier does not allow me to choose the vault to backup to. This means I can not give my own name to the vault, but also I can not backup to a…
Jorrit Reedijk
  • 169
  • 2
  • 12
1
vote
1 answer

Glacier retrieval notification of s3 objects

I have some s3 buckets which send their objects to glacier after x days of creation. When I go to retrieve those objects on the s3 interface, I need to keep reloading page to see when restoration has finished so object is ready for download. I'd…
alexandresaiz
  • 111
  • 4
1
vote
1 answer

How fast are transfers from Amazon EC2 to Amazon Glacier?

I am using a large, 1st generation instance on Amazon EC2 in the us-east-1 region, and would like to transfer data to Amazon Glacier. I will be transferring data from the instance's ephemeral storage. What are the data transfer rates I can expect?
Dmitry Minkovsky
  • 557
  • 3
  • 9
  • 22
1
vote
1 answer

Uploading a seemingly large (~200 GB) archive to Amazon Glacier

I am seeking to upload a 200+ GB archive to Amazon Glacier—a single .tgz. Wondering if anyone has had experience with this, and whether this seems extraordinary to accomplish without timeout issues, etc. On one hand, 200 GB is a lot of data. On the…
Dmitry Minkovsky
  • 557
  • 3
  • 9
  • 22
1
vote
1 answer

Incremental backups from Rackspace Cloud Files to Amazon Glacier

Is there a software product/module (open-source or commercial) that can provide incremental backups from Rackspace Cloud Files to Amazon Glacier? We are looking for something that will provide the following functionality (or achieve the same result,…
Martin Wilson
  • 121
  • 5
1
2
3 4