Stack Overflow
Stack Overflow

Questions tagged [amazon-glacier]

Amazon Glacier is an online storage service intended to provide durable and secure long-term storage for the purposes of archiving and backup of large amounts of data. Glacier is lower cost than the other Amazon storage offerings, primarily because it's optimized for infrequent access.

Amazon Glacier is an online storage service offered as part of Amazon Web Services.

Glacier is intended to provide durable and secure long-term storage for the purposes of archiving and backing up of larger amounts of data, ultimately intended to compete with backup and storage systems that companies often must maintain.

It is differentiated from the other storage offerings from Amazon - S3 (Simple Storage Service) and EBS (Elastic Block Store) - in that it's designed for extremely infrequent access of the data stored inside its 'Vaults', whereas those services are designed such that objects stored inside them are highly available to be manipulated and/or served in real-time to Amazon EC2 servers (in the case of EBS), or web clients (in the case of S3).

Glacier is significantly lower cost than the other Amazon storage offerings, primarily because it's optimized for infrequent retrievals of data, however the delay period between requesting a data retrieval and the 'Vault' content becoming available makes it unsuitable for real-time use as a storage system.

331 questions
6
votes
3 answers

Unable to download aws s3 glacier objects

I was trying to copy all the files from my S3 bucket to a local folder in VM and I am getting the following error: warning: Skipping file s3://bucket/object. Object is of storage class GLACIER. Unable to perform download operations on GLACIER…
snehab
  • 684
  • 5
  • 13
6
votes
1 answer

Amazon AWS S3 Glacier: is there a file hierarchy

Does Amazon AWS S3 Glacier support some semblance of file hierarchy inside a Vault for Archives? For example, in AWS S3, objects are given hierarchy via /. For example: all_logs/some_sub_category/log.txt I am storing multiple .tar.gz files, and…
Intrastellar Explorer
  • 3,005
  • 9
  • 52
  • 119
6
votes
2 answers

GlacierSelectNotAvailable: Glacier select retrievals are currently not available, please try again later

When I restore glacier archive file in s3,I am facing with GlacierSelectNotAvailable error. I try to setting up the params of restoreObject but I keep getting that error. I use Nodejs AWS SDK. var params = { Bucket: 'test_bucket', Key:…
user3156613
  • 73
  • 6
6
votes
2 answers

How can I backup Google Drive into AWS Glacier?

I want to backup whatever new file or folder added to my Google Drive into AWS Glacier through a linux instance running in an EC2 instance. I have gone through some AWS Glacier clients, but they are for uploading files from and downloading to local…
Sagar Ajmire
  • 333
  • 3
  • 13
6
votes
1 answer

How to move object from Amazon S3 to Glacier with Vault Locked enabled?

I'm looking for a solution for moving Amazon S3 objects to Glacier with Vault Lock enabled (like described here https://aws.amazon.com/blogs/aws/glacier-vault-lock/). I'd like to use Amazon built in tools for that (lifecycle management or some…
Joosep Simm
  • 462
  • 1
  • 5
  • 13
6
votes
2 answers

Downloading a large archive from AWS Glacier using Boto

I am trying to download a large archive (~ 1 TB) from Glacier using the Python package, Boto. The current method that I am using looks like this: import os import boto.glacier import boto import time ACCESS_KEY_ID = 'XXXXX' SECRET_ACCESS_KEY =…
sahoang
  • 375
  • 3
  • 9
6
votes
2 answers

Glacier retrieval notification of s3 objects

I have some s3 buckets which send their objects to glacier after x days of creation. When I go to retrieve those objects on the s3 interface, I need to keep reloading page to see when restoration has finished so object is ready for download. I'd…
alexandresaiz
  • 2,678
  • 7
  • 29
  • 40
5
votes
1 answer

Any limitation on number of s3 lifecycle rules?

I want to move some millions of s3 objects to glacier. path/to/object1/1.jpg path/to/object2/2.jpg ... So I will set s3 lifecyle rules like this. Rule 1 prefix: path/to/object1/1.jpg Rule 2 prefix: path/to/object2/2.jpg ... Rule n prefix:…
DAESEONG KIM
  • 371
  • 3
  • 12
5
votes
2 answers

Restore object from AWS Glacier to S3

I have configured life cycle policy in S3, some of objects in S3 are stored in Glacier class, some of object are still in S3, now I am trying to restore objects from Glacier, I can get object list in S3 by java AWS SDK, how can I know which object…
Xiaomeng Yi
  • 137
  • 2
  • 8
5
votes
1 answer

How to upload large archive to Amazon Glacier using ruby and aws-sdk?

The amazon documentation for glacier doesn't seem to include any Ruby examples and the documentation itself is rather sparse. I gather I need to instantiate a Glacier Client object and then use the upload_multipart_part method to access the Glacier…
Ben
  • 432
  • 5
  • 16
5
votes
1 answer

Linux backup service with Glacier support

I`m using bacula + s3fs to make backups on S3 but it doesn`t support Glacier. Is there something like Bacula with Glacier support? I need different backup polices (FULL,INCREMENTAL ... e.t.c.) edit backup jobs from single place monitoring of…
glebiuskv
  • 321
  • 4
  • 13
5
votes
1 answer

AWS S3 to Glacier: did backup work?

I am experimenting with backing up data in my Amazon S3 folders to Glacier using lyfecycle management options. I chose one of the folders in the bucket for the testing and created a lifecycle rule that states that objects with that prefix need to be…
I Z
  • 5,719
  • 19
  • 53
  • 100
5
votes
1 answer

Boto AWS Glacier - Retrieve archive

I'm actually using python boto to store data on my glacier's vault and launch retrieve jov and inventory job. This works quite well. But i didn't find any example about the method to use to download an archive from glacier? I had launch retrieve jov…
Peter Stew
  • 81
  • 1
  • 3
4
votes
3 answers

Apply encryption to existing S3 objects without impacting storage class

I am trying to encrypt an existing s3 bucket. When I do this: aws s3 cp s3://test/ s3://test/ --recursive --sse it is encrypting all the files in the bucket by re-copying the objects. My issue here is that I have objects in the bucket in Standard,…
Putharekulu
  • 131
  • 2
  • 13
4
votes
4 answers

Restoring data from Amazon Glacier

Is there a command line way to restore data from Glacier? So far I have tried: s3cmd restore --recursive s3://mybucketname/folder/ aws s3 ls s3:// | awk '{print $4}' | xargs -L 1 aws s3api restore-object --restore-request Days=…
Shabbir Bata
  • 861
  • 2
  • 11
  • 23
1 2
3
…
22 23