Questions tagged [elasticsearch-snapshot]
16 questions
4
votes
2 answers
elasticsearch on docker - snapshot and restore - access_denied_exception
I created elasticsearch cluster flowing by the article: Running the Elastic Stack on Docker
After the elasticsearch runs, I need to create snapshot and restore to backup my data.
I modified my elastic-docker-tls.yml file:
version: '2.2'
services:
…
Minh Giang
- 631
- 9
- 28
3
votes
1 answer
Unable to restore elasticsearch snapshots from S3 using the repository-s3 plugin after nodes data directory got deleted from all nodes
I am using repository-s3 plugin for snapshot and restore with elasticsearch 7.5.1.
I created snapshot policies and took snapshot of specific indices, confirmed that they existed in my S3 bucket. Now due to some reason, I had to delete data from all…
Arnav Singh Chauhan
- 87
- 4
2
votes
0 answers
Elasticsearch - repository_exception
While restoring the index via snapshot, I am getting repository_exception.
Error - Could not read repository data because the contents of the repository do not match its expected state. This is likely the result of either concurrently modifying the…
Sumit Suman
- 71
- 1
- 6
1
vote
1 answer
Deleting a Elasticsearch Snapshot
We have a elasticsearch cluster running on EKS, and we have configured a daily snapshot for the cluster onto S3. We have now a lot of data piled up on S3, and for cost optimisation we are planning of deleting any snapshots older than 2…
user517696
- 2,472
- 7
- 24
- 35
1
vote
1 answer
AWS ElasticsearchService: Automated snapshot is running for more than 20days
We are experiencing lot of failures with ElasticSearch queries for few days. When I monitor the cluster health CPU/JVM Memory utilization is high (almost 98%).
While debugging the issue, I found that last automated snapshot is i IN_PROGRESS state…
Venkat Papana
- 4,757
- 13
- 52
- 74
1
vote
1 answer
How does Elasticsearch incremental snapshots deal with the deleted docs?
I regularly take a snapshot of my ES cluster in a s3 bucket and so i wanted to know that if i am deleting my old docs from the cluster and regularly adding new docs then after taking a snapshot how does ES deal with this scenario wheather the docs…
Yash Tandon
- 345
- 5
- 18
1
vote
1 answer
How to manually invoke snapshot endpoint for ElasticSearch using JestClient
I'm already using JestClinet for all my CRUD operations on my ES on AWS. Now I'm trying to snapshot my ES as described in
https://docs.aws.amazon.com/elasticsearch-service/latest/developerguide/es-request-signing.html
Instead of using another…
Venkat Papana
- 4,757
- 13
- 52
- 74
1
vote
1 answer
Unable to register snapshot repository for AWS elasticsearch in fs
I am trying to register a snapshot repository on AWS Elasticsearch/OpenSearch. I am getting the following error: "Message":"User: anonymous is not authorized to perform: iam:PassRole on resource: arn:aws:iam::$$$$$:user/Elasticsearch"}
Below is my…
ARUN R
- 31
- 1
- 5
0
votes
1 answer
Elasticsearch snapshot for a cluster
I have a Elasticsearch cluster running with three nodes.
and have created a snapshot repository for the cluster, and trying to create a snapshot manually using,
10.0.0.120:9200/_snapshot/$REPO_NAME/$SNAPSHOT_NAME
But I am not sure if I have to…
sjsj15
- 745
- 6
- 11
0
votes
1 answer
Elasticsearch Restoring large snapshot incomplete due to size
I have a project where I need to restore a couple of snapshots one at a time in a read-only instance and reached a snapshot that is larger than the size I have on the machine and cannot increase size or add another node. I am filtering also by…
Andrei Budaes
- 591
- 7
- 22
0
votes
1 answer
How to read Elasticsearch snapshot files in python?
I have an ES cluster for which we started to stream data using an Azure Function (on python) into Azure Blobs. Basically, I am getting the last 5 min data in JSON format, compressing the list of JSON's and storing them on the Blob for live data. We…
Andrei Budaes
- 591
- 7
- 22
0
votes
1 answer
How to take snapshots of specific indices in Elastic Cloud Enterprise?
In Elastic Cloud UI, You can take snapshots/backup of your entire on-disk data and store it in a file shared system, say, Object Store S3.
How do I backup only certain indices instead of all with using Elastic Cloud UI only? Is there a way?
If…
bosari
- 1,922
- 1
- 19
- 38
0
votes
1 answer
How to delete a snapshot data in Elasticsearch?
When a repository is unregistered, Elasticsearch only removes the
reference to the location where the repository is storing the
snapshots. The snapshots themselves are left untouched and in place.
So Elasticsearch DELETE /_snapshot/my_backup…
eugene
- 39,839
- 68
- 255
- 489
0
votes
1 answer
How to delete ElasticSearch snapshots by prefix
I'm taking ES snapshots for every 15min, snapshot name will be in the format es-snapshot-YYYY-MM-DD-HH-MM-SS
Two questions:
As per documentation it will be incremental, and I never attempted to delete any. But after 3months, now I couldn't able to…
Venkat Papana
- 4,757
- 13
- 52
- 74
0
votes
1 answer
"Read-only file system" error while creating snapshot in elasticsearch with multiple-nodes
I have setup an Elasticsearch cluster with 2 nodes. I'm trying to implement the Snapshot-Restore process now. But I get this "Read-only file system" Error. And I'm unable to create the snapshot because of this error.
I have created a directory in…
Sowjanya R Bhat
- 1,128
- 10
- 19