Questions tagged [ilm]
26 questions
0
votes
1 answer
elascticsearch roll over based on ilm policy with keeping application/consumer as-is
I have an elasticsearch service which is a logging backend for our applications.
Application code is not open to us, so we can not change the application.
applications are calling elasticsearch in certain points in flow via http as below.
POST…
faruk
- 1
- 1
0
votes
0 answers
FuentD Rollover alias for AWS OpenSearch ILM
I have logging infrastructure setup with AWS OpenSearch, Fluent-bit (DaemonSet on EKS), FluentD (Deployment on EKS) and OpenSearch Dashboard.
I am working on the ILM policy and facing issue with the rollover. I am trying to achieve with the policy,…
srenukunta
- 1
- 3
0
votes
1 answer
ILM Policy not working (not deleting indices of settled duration)
I am using elk version 8.0.0 in Windows OS. There are totally of 3 elk nodes 2 logstash and 1 kibana node.
The ILM is not working based on the duration I set (ex:5mints,the data is not getting deleted).I have created ILM template and assigned…
user18859447
- 1
- 2
0
votes
1 answer
Using Elasticsearch ILM without Bootstraping the First Index
I am trying to set an ILM policy for an Elasticsearch cluster of 3 nodes (hot, warm and cold) whose logs are coming from Logstash. I need the indices to be rolled over after reaching to a specific size. Also title of each log's data source should be…
Mohammadreza Sahelgozin
- 166
- 1
- 8
0
votes
1 answer
minio ilm configuration suggestion needed
Hello Im working with minio these days and found out there is a feature which configures the life cycle of the minio objects, which is called ilm. And I can set the storage class as the tier to transit the object data to it.
the official explanation…
Jinyu
- 1
0
votes
1 answer
ILM policy and template
Can I know whether can I use ilm template for my custom index. Will it rollover if yes to what value? My index is created in logstash. My index is indexname-team. Will it rollover using the template? What is the name?
Devis
- 1
- 1
0
votes
0 answers
Elasticsearch ILM index data is not shifting/migrating
We have created ILM (index lifecycle management) policies, to automate index rollover using a matching index template and a bootstrap index to enable write index with an alias.
Please find the below API code:
Polices
{
"policy": {
"phases": {
…
Pradeep M Nayak
- 50
- 2
- 9
0
votes
1 answer
Does elasticsearch CCR feature replicates ILM?
It might that it is not correct question, but I have created ILM on my leader cluster, however I don't see that it is replicated to follower cluster.
Am I right in thinking that it should not be replicated at all because it is not related to index…
liotur
- 809
- 2
- 17
- 36
0
votes
0 answers
Read data from latest index generated by ILM policy rollover
I have both Elasticsearch and Logstash in version 7.9.1-1 installed. Here's the policy I've created:
PUT _ilm/policy/test-policy
{
"policy": {
"phases": {
"hot": {
"actions": {
"rollover": {
"max_age": "2d"
…
Rfroes87
- 668
- 1
- 5
- 15
0
votes
1 answer
elasticsearch template doesn't change index ILM
in my elasticsearch, I will receive daily index with format like dstack-prod_dcbs-. I want to add ILM to them, immediately after they are revived. I dont know why ILM are not added to indexs. below you can find my command.(I have already defined…
hossein bazrafkan
- 99
- 8
0
votes
1 answer
Issue setting up ElasticSearch Index Lifecycle policy with pipeline date index name
I'm new to setting up a proper Lifecycle policy, so I'm hoping someone can please give me a hand with this. So, I have an existing index getting created on a weekly basis. This is a third party integration (they provided me with the pipeline and…
ozonshak
- 1
- 1
- 2