Stack Overflow
Stack Overflow

Questions tagged [amazon-elasticsearch]

Amazon Elasticsearch Service is a managed Elasticsearch offering as part of Amazon Web Services.

248 questions
3
votes
1 answer

Indexing on Amazon Elasticsearch Service - Bulk Insert

I have an Amazon Elasticsearch instance which is active, and I'm able to connect and execute statements through 'Sense' from Chrome. But when I try to do bulk inserts, it shows 'timeout' error. I've been trying through both Python (bulk helper) and…
Hari Shreyas
  • 65
  • 1
  • 8
3
votes
3 answers

Is it possible to transfer data from Redshift to Elasticsearch?

I'm working on something related to Amazon elasticsearch service.For that,I need to get data from Amazon Redshift.The data to be tranfered is huge i.e. 100 GB.Is there any way to get it directly form Redshift or is it a two step process like…
AV94
  • 1,824
  • 3
  • 23
  • 36
2
votes
2 answers

How to synchronize MySQL database with Amazon OpenSearch service

I am new to Amazon OpenSearch service, and i wish to know if there's anyway i can sync MySQL db with Opensearch on real time. I thought of Logstash but it seems like it doesn't support delete , update operations which might not update my OpenSearch…
Simo
  • 29
  • 1
  • 2
2
votes
1 answer

Index State Management - Setting replicas to 0 fails once moved to ultrawarm storage

I have an elasticsearch cluster managed by AWS Elasticsearch Service. I am setting up a hot-warm policy to move indices older than 8 days into ultrawarm storage. I want to reduce the replicas to 0 as the ultrawarm nodes are backed by S3 and say that…
Dónal Tuohy
  • 31
  • 2
2
votes
1 answer

Can I use fine-grained access control in Amazon Elastic Search leveraging an external Access management system?

I am working on a search service. My Spring Boot search service stands between my internal userbase and my Amazon Elastic Search cluster. I want to enable fine-grained access control, however I can't rely on AWS IAM as we have an in-house service to…
AR1
  • 4,507
  • 4
  • 26
  • 42
2
votes
0 answers

AWS Elasticsearch restore index from backup stuck with "primary shard for this replica is not yet active"

When performing a restore of a specific index (using POST /_snapshot/s3-bucket/snapshot-name/_restore) on a new AWS Managed ElasticSearch cluster (version 7.1) it is getting stuck in Red state due to primary shard for this replica is not yet…
Jethro
  • 3,029
  • 3
  • 27
  • 56
2
votes
0 answers

AWS Elasticsearch Service - How to authenticate ES endpoint with AWS Cognito?

I'm creating a search service on AWS Elasticsearch and it's only for internal users, so I have to authenticate the users through a Cognito User Pool. I found the an article on AWS to Configuring Amazon Cognito authentication for Kibana in here:…
ThaiSon Nguyen
  • 21
  • 1
  • 3
2
votes
2 answers

Can't disable field indexing on ElasticSearch AWS

I'm using AWS ElasticSearch 7.9. I'm pushing logs to it with Filebeat 7.12 installed on an Elastic Beanstalk AMI2. My log structure is as follow: { "timestamp": "2021-04-07T22:58:08.012Z", "label": "My API", "level": "info", "module":…
Tnargib
  • 73
  • 12
2
votes
0 answers

Cross Region Replication AWS Elasticsearch

After doing some research, elastic has built in remote replication. Below is an example of the command for setting up replication to another elastic instance: PUT /_cluster/settings { "persistent": { "cluster.remote.leader.seeds":…
ajohnson10209
  • 644
  • 1
  • 6
  • 14
2
votes
1 answer

AWS ELK - SAML SSO works in browser but not in iFrame

I'm implementing SSO in my application where I have: A react app which is registered as Open Id Client in Keycloak. AWS ELK registered as SAML client in Keycloak. Scenario: 1 Use Kibana directly in browser When I visit, Kibana URL such as this-…
Hiren Desai
  • 941
  • 1
  • 9
  • 33
2
votes
1 answer

Publicly accessible Elasticsearch instance using CloudFormation template

I can create an elastic instance using console using the options mentioned below: Network configuration: Public access Fine Grained access control - enabled Create Master user: selected Master Username: root Master Password: PassWord152) Domain…
shantanuo
  • 31,689
  • 78
  • 245
  • 403
2
votes
1 answer

AWS Kinesis Firehose unable to index data into AWS Elasticsearch

I am trying to send data from Amazon Kinesis Data Firehose to Amazon Elasticsearch Service, but it's logging an error saying 503 Service Unavailable. However, I can reach the Elasticsearch endpoint (https://vpc-XXX..es.amazonaws.com) and…
dayuloli
  • 16,205
  • 16
  • 71
  • 126
2
votes
1 answer

Migrate to istio/envoy from nginx with sub_filter

Wondering if I can migrate a nginx configuration like this to istio. The undelying problem statement how to expose aws's vpc elasticsearch over a public loadbalancer. The aws-es instance is protected using a cognito endpoint. While I can get cognito…
rohit
  • 862
  • 12
  • 26
2
votes
3 answers

Number of nodes AWS Elasticsearch

I read documentation, but unfortunately I still don't understand one thing. While creating AWS Elasticsearch domain, I need to choose "Number of nodes" in "Data nodes" section. If i specify 3 data nodes and 3-AZ, what it actually means? I have…
Iaroslav Davydiak
  • 41
  • 1
  • 7
2
votes
3 answers

AWS kibana after login throws Missing Role error

I've started learning elasticsearch using AWS I followed this article to create elasticsearch and Kibana setup After completing the setup, tried to log in using my user from user pool, after login I'm getting error "Missing Role" url…
Elankeeran
  • 6,134
  • 9
  • 40
  • 57
1 2 3
…
16 17