Questions tagged [aws-elasticsearch]

Use this tag for questions related to AWS OpenSearch, which is an open-source, RESTful, distributed search and analytics engine built on Apache Lucene.

Useful Links:

  1. OpenSearch
  2. OpenSearch Service
448 questions
5
votes
1 answer

How to recover aws ElasticSearch Cluster status is Red and cannot access it

My AWS ElasticSearch cluster health goes to Red and I cannot access it, and it always show 502 Bad Gateway

502 Bad Gateway

Please let me know how to…
PPShein
  • 13,309
  • 42
  • 142
  • 227
5
votes
2 answers

Filebeat and AWS Elasticsearch - Not Working

I have good experience in working with Elasticsearch, I have worked with version 2.4 and now trying to learn new Elasticsearch. I am trying to implement Filebeat to send my apache and system logs to my Elasticsearch endpoint. To save my time I…
5
votes
2 answers

Amazon Elasticsearch - Not able to access Kibana

I have launched Elasticsearch in a Public Subnet, still, I am not able to access the Kibana console from my browser. I am not able to understand the issue, I have configured the Security Group correctly. Please refer the image below for my setup…
Shivkumar Mallesappa
  • 2,875
  • 7
  • 41
  • 68
5
votes
2 answers

Cloudformation template to push cloudwatch logs to elasticsearch

I am looking for a Cloudformation template to push cloudwatch logs to elasticsearch in another account. Even to the same account would be ok and I can update that. Seems like a standard problem but haven't seen any template which automates the steps…
5
votes
2 answers

Connecting to VPC-based Kibana using AWS Cognito

I'm a beginner to AWS and a bit confused regarding the AWS Cognito system. I have an AWS Elasticsearch service behind a VPC. I'm trying to access the Kibana endpoint using AWS Cognito, but when I navigate to the log in screen I see a blank page. Is…
4
votes
1 answer

Why is Elasticsearch/Opensearch query returning everything?

I'm using AWS's OpenSearch, and I'm having trouble getting any queries or filters to only return matching results. To test, I'm using sample ecommerce data that includes the field "customer_gender" that's one of "MALE" or FEMALE." I'm trying to use…
4
votes
1 answer

What is the Amazon OpenSearch equivalent for http.max_content_length and can I increase it?

In non-AWS-managed ElasticSearch, you can increase the value for http.max_content_length configuration when you send data to the nodes to be indexed in batches to a value larger than the default 100MB. This would be done in the elasticsearch.yml…
yobo
  • 49
  • 1
  • 6
4
votes
1 answer

Why is the AWS Elasticsearch Minimum free storage space metric different to cat allocation api

I have an Elasticsearch cluster in AWS and was alerted that the clusters minimum storage space was around 2gb. Before just upgrading the storage on each node I decided to dig a little deeper. For reference the cluster has 8 nodes with 35gb storage…
4
votes
0 answers

aws kinesis firehose to aws elasticsearch via lambda, how to modify or delete?

i'm trying incremental indexing kinesis firehose => lambda transform => amazon es. The insert example is like that const output = event.records.map((record) => { return { recordId: record.recordId, result: 'Ok', data:…
4
votes
2 answers

Terraform, ElasticSearch: Error: InvalidTypeException: Error setting policy

I would like to attach the access policy below to the ElasticSearch: { "Version": "2012-10-17", "Statement": [ { "Effect": "Allow", "Principal": { "AWS": "*" }, "Action": "es:*", "Resource":…
4
votes
2 answers

AWS ElasticSearch: How to apply a policy to an index

We have an AWS ElasticSearch domain and are writing records/documents to it. I've now created an Index State/Lifecycle Management (ISM/ILM) policy in Kibana and I can apply the policy to an Index from within Kibana. I now want to apply that policy…
Hephaestus
  • 4,337
  • 5
  • 35
  • 48
4
votes
0 answers

Log Api Gateway request/response body/headers to ElasticSearch

It's easy to setup it by default, but i cannot change the format of messages. It sends to CloudWatch Api Gateway works as proxy 2019-03-15 13:31:22.248 (REQ_ID) Method completed with status: 200 2019-03-15 13:31:22.248 (REQ_ID) Successfully…
NeverBe
  • 5,213
  • 2
  • 25
  • 39
4
votes
1 answer

How to connect to AWS ElasticSearch using npm elasticsearch and http-aws-es?

I am using the npm elasticsearch package to search my AWS ES domain. Everything seems to work fine when I use Postman to make POST requests with my AWS IAM credentials. I wanted to do the same in my code (node.js). I referred to this answer here:…
4
votes
1 answer

Amazon AWS elasticsearch Kibana access from browser

I know this issue has been already discussed before , Yet I feel my question is a bit different. I'm trying to figure out how am I to enable access to the Kibana over the self manged AWS elastic search which I have in my AWS account . Could be that…
4
votes
0 answers

ElasticSearch - Error while querying AWS ElasticSearch Service - Unsupported Content-Type: text/html

Using ElasticSearch HighLevel Rest Client, I am trying to search the AWS ElasticSearch service which has data I reindexed before. The search code is SearchRequest searchRequest = new SearchRequest(quickSearchDTO.getIndexName()); …
KarthiK
  • 841
  • 1
  • 6
  • 11
1 2
3
29 30