Questions tagged [aws-elasticsearch]

Use this tag for questions related to AWS OpenSearch, which is an open-source, RESTful, distributed search and analytics engine built on Apache Lucene.

Useful Links:

  1. OpenSearch
  2. OpenSearch Service
448 questions
8
votes
0 answers

"No server available to handle the request" thrown by AWS Elasticsearch Service

It doesn't happen regularly, but I was able to catch it in my debugger: And then, because of that trailing comma, things further complicate. That error is not even well formatted JSON, which makes it throw DeserializationError, which is how it…
7
votes
3 answers

AsyncElasticsearch client not accepting connection with AWS Elasticsearch - AttributeError: 'AWS4Auth' object has no attribute 'encode'

I'm using AWS Elasticsearch and async elasticsearch-py package in my project to connect with the cluster. AWS Elasticsearch Version 7.9 Python package: elasticsearch[async]==7.12.0 I'm not able to initialize the Async Elasticsearch client using the…
7
votes
1 answer

elastic search update Service software release in AWS console

after pressing update service software release in AWS console the following message appeared An update to release *******has been requested and is pending. Before the update starts, you can cancel it any time." Right now I waited for 1 day - still…
7
votes
4 answers

streaming data from DynamoDB to elasticsearch is failing with "no permissions for [indices:data/write/bulk]"

I'm trying to stream data from DynamoDB to ElasticSearch. I've checked the documentation by AWS + some other sources online but I'm stuck on a security issue. So I'm using a lambda function, the process of retrieving data from DynamoDB is fine, but…
legacycode
  • 147
  • 2
  • 7
7
votes
1 answer

Search for a parent and all it's children in one query in elastic search

Referring to the examples mentioned in the official documentation of building a parent-child relationship - https://www.elastic.co/guide/en/elasticsearch/reference/current/parent-join.html The link has provided question-answer join relationship…
Righto
  • 855
  • 3
  • 11
  • 32
7
votes
4 answers

Stream AWS CloudWatch Log Group to Multiple AWS Elasticsearch Services

Is there a way to stream an AWS Log Group to multiple Elasticsearch Services or Lambda functions? AWS only seems to allow one ES or Lambda, and I've tried everything at this point. I've even removed the ES subscription service for the Log Group,…
6
votes
2 answers

Logstash throwing 401 while connecting with AWS Elasticservice

I have AWS Elastic service domain setup, I'm trying to push some data from an ec2 instance to the AWS elasticservice via Logstash. I have setup the AWS ES domain with Open access policy - Allow all traffic. I have also enabled Fine Grained Control…
6
votes
2 answers

Using AWS4 Signature via Postman for CRUD Elastic operations

I'm trying to post data to Elasticsearch managed by AWS using AWS4 signing method. I would like to achieve this via postman pre-script. I tried using below script which worked perfectly for GET operation of Elastic search but its not working for…
6
votes
1 answer

AWS Elasticsearch service get NodeId (Instance ID)

I provision AWS Elasticsearch service with Terraform and want to setup CloudWatch alarms for some metrics like CPU Usage etc. also by using Terraform. In order to do it I have to put NodeId to aws_cloudwatch_metric_alarm resource: The problem is…
kagarlickij
  • 7,327
  • 10
  • 36
  • 71
6
votes
2 answers

Connect to elasticsearch in AWS using key credentials

I'm trying to post a request using curl to my es cluster in AWS using my accessKey and secretKey. I have successfully done this through postman (details here) where you can specify AWS credentials but I would like to make this work with curl.…
Damo
  • 5,698
  • 3
  • 37
  • 55
6
votes
1 answer

How to move AWS Elasticsearch into another account

I'm moving all the instances under each service from old AWS account into new AWS account. I've found ways to move EC2 and RDS into another account. To move EC2 instance, I have created an AMI and shared with the new AWS account. Using that image…
5
votes
0 answers

AWS OpenSearch Service connection with MongoDB

Is there any way we can connect AWS OpenSearch with MongoDB without using DocumentDb? I have an application based on Nest.js and ReactJs where I want to use OpenSearch Service
5
votes
0 answers

Is is possible to pretty print a JSON log message in ElasticSearch/Kibana

I have logs being indexed by ElasticSearch from stdout of our application server. Without having to modify the source writing the logs, is it possible to "pretty print" any JSON log message? If I try to pretty-print the JSON from my logger, each…
occasl
  • 5,303
  • 5
  • 56
  • 81
5
votes
1 answer

AWS Elasticsearch returning 403 forbidden error using ES client

I'm trying to create an index via an indexing job written in Go. I have all the access to ES cluster on AWS and using my access key and secret key. I can easily create indices using Kibana but when I try to use Go client, it does not work and…
Harshit
  • 1,510
  • 19
  • 42
5
votes
0 answers

Authentication Finally Failed on AWS ElasticSearch Service

I am trying to install the AWS ElasticSearch Service on aws console. Wherein I have been able to set up the same properly. But when running it through the end-point URL, it states that, "Authenication finally…
1
2
3
29 30