Stack Overflow
Stack Overflow

Questions tagged [amazon-elasticsearch]

Amazon Elasticsearch Service is a managed Elasticsearch offering as part of Amazon Web Services.

248 questions
3
votes
1 answer

Constant 503 errors from Elasticsearch inside a VPC when using Kinesis Firehose

I am using the Amazon Kinesis Data Generator to send data to a test Kinesis Firehose Stream for indexing in an Elasticsearch Service cluster. The data generator sends a fairly basic json doc for processing, the stream element works fine, as does the…
Jamie Buchanan
  • 3,868
  • 4
  • 22
  • 24
3
votes
1 answer

AWS permissions error ... Kinesis Firehose is not sending data to Elasticsearch…

I get this error in CloudWatch logs of kinesis firehose { "deliveryStreamARN": "arn:aws:firehose:us-west-2:917877325894:deliverystream/test_dynamodb", "destination": "arn:aws:es:us-west-2:917877325894:domain/test-dynamodb2", …
Data_sniffer
  • 588
  • 1
  • 8
  • 19
3
votes
2 answers

AWS Kinesis Firehose is not sending data to Elasticsearch....IAM permissions?

So I have everything ready and working good except for the last step which sending data from Firehose to Elasticsearch. This is the error I get in Kinesis Firehose Elasticsearch service logs: Error received from Elasticsearch cluster.…
Data_sniffer
  • 588
  • 1
  • 8
  • 19
3
votes
1 answer

AWS Elasticsearch cluster disk space not balanced across data instances

Background I have an AWS managed Elascsearch v6.0 cluster that has 14 data instances. It has time based indices like data-2010-01, ..., data-2020-01. Problem Free storage space is very unbalanced across instances, which I can see in the AWS…
gondalez
  • 1,225
  • 10
  • 13
3
votes
1 answer

restore elasticsearch snapshot from a different s3 region

I have an AWS ElasticSearch domain in eu-west-1 region and have taken a snapshot to an S3 bucket sub folder also in the same region. I have also deployed a second AWS ElasticSearch domain in another aws region - eu-west-2. Added an S3 bucket…
khinester
  • 3,398
  • 9
  • 45
  • 88
3
votes
0 answers

Elastic search single huge document vs multiple small documents

Following is the behaviour: 1. each record is generated for an order. 2. each record has some common data that will be same across all the records for an order. 3. The records for an order may range from 1k to 500k There are two ways: Either merge…
Xephonia
  • 153
  • 12
3
votes
0 answers

Forward logs with logstash running in ec2 instance to Amazon Elasticsearch service

I'm currently running logstash in an ec2 instance with the default linux AMI, and attempting to send logs to an AWS ES instance. If I used the standard 'elasticsearch' output, I can send unsigned data to the AWS ES instance, but I'm trying to set up…
pmurphy86
  • 31
  • 2
3
votes
2 answers

Global Search in Elastic Search

Working on Elasticsearch, my use case is very straight forward. When a user types in a search box I want to search all of my data set irrespective of field or column or any condition (search all data and provide all occurrences of searched word in…
Kiran
  • 868
  • 1
  • 13
  • 23
3
votes
0 answers

Jest client shutdown after the first execute operation

I created an AWS Lambda package (Java) with a function that reads some files from Amazon S3 and pushes the data to AWS ElasticSearch Service. Since I'm using AWS Elastic Search, I can't use the Transport client, in which case I'm working with the…
choka
  • 33
  • 5
3
votes
1 answer

Set up Elasticsearch suggesters that can return suggestions from different data types

We're in the process of setting up Amazon Elasticsearch Service (running Elasticsearch version 2.3). We have different types of data (that I'm currently thinking of as different document types within the same index). We have a generic search in an…
Roy Solberg
  • 18,133
  • 12
  • 49
  • 76
3
votes
2 answers

Amazon AWS - S3 to ElasticSearch (Python Lambda)

I'd like to copy data from an S3 directory to the Amazon ElasticSearch service. I've tried following the guide, but unfortunately the part I'm looking for is missing. I don't know how the lambda function itself should look like (and all the info…
lte__
  • 7,175
  • 25
  • 74
  • 131
3
votes
2 answers

How to store date range data in elastic search (aws) and search for a range?

I am trying to store hotel room availability in elasticsearch. And then I need to search rooms those are available from a date till another date. I have come up with two ways to store data for availability, and they are as follows: Here…
JVK
  • 3,782
  • 8
  • 43
  • 67
3
votes
3 answers

Stream data to amazon elasticsearch using logstash?

So I spinned up a 2 instance Amazon Elasticsearch cluster. I have installed the logstash-output-amazon_es plugin. This is my logstash configuration file : input { file { path => "/Users/user/Desktop/user/logs/*" } } filter { grok…
Karup
  • 2,024
  • 3
  • 22
  • 48
3
votes
1 answer

Scripting in AWS elasticsearch

I read online about scripting in aws elacticsearch service. It said that AWS ES doesn't support dynamic scripting so I am writing aggregations using scripts stored in my disk. I wrote the following query { "query":{ "match_all":{} …
sidd607
  • 1,339
  • 2
  • 18
  • 29
3
votes
1 answer

Filter on boolean field increases latency and CPU

I'm using the AWS ElasticSearch service (1.5.2) and is receiving more than 100 requests/sec without problems. Almost every query have geo filters, full text filters, integer filters... But I have a problem, adding one simple filter more; a boolean…
Odín del Río Piñeiro
  • 131
  • 6
1 2 3
…
16 17