Questions tagged [amazon-elasticsearch]

Amazon Elasticsearch Service is a managed Elasticsearch offering as part of Amazon Web Services.

248 questions
2
votes
1 answer

Limit results per document type in Elasticsearch

I'm using Elasticsearch (version 2.3) to search in an index with several document types. I want to limit the number of results to the top X search hits for each document type. How can that be achieved? The query is very plain and simple: { …
Roy Solberg
  • 18,133
  • 12
  • 49
  • 76
2
votes
1 answer

error using Python Elasticserarch-py package

So I am trying to create a connection to AWS ES. I have successfully connected to my S3 bucket in the same zone. However, when I try to connect to ES, I get this message every time. Please install requests to use RequestsHttpConnection. I have…
2
votes
0 answers

aspnet-redis-providers not working for multi server setup in AWS behind Load balancer

I'm facing problem when I tried to use redis as session server for the below configuration: more than one windows servers hosting same application with https://github.com/Azure/aspnet-redis-providers Elastic load balancer with weighted routing…
2
votes
1 answer

Logstash in EC2 can't send log data to AWS Elasticsearch service

In EC2 I have configured logstash as belows input { # beats{ # port => 5044 # } file { type => "adjustlog" path => "/etc/logstash/conf.d/sample.log" start_position => "beginning" sincedb_path =>…
Tw K
  • 70
  • 2
  • 8
2
votes
1 answer

Change Elasticsearch mapping for aws kibana

I have setup integration with CloudWatch logs using a subscription. However, I noticed some aspects of the mapping need to be adjusted (for example the 'url' coming through in my web server logs gets parsed as an analyzed field which it makes it…
2
votes
0 answers

Longest Prefix query in elastic search

I am trying to do a longest prefix query in Elasticsearch. My requirement is that suppose I have the numbers 12356 12345 33332 in elastic search and I query 1234567 It should return the number with the longest sequence of common characters. In…
sidd607
  • 1,339
  • 2
  • 18
  • 29
2
votes
1 answer

Connecting to Elasticsearch - Amazon Elasticsearch service - IAM user

I have selected "Allow access to one or more AWS accounts or IAM users" My access policy { "Version": "2012-10-17", "Statement": [ { "Effect": "Allow", "Principal": { "AWS": "arn:aws:iam::12345678910:user/elastic" …
2
votes
1 answer

Configure output as elasticsearch in logstash

I'm working on an elasticsearch project where I want to get data from Amazon s3.for this,I'm using logstash.To configure, output{ elasticsearch{ host => 'host_' cluster => 'cluster_name' } } is the usual approach. But,I'm using…
AV94
  • 1,824
  • 3
  • 23
  • 36
2
votes
1 answer

Elasticsearch Single Node Reliability

I'm thinking to use AWS' canned Elasticsearch service as a single node cluster to allow searching across a record set of 100MM small records (people's names and their company etc, as well as other attributes). Very read heavy, updates once every…
Kong
  • 8,792
  • 15
  • 68
  • 98
2
votes
1 answer

Kibana won't connect to Elasticsearch on Amazon's Elasticsearch Service

After switching from hosting my own Elastiscsearch cluster to Amazon's Elasticsearch Service, my Kibana dashboards (versions 4.0.2 and 4.1.2) won't load and I'm receiving the following error in kibana.log: { "name": "Kibana", "hostname":…
user559633
1
vote
0 answers

AWS Elasticsearch / Opensearch - Get Metrics On What's Being Searched

I have an instance of Elasticsearch running in AWS OpenSearch. From the documentation I've found online, AWS has something called OpenSearch Dashboards that is essentially their own forked version of Kibana. This can be connected to my…
1
vote
1 answer

Evaluating access policies can impact resource usage in case of multiple requests? (AWS Opensearch)

I couldn't find any confirmation or explanation of where AWS (specifically in the OpenSearch/Elasticsearch service) evaluates IAM access policies. Is policy evaluation, in the case of non-serverless services, done with the allocated system…
1
vote
1 answer

AWS Opensearch (Elasticsearch 7.10) - Refuses to assume Cognito group role

So, I have two Elasticsearch 7.10 clusters. I have a Cognito user pool, with an admin group. This admin group a role attached to it from IAM, call it the AdminRole. It's precedence is 1. Now, I have configured both of the aforementioned…
1
vote
1 answer

AWS opensearch: Cannot update advanced option `override_main_response_version`

I have an AWS opensearch with vanilla settings. I needed to change the advanced options to enable override_main_response_version=true so that filebeat could work. But whichever way I try, it just does not work. Any workarounds? Method 1:…
ixaxaar
  • 6,411
  • 3
  • 24
  • 33
1
vote
1 answer

How is a Kinesis DeliveryStream writing to OpenSearch configured to save data to S3?

I have inherited an application running on AWS after the original developer left. I don't understand how part of it is set up. The application is a Lambda (written in Python but I don't think that's significant here) that accepts events from a SQS…