Questions tagged [amazon-elasticsearch]

Amazon Elasticsearch Service is a managed Elasticsearch offering as part of Amazon Web Services.

248 questions
0
votes
1 answer

Specifying number of indexes in AWS Elastic Cluster

I am new to Elastic Search and when I went through the documentation for AWS Elastic Search, I noticed that there is no where, where I can mention the number of shards per index or the number of indexes I require for my cluster in the cloud…
Abhijith Rao
  • 75
  • 1
  • 1
  • 6
0
votes
1 answer

Use AWS authentication for Amazon Open Search Service (AOSS)

We have an AOSS cluster and I'd like to use regular AWS console authentication to authenticate users. I've reviewed (and followed much of) the following: Configuring Amazon Cognito authentication for OpenSearch Dashboards How to enable secure…
0
votes
1 answer

Elastic search count query based on field with value containing filesystem path

I asked this question earlier question here However I realized my mistake very soon as I tried the solution with more data. So I am back to square one. So I am hoping to ask this question again and get more insights. My task is still the same but…
Vikas
  • 404
  • 5
  • 18
0
votes
0 answers

ensure minimum functionality under heavy search load elk

I have a 3x node elk cluster with fillowing node characteristics: 96GB RAM 25GB heap 10x CPU 6TB total indexes size for past 30 days distributed in 1.5TB per node the filebeat index 50GB per index split across 3x shards ~ total 100GB/day ,…
R2D2
  • 9,410
  • 2
  • 12
  • 28
0
votes
1 answer

Remote reindex API AWS ElasticSearch Null Pointer Exception

I am trying to move one index from an older cluster with ES 5.3 to different cluster ES 7.10 using remote reindexing api both are in the same VPC curl -X POST \https://target.com/_reindex \ -H 'content-type: application/json' \ -d '{ "source": { …
0
votes
1 answer

The ambiguous role mapping rules for: cognito with microsoft active directory

I've encountered following error message when I'm trying to integrate AWS Cognito and AWS ElasticSearch with AD. I've setup AD and cognito integration but after login with AD-User in AD Console, I've encountered following message. But when I've…
0
votes
1 answer

advantage of closing an index and restoring from snapshot elasticsearch

One of my index in elasticsearch has a shard which is unassigned therefore that data is not available and my cluster status is red , I want to restore this index i have a snapshot of the same , so i want to restore this index from the snapshot Now i…
Srinjoy Choudhury
  • 622
  • 1
  • 4
  • 19
0
votes
1 answer

Elasticsearch: Aggregation of null fields in a facet bucket

I'm trying to implement facets with a date range aggregation in the current version of Amazon Elasticsearch Service (version 7.10). The key for what I want the article documents to group for, is publishedAt, what is a date. I want one bucket, where…
0
votes
1 answer

Amazon ElasticSearch Service Unknown aggregation type boxplot

I have created a query for boxplot in ElasticSearch 7.9.3 (via Docker image) on local with Symfony 5 and it worked just fine. But when uploading on test environment where I use Amazon ElasticSearch Service, I get error: "Unknown aggregation type…
0
votes
1 answer

Access to Amazon Elasticsearch Service via Client VPN Endpoint

I'm currently learning AWS and I'm stuck. I created Amazon Elasticsearch Service domain in my VPC, in subnet A (one of 3 default subnets). The access is available through VPC, not from the Internet. I wanted to connect to it from my computer (to…
0
votes
2 answers

POST request to Amazon Elastic Search from application impersonating user role (e.g. manager, contractor, etc...)

I am working on a search microservice in Spring boot that relies on Amazon Elastic Search. I have an angular Front end and a spring boot service in front of Amazon Elastic Search I created Application Privileges in Elastic search so that my…
AR1
  • 4,507
  • 4
  • 26
  • 42
0
votes
1 answer

filebeat version 7.13.1 not working with aws elasticserach 7.4

Can someone help me with the below error? #filebeat test output -c /etc/filebeat/filebeat.yml talk to server... ERROR Connection marked as failed because the onConnect callback failed: could not connect to a compatible version of Elasticsearch:…
Nagendren
  • 11
  • 4
0
votes
1 answer

AWS Elasticsearch IAM question to access Kibana via Browser

I've set up my elasticsearch yml file (deployed via Serverless) as follows: Resources: CRMSearch: Type: "AWS::Elasticsearch::Domain" Properties: ElasticsearchVersion: "7.10" DomainName: "crm-searchdb-${self:custom.stage}" …
0
votes
1 answer

Match missing LogStash logs to the correct date in Kibana dashboard

TL;DR; Map missing logs from LogStash in Kibana dashboard to their correct date and time I have an Amazon ElasticSearch domain(which includes both ElasticSearch service and Kibana dashboard) configured. My source of logs is a Beanstalk environment.…
Sandun
  • 395
  • 2
  • 10
  • 25
0
votes
2 answers

How to connect to AWS Elasticsearch from EC2 using IAM?

I am trying to connect my EC2 instance to my ES domain and keep getting the following error: AuthorizationException(403, 'security_exception', 'no permissions for [indices:data/read/search] and User [name=arn:aws:iam::ACCOUNT_ID:role/my-role,…
user1040535
  • 201
  • 1
  • 3
  • 14