Questions tagged [amazon-elasticsearch]

Amazon Elasticsearch Service is a managed Elasticsearch offering as part of Amazon Web Services.

248 questions
1
vote
1 answer

How to create full access from all ip in kibana and create a login and password to log in to the cab using terraform

I'm creating a test elasticsearch aws using terraform, I can't give full access from all ip addresses + how do I automatically add a username and password to log in to kibana? I read the manual s on github but I didn't understand how to do ithelp me…
1
vote
1 answer

How to set the retry on conflict in Elastic search using client.bulk method

I am using client.bulk method to insert into elastic search. I need to pass the retry_on_conflict param in client.bulk as per the document. https://www.elastic.co/guide/en/elasticsearch/reference/current/docs-update.html Below code I was trying, but…
Muthukumar Marichamy
  • 1,175
  • 1
  • 17
  • 39
1
vote
1 answer

Enable SAML authentication for Dashboards of private AWS OpenSearch cluster running in VPC

I would like to configure single sign on for Kibana with Azure Active Directory as the identity provider and embedded SAML authentication method that OpenSearch provides. However, OpenSearch cluster is running in private subnets and not available…
1
vote
1 answer

ElasticSearch document refresh=true does not appear to work

In order to speed up searches on our website, I have created a small elastic search instance which keeps a copy of all of the "searchable" fields from our database. It holds only a couple million documents with an average size of about 1KB per…
mojoken
  • 1,256
  • 1
  • 15
  • 27
1
vote
0 answers

AWS Elasticsearch IAM user not allowed for es domain / dashboard

We created an admin user in our amazon account with full access to elasticsearch service. Nonetheless, when the user want to open the es dashboard, we get this error: DescribeReservedElasticsearchInstances: {"Message":"User:…
1
vote
0 answers

Elasticsearch configuration recommendation for *search-only* index with a complex fuzzy querying

We use Elasticsearch (managed by AWS) to search documents by running a complex query (fuzzy multi_match on many short text fields with a few additional matches). We don't change the data almost at all (max. once a year - reupload of whole data). The…
Beniamin H
  • 2,048
  • 1
  • 11
  • 17
1
vote
3 answers

Connect springboot java RestHighLevelClient to aws elasticsearch

Config: private static final String HOST = "search-qas-sam-zxbalglrksamjfcazl3zmkiiq7.ap-south-1.es.amazonaws.com"; private static final int PORT = 443; // tries 9200, 9300, 80 private static final String PROTOCOL = "https"; @Bean public…
1
vote
1 answer

Logstash in EC2 can't connect with ElasticSerach domain in AWS

I'm having some trouble in connecting the Logstash (In AWS - EC2) with the ElasticSearch domain in AWS. ES Configuration: In VPC Cognito enabled with fine-grained access (Using the master IAM arn) Logstash Pipeline Config: input { stdin {…
1
vote
1 answer

Can we set ignore_malformed flag true of an already existing index in elasticsearch

I'm new to elasticsearch. I'm re-indexing old index to new index. but while re-indexing millions of records sometime, I am getting mapper_parsing_exception exception. so my question is that, Is there a way to set ignore_malformed flag true of an…
1
vote
1 answer

Elasticsearch 6.3 (AWS) snapshot restore progress ERROR: "/_recovery is not allowed"

I take manual snapshots of an Elasticsearch index These are stored in a snapshot repo on S3 I have created a new ES cluster, also version 6.3 I have connected the new cluster to the S3 snapshot repo via python script method mentioned in this…
Brian Webster
  • 30,033
  • 48
  • 152
  • 225
1
vote
1 answer

Create a public endpoint to AWS ElasticSearch domain which is inside a VPC

I need to access a AWS ElasticSearch (AES) domain, which is inside a VPC, from the internet, so that I can do read/write testing from a local machine. Ultimately, the code will run on an EC2 instance inside the VPC, but for now I need direct…
Hephaestus
  • 4,337
  • 5
  • 35
  • 48
1
vote
0 answers

FAIL: Configuration for 'config' failed because of UnavailableShardsException[[.opendistro_security][0] primary shard is not active

I was trying to configure opendistro elastic search by my own certificates. when i did a curl to esip:9200 the response was Open Distro Security not initialized. Later when i tried to run security admin.sh for initializing security the error was…
1
vote
1 answer

Elasticsearch wildcard query on numeric fields without using mapping

I'm looking for a creative solution because I can't use mapping as solution is already in production. I have this query: { "size": 4, "query": { "bool": { "filter": [ …
user2199630
  • 203
  • 1
  • 2
  • 12
1
vote
2 answers

Match Substring email address at specific location in ELK

I am trying to find out data matching emails from a message field in ELK Kibana discover section, I am getting the results using: @message:"abc@email.com" However, the results produced contains some other messages where email should not be matched,…
Shubham Namdeo
  • 1,845
  • 2
  • 24
  • 40
1
vote
0 answers

How to integrate Kibana with nagios?

We use ELK for log management and nagios for centralized monitoring. I want to setup pattern match alerts in kibana and notify via nagios. Can you please let me know if this is feasible.