Questions tagged [amazon-elasticsearch]

Amazon Elasticsearch Service is a managed Elasticsearch offering as part of Amazon Web Services.

248 questions
0
votes
1 answer

Enable Field Level Security in AWS Elasticsearch Service with AWS Cognito

I am working on setting up an Elasticsearch index, where the Kibana access would be controlled by AWS Cognito. I would like to set up 2 types of users in Cognito; Type 1 would have access to all data fields in the index, while Type 2 would only have…
0
votes
0 answers

Is there a Scala ES SDK that will let me run the ES Client on my own maintained instances and connect to AWS ES as well?

I'm trying to use a Scala Client/SDK that will help me access ES endpoints/libraries both when maintaining my own instances and when maintained by AWS. I found a bunch of them online but they all conflict with the current sbt versions that I use for…
0
votes
1 answer

Proxy_url for kibana in metricbeat.yml

My server requires proxy to connect to kibana. How can I specify that in metricbeat.yml file. For output.elasticsearch there is attribute called proxy_url but I cant see for kibana
0
votes
0 answers

AWS elasticsearch service returning 403 response with .NET HttpClient - wrong casing in http request headers

Anyone ever had issues with casing in headers and AWS elasticsearch service? Trying to call _cat/health, but the service returns 403. Connection: Close doesn't work, Connection: close works. This is annoying in .NET Framework where the casing is…
0
votes
0 answers

How to set metricbeat on amazon elasticsearch

I have two servers one for production and one for test, I've been trying to install metricbeat on both servers. I did on my test server and set it to send logs to my amazon elasticsearch service and now I can see on kibana all data from that server…
Diogo Silva
  • 195
  • 3
  • 17
0
votes
1 answer

Amazon Elasticsearch access policy from EC2 auto-scaling

We are using Amazon Elasticsearch and the client which are accessing this service is running in EC2 machine. For the security purpose, we are using IP based security so we have given the ec2 machine's IP in the ES security policy. Now the ec2…
0
votes
1 answer

Kibana including versioned documents in visualizations

I have a document with _id "123456", and when I do a GET in Elasticsearch for that ID in my index I can see that it is _version: 2 which makes sense because I updated it. However in my Kibana visualizations it seems like it is picking up both…
Omar Himada
  • 2,540
  • 1
  • 14
  • 31
0
votes
1 answer

Heap allocated to elasticsearch node in an m4.large.elasticsearch instance?

The jvm node stats /_nodes/stats/jvm in elasticsearch suggests that, in the case of an m4.large.elasticsearch instance type, the allocated heap size in 4Gb whereas the capacity of the instance type in 8Gb. Is it possible to increase this…
0
votes
1 answer

Using ElasticSearch Transport Client with Amazon ElasticSearch Service ( AES )

We are planning to move our Elasticsearch cluster to Amazon ElasticSearch Service ( AES ). Our current code base use native Java transport client to interact with ElasticSearch cluster but as per the AES documentation, it does not support the TCP…
krajwade
  • 133
  • 1
  • 12
0
votes
0 answers

how to avoid time out exception while indexing data in elasticsearch with concurrent requests?

we are indexing data in elasticsearch using java api and architecture is like there are multiple applications can be running at the same time so many concurrent requests may be made to ES due to which time out exception occures on elasticsearch.how…
Atul Ghodke
  • 64
  • 1
  • 5
0
votes
1 answer

Is it possible to upload a local snapshot to Amazon Elasticsearch?

First time working with Elasticsearch. I was wondering how to migrate my local data (a local instalation in my computer of ES) into Amazon ES, be it with a snapshot, which I found was one way to do it or by other means. I made a snapshot, which is…
0
votes
1 answer

How to configure the elastic search endpoint so that graylog-ctl reconfigure does not overwrite it

I am running graylog in AWS sourced from https://github.com/Graylog2/graylog2-images/tree/2.3/aws I am using an external elastic search server (actually a hosted AWS Elastic search) I have configured my graylog to run without elastic search but I…
Michael Wiles
  • 20,902
  • 18
  • 71
  • 101
0
votes
2 answers

Python Elasticseach indexing error

Elasticsearch was working well and fine before today. Issue: Some documents which are failing to index with error: u'Limit of total fields [1000] in index [mintegral_incent] has been exceeded' Error: "BulkIndexError: (u'14 document(s) failed to…
Kishan Mehta
  • 2,598
  • 5
  • 39
  • 61
0
votes
1 answer

Is it a good idea to have synchronous updates to elastic search index

I have a use-case where the backend store is S3 and we want to power the search through elastic search. One option is to update S3 and index simultaneously. Most of the use-cases I have seen are updating the index asynchronously. One obvious…
Abhay Dubey
  • 549
  • 2
  • 7
  • 18
0
votes
1 answer

Configure cloudwatch -> elastic search through java code

If you look at the following link: http://docs.aws.amazon.com/AmazonCloudWatch/latest/logs/CWL_ES_Stream.html, there is a mechanism to associate a log group with an elastic search domain. Do you know this can be done via the java aws sdk so that it…