Questions tagged [elasticsearch]

Elasticsearch is a flexible and powerful open source, distributed, real-time search and analytics engine.

Elasticsearch is a flexible and powerful open source, distributed, real-time search and analytics engine. Architected from the ground up for use in distributed environments where reliability and scalability are must haves, Elasticsearch gives you the ability to move easily beyond simple full-text search. Through its robust set of APIs and query DSLs, plus clients for the most popular programming languages, Elasticsearch delivers on the near limitless promises of search technology.

http://www.elasticsearch.org

378 questions
0
votes
1 answer

Could not communicate to Elasticsearch, resetting connection and trying again. EOFError (EOFError)[Fluentd using helm on kubernetes]

I'm installing elasticsearch, kibana and fluentd in kubernetes with helm chart Elasticsearch and kibana pods stand up smoothly, but fluentd pods don't stand up I get the following errors: 2023-06-13 13:29:39 +0000 [warn]: #0 [filter_kube_metadata]…
zoroglur
  • 101
  • 1
0
votes
0 answers

How to have multiple instances of filebeat load balance Netflow input?

I have a very high volume Netflow input stream, and I was hoping that I could run multiple instances of Filebeat and load-balance the Netflow traffic over the Filebeat instances, and then write to a single remote Elasticsearch. I've read about…
Rayne
  • 211
  • 2
  • 14
0
votes
0 answers

Filebeat docker multiline

I'm using filebeat to retrieve log files to Elastic cloud. I'd like to put errors and java exception in one document instead of multiple for each line. I managed to make it work on text log files but it does not seem to work on containers…
Ror
  • 321
  • 3
  • 16
0
votes
0 answers

Logstash cloudwatch plugin behavior

We have an ELK stack set up on an ec2 instance that stopped working a month ago and I just got it working again (the problem was credentials with the cloudwatch logstash plugin). What is strange is that it seems to be ingesting logs from over two…
0
votes
0 answers

AWS centralized logging with single index for all log groups

I am setting up logging on AWS, based on official AWS Centralized logging (source). Cloudwatch log groups are added with command like: aws logs put-subscription-filter --destination-arn DEST --log-group-name NAME --filter-name FILTER…
0
votes
1 answer

Can I use keycloak as an Idp for kibana installed using the ElasticSearch Operator in kubernetes?

I have setup a kubernetes cluster in a private network and I'm using a gateway machine for accessing the cluster. In the kubernetes cluster I have installed the elasticsearch operator and through that I have created an elastic cluster and a kibana…
0
votes
0 answers

Elastisearch on kubernetes - memory_lock not working

I'm trying to deploy elasticsearch on kubernetes, with memory_lock enabled, but nothing works all the time. First, I'll paste my kubernetes config apiVersion: apps/v1 kind: Deployment metadata: name: elasticsearch labels: app:…
PawelC
  • 149
  • 1
  • 11
0
votes
1 answer

Elasticsearch: java.security.cert.CertPathValidatorException: Path does not chain with any of the trust anchors (ca.crt matches on all nodes)

Note that this entire cluster was working fine up 'til I updated certificates. I'm on Elasticsearch 7.5. I updated my certificates using the certificate-util - created a server.yml with all my servers and the Kibana node in it, ran the utility with…
Epsilon
  • 11
  • 1
  • 5
0
votes
0 answers

The java program reports an error to elasticsearch?

Just started es report: [2022-12-21T02:15:32,549][WARN ][o.e.c.r.a.DiskThresholdMonitor] [es-node0] flood stage disk watermark [10gb] exceeded on [NV7q65SBQBWdsgLjTxbQOw][es-node0][/usr /share/elasticsearch/data/nodes/0] free: 3.2gb[3.3%], all…
0
votes
1 answer

SonarQube is not starting on SynologyNAS due to CONFIG_SECCOMP

SonarQube is unable to start on Synology NAS Docker due to the CONFIG_SECCOMP not being present on Synology NAS. Is there an option to ignore SECCOMP for SonarQube while it's starting ElasticSearch? 2022-11-26T11:00:50.430590094Z stdout …
VeeeneX
  • 103
  • 2
0
votes
0 answers

Application and Server Communcation Between Two Firewalls

I have a test scenario where I have an application elastic-agent (behind Pfsense Firewall A) that needs to send communication over 8220 and 9200 to my server elasticsearch (behind Pfsense Firewall B). So the communication between A and B needs to…
Lastday
  • 1
  • 1
0
votes
1 answer

Restricting Kibana to TLSv1.2

What is the setting that needs to be set in the kibana.yml file (or other file) to restrict Kibana to TLSv1.2 over HTTP? I believe that it uses TLSv1.0, TLSv1.1, and TLSv1.2 by default. I need to restrict it to only TLSv1.2.
Jay
  • 1
0
votes
1 answer

Handle 150 req/s and 2TB of logs for 7 days of retention available by API

I would like to get advise from experienced people to build a HA infrastructure to log 2To of data in JSON format every week. I need to have a retention time of 7 days and need to be able to requests these data by API. The global requirements are…
0
votes
1 answer

curl -X GET http://localhost:9200 return Access Denied

I am trying to install and setup Elasticsearch 8 on Centos 7 server, the service started but when I do curl -x GET HTTP://localhost:9200, or curl -x GET HTTP://127.0.0.1:9200 or curl -x GET HTTP://(local IP of the host):9200, the return is like…
Mai
  • 1
  • 1
0
votes
0 answers

Free storage space in amazon open search data node is low and others nodes has more than enough free space

In my AWS open search i am using 8 data nodes (r5.2xlarge.search) and 3 master nodes (r5.large.search) and each data nodes has allocated to a space of 200gb each. And also added my shard value as 4.When i checked the open search dash board i could…
aks
  • 57
  • 2
  • 7