Stack Overflow
Stack Overflow

Questions tagged [efk]

121 questions
0
votes
1 answer

Data too large ElasticSearch issue along with Readiness probe failed

We have set up an EFK stack for our project and from yesterday kibana seems down. When we initially troubleshooter we have found the following errors: Readiness probe failed: Error: Got HTTP code 503 but expected a 200 & Readiness probe failed:…
Shubham Kadam
  • 1
  • 2
0
votes
1 answer

Kibana nano seconds showing zeros

Kibana not showing nano seconds, it is showing zeros Actually timestamp is available in nano seconds How to sort the data in kibana using nano seconds precision
Phani Kumar
  • 158
  • 5
0
votes
1 answer

fluentd cannot connect to elasticsearch

I run the stack EFK through docker-compose, the stack starts, kibana and elasticsearch go through the initial setup. fluentd throws the following error at startup: "The client is unable to verify that the server is Elasticsearch. Some functionality…
Rostislav Udaltsov
  • 79
  • 1
  • 6
0
votes
0 answers

fluent-bit logstash elastic configuration for parsing AKS containerd logs

After we moved to azure ( AKS ) our logstash fluent-bit EFK parsing for logs stopped working. I narrowed it down to due to our nodes using containerd which saves the log with a date in the format below: 2021-02-11T15:17:24.366452645Z stdout F…
Joelgullander
  • 1,624
  • 2
  • 20
  • 46
0
votes
1 answer

Monitor Kafka Connector Processes and the status of Connector using Elastic Fluentd Kibana

The current setup of Kafka connector runs in AWS EKS kubernetes . The connector are self managed. How can we monitor the connector status (stopped/paused) and exceptions from EFK( elastic-fluentD-Kibana)? We expect the EFK to send an mail on…
user3747198
  • 3
  • 1
  • 4
0
votes
1 answer

How to expand keys in flunetd with logs in sorted way (latest logs should be on top)

I'm using EFK stack. My flunetd configuration is: @type multi_format format json time_key time time_type string time_format "%Y-%m-%dT%H:%M:%S.%NZ" keep_time_key true …
Shrikar
  • 1
  • 1
0
votes
1 answer

Build the EFK system used for simulating logging server on Docker

I want to simulate laravel logging to EFK system server Base on this, I build up two container. One of laravel project's container. The ohter is EFK system container but EFK's fluentd does not catch any data or event my container's…
Henry Kao
  • 88
  • 1
  • 6
0
votes
1 answer

failed to write data into buffer by buffer overflow action=:block

Can someone help me about this issue https://github.com/fluent/fluentd/issues/3626
Anup
  • 81
  • 1
  • 14
0
votes
0 answers

FluentD, grep only specific logs events

I have logs, and I want to grep only the logs and send to Elasticsearch which contains 'error="400 - Rejected by Elasticsearch' and 'failed to parse field' and ignore the others. log:2022-02-04 23:56:43 +0530 [warn]: #0 dump an error event:…
Anup
  • 81
  • 1
  • 14
0
votes
1 answer

failed to flush the buffer in fluentd looging

I am getting these errors during ES logging using fluentd. I'm using fluentd logging on k8s for application logging, we are handling 100M (around 400 tps) and getting this issue. I'm using M6g.2xlarge(8 core and 32 RAM) AWS instances 3 master and 20…
Anup
  • 81
  • 1
  • 14
0
votes
0 answers

Fluentd Throwing error and not uploading data to Elastic

unexpected error error_class=Elasticsearch::UnsupportedProductError error="The client noticed that the server is not a supported distribution of Elasticsearch."
Muhammad Ansab
  • 1
0
votes
0 answers

Unable to send application logs to elasticsearch with fluent bit in docker-compose

I'm trying to run app with EFK in docker-compose. App writes logs in /var/log/containers directory. When i checked fluent bit logs it has a error [error] [input:tail:tail.0] read error, check permissions: /var/log/containers/*.log. Looks like app…
Raushan
  • 307
  • 3
  • 12
0
votes
0 answers

Kibana shows logs after 5 minutes kibana

I'm using EFK setup, have a problem with showing logs in Kibana. Kibana shows log after 5 minutes in Elasticsearch and kibana. My Fluentd config- fileConfigs: 02_apps.conf: | @type record_transformer …
Anup
  • 81
  • 1
  • 14
0
votes
4 answers

How to connect fluentd to opendistro for elasticsearch

I have created a docker file : FROM fluentd:v1.14.0-debian-1.0 USER root RUN ["gem", "install", "fluent-plugin-elasticsearch", "--no-document", "--version", "5.1.2"] USER fluent From which I create a container in my compose file: version:…
Alexander Mladzhov
  • 545
  • 8
  • 31
0
votes
0 answers

I have setup EFK stack with Xpack security enabled it worked great until one of the Elasticsearch pods restarted

When one of the elasticsearch pods restarts for any reason, in kibana logs I was getting error that the elastic user was not able to authenticate . I could not able to find any relevant documentation. Any help would be appreciated. my kibana…
balu
  • 11
  • 2
1 2 3
…
8 9