Stack Overflow
Stack Overflow

Questions tagged [elk]

Questions about the ELK stack, which gives you the ability to aggregate logs from all your systems and applications, analyze these logs and create visualization.

ELK is a stack of the three open source projects - , and

The ELK stack gives you the ability to aggregate logs from all your systems and applications, analyze these logs and create visualization.

Useful links:

1095 questions
2
votes
1 answer

Docker-compose filebeat container is not able to push docker container logs to logstash

I am running ELK and filebeat inside two different host separate docker-compose.yml. But filebeat cannot connect to logstash. I can properly telnet into logstash telnet a.b.c.d 5044 after I wait for the logstash pipelines to start. Server Side…
Aakarshit Agarwal
  • 31
  • 3
2
votes
1 answer

Is it possible to redirect NATs Jetstream message to Elastic search

We use Nats jetstream for message distribution. I want to display messages delivered to Nats in UI. All message have pre defined common structure. Do we have file beat or logstash plugin to read the content (message) of NATS and redirect to ES. Or…
defender
  • 353
  • 2
  • 11
2
votes
1 answer

I got a 404 when running kibana on docker behind traefik, but elastic can be reached

I am having issues while running ELK on docker, behind Traefik. Every other services are running, but when i try to access to kibana on a browser via its url, I got a 404. This is my docker-compose.yml : version: '3.4' networks: app-network: …
Loot
  • 71
  • 8
2
votes
1 answer

Log aggregation tools vs Logging service

Log aggregation tools like ELK stack seems to be de facto solution in microservices monitoring space. Microservices writes their logs to files, which are collected and forwarded by the host machine collector agents. To be honest, I don't see many…
Tuomas Toivonen
  • 21,690
  • 47
  • 129
  • 225
2
votes
0 answers

Elastic Search authentication rest call

Hi I have a problem with elk reported below, I have to call an api in elk search, I generated the key for elk from the web but when I insert it in the rest call I have the error reported below, how do I fix it? http://localhost:9200/_search Api…
riki
  • 1,502
  • 5
  • 17
  • 45
2
votes
2 answers

Error while starting Log Stash Expected one of [ \\t\\r\\n]

Connecting LogStash to SQL Server. Could help me with following error while starting logstash? I executed this command: logstash.bat -f c:\DevSoft\logstash-8.3.3\bin\logstash-sample.conf I get following error: I tried removing all whitespaces from…
Abhijeet
  • 13,562
  • 26
  • 94
  • 175
2
votes
0 answers

Logstash cant connect to Elasticsearch inside Docker -> Response code 401

i am trying to connect my Logstash Docker container to my Elasticsearch Docker container. First of all i will present to Elasticsearch configuration i am using: I am running both services out of separate docker-compose files to manually be able to…
MajesticOl
  • 311
  • 1
  • 20
2
votes
0 answers

How to avoid APM field explosion exceeding 1024 fields?

We are using ELK APM from NodeJS running in Azure App Service. We currently have APM version 1.7.16. The APM index patterns has 1467 fields, which makes search across all fields fail with this error: "type" : "query_shard_exception", "reason" :…
Nikola Schou
  • 2,386
  • 3
  • 23
  • 47
2
votes
0 answers

when i am creating multiple dashboard, it is streaming same logs table for all dashboard

I am using filebeat to ship my logs and using elasticsearch, logstash and kibana for visualization. On kibana dashboard, I have setup Observability-> logs-> streams-> settings-> log index pattern from kibana (Here I am able to give only one index…
Yash garg
  • 31
  • 2
2
votes
2 answers

FileBeat not sending data to ElasticSearch Kibana

I'm unable to receive data in the Kibana dashboard from the Filebeat agent. I'm using self-managed ELK with AWS EC2 server. Below is my filebeat.yml filebeat.inputs: - type: log enabled: true paths: -…
Naveen
  • 103
  • 1
  • 12
2
votes
1 answer

What is the maximum number of indices allowed in elasticsearch?

I am using MySQL for storing data in my software. We have to generate hundreds of reports using the data and it is taking more time when the size of data in increasing. For some reports it is taking 1 or 2 minutes. So we have decided to use NoSQL…
rqb
  • 68
  • 7
2
votes
1 answer

Create kibana visualizations using Chart.js or elastic-charts

I want to create the charts/bar graphs/ pie plots similar to one which is created by kibana (in dashboard). By using chart.js / elastic-charts on frontend and the data present in my elastic search instance. how can I do that ?
user18362049
2
votes
1 answer

Kibana visualization for grouping and filter

I have my data in Elasticsearch like below I'm trying to create a pie chart in kibana which shows the percentage of people who visited both UK and India and % of people who visited only India and % percentage of people who visited only UK. But I'm…
Manoj kumar
  • 227
  • 6
  • 19
2
votes
2 answers

How to change “message” value in index

In logstash pipeline or indexpattern how to change the following part of CDN log in "message" field to seperate or extract some data then aggrigate them. <40> 2022-01-17T08:31:22Z logserver-5 testcdn[1]:…
MHZR
  • 43
  • 5
2
votes
0 answers

Filebeat : Split the multiline json(array of json object) from message field to separate fields

I need to use filebeat to push my json data into elastic search, but I'm having trouble decoding my json fields into separate fields extracted from the message field. Filebeat version : 7.16.2 Filebeat.yml filebeat.inputs: - type: log enabled:…
max
  • 255
  • 2
  • 7
1 2 3
…
72 73