Stack Overflow
Stack Overflow

Questions tagged [elk]

Questions about the ELK stack, which gives you the ability to aggregate logs from all your systems and applications, analyze these logs and create visualization.

ELK is a stack of the three open source projects - , and

The ELK stack gives you the ability to aggregate logs from all your systems and applications, analyze these logs and create visualization.

Useful links:

1095 questions
2
votes
0 answers

unique document id across incremental index name on elastic search and logstash

I'm using ELK for reporting purpose. Logstash JDBC plugin used to feed elastic search from Oracle query. I'm having the index name with daily date as incremental postfix. And I'm using document ID as primary key from DB. But same record in DB will…
sugunan
  • 4,408
  • 6
  • 41
  • 66
2
votes
1 answer

How to use the update API in elastic search query for updating the data in the data set

How to add a new data field to an existing dataset using Update API in elsticsearch. For example if dataset already contains fields like id but now I need to add a new field name Name and pass a value A.
Tony Stark
  • 511
  • 2
  • 15
2
votes
0 answers

How to merge two data sets using common field and using transform s with the help of elastic search query

Using transforms in elasticsearch how to merge two datasets if the have same field for example Table A id name 1 a 2 b Table B id name 1 c 3 d If both the ids are same then merge the datas in new table using transforms
Tony Stark
  • 511
  • 2
  • 15
2
votes
0 answers

Elasticsearch query data removing continuous duplicate data

i have a problem. I would like to get a list of data but has some same values that i would like to get rid of. This is a list of a alerts turned on and off, some times i get a "falseTick" and store this data, i need to make a history of this but i…
Josep Soler
  • 21
  • 2
2
votes
0 answers

How to Specify MDC Field Type with SLF4J MDC With Logback?

I'am using SLF4J MDC (using logback as logging framework) like below: MDC.put("numericField", Long.valueOf(500).toString()); log.info("Testing MDC"); MDC.clear(); But when I send these logs to elasticsearch via filebeat (without using logstash), I…
H.Ç.T
  • 3,335
  • 1
  • 18
  • 37
2
votes
1 answer

Kibana server is not ready yet even started

i have 1 master node (master), and 1 data node(node-1). Im using centos7 as os. master:9200 [root@localhost kibana]# curl localhost:9200 { "name" : "master", "cluster_name" : "elasticsearch", "cluster_uuid" : "P4QlwvuRRGSmlT77RroSjA", …
yuliansen
  • 470
  • 2
  • 14
  • 29
2
votes
1 answer

Indexing Errors when using quarkus logging-gelf extension and ELK stack

I have setup logging like described in https://quarkus.io/guides/centralized-log-management with an ELK Stack using version 7.7. My logstash pipeline looks like the proposed example: input { gelf { port => 12201 } } output { …
Jonas
  • 37
  • 1
  • 7
2
votes
1 answer

How to setup ELK in simple java project

I am new in ELK setup. I setup ELK in spring Boot microservice and running successfully but i want to setup ELK in simple Java project. I have a simple JAVA project i am using Jar of that project in docker file. Is there any way to setup ELK in…
ankit
  • 2,591
  • 2
  • 29
  • 54
2
votes
1 answer

Combine two fields of two different log lines in same index pattern

I'm new to Kibana, i have two log patterns in same index pattern Example log line 1 : rejected with ID 123456 log line 2 : rebooking is successful for ID 123456 for US country I need to create bar chart for country base on the matched ID , something…
HemaDharani
  • 33
  • 3
2
votes
3 answers

Logstash : "Error: Could not find or load main class Heal" when running logstash.bat

I just downloaded logstash 7.6.0 in windows 10. I already have elastic search (7.6.0) and kibana (7.6.0) running. When I run logstash.bat with default configuration it gives this error. Error: Could not find or load main class Heal I have jdk 11…
Faizal
  • 41
  • 6
2
votes
1 answer

Why can I only destructure anonymous types?

I am trying to set up an ASP.NET Core 3.1 Web API to test the elk stack using Serilog v2.9 and Serilog.Sinks.Elasticsearch v8.0.1. This is all new to me and I'm just trying to figure things out. I seem to have everything working and can log simple…
Lordshmee
  • 43
  • 3
2
votes
1 answer

Is it possible to run the elk stack on kubernetes using minikube

I am trying to get the elk stack running locally on a linux ubuntu 18.04 laptop using minikube. But I don' get past step one, the elastiearch master nodes do not come on line. Appearantly because the physical volumes are not being created, or…
Tobbes
  • 41
  • 11
2
votes
1 answer

Running kibana with docker - ENV variables not set

I am trying to setup a development elastic search + kibana servers. Elastic search server is up and running. When I am trying to run the kibana image, for some reason it ignores my env-varaibles This is the command i am using: sudo docker run -dit…
omriman12
  • 1,644
  • 7
  • 25
  • 48
2
votes
0 answers

Filebeat does not complete on close_eof + --once

Using filebeat 7.5.2: I'm using a filebeat configuration with close_eof enabled and I run filebeat with the flag --once. I can see the harvester reaching eof but the filebeat keeps going. Flebeat conf: filebeat.inputs: - type: log close_eof: true …
José Marques
  • 21
  • 2
2
votes
1 answer

how to handle special characters ( " ) in input file logstash

i'm having a problem with my data when push to ELK using logstash. here is my input file input { file { path => ["C:/Users/HoangHiep/Desktop/test17.txt"] type => "_doc" start_position =>…
Hoang Hiep
  • 37
  • 5
1 2 3
…
72 73