Logstash File Input stream events from Files
Questions tagged [logstash-file]
221 questions
0
votes
1 answer
Log back configuration error while running JUnit
I configured logback.xml in my application and it's working fine. But after working some days, while running Junit test cases i got the below error.
java.lang.IllegalStateException: Logback configuration error detected:
ERROR in…
G V
- 65
- 1
- 10
0
votes
1 answer
Can't not start logstash when enable security At elastic search and Kibana
I'm try to using Security function at ELK. My elastic version is 7.5.1
I'm having a problem with the file config. i can't start logstash
1.First, i enable security in elasticsearch.yml by added xpack.security.enabled: true
2.Second, at kibana.yml i…
Hoang Hiep
- 37
- 5
0
votes
0 answers
Logstash Not Recognizing The Lat/Lon fileds in Json Format
I have fields like A_Latitude, A_Longitude, B_Latitude and B_Longitude. I would like to make use of this data and create Maps in Kibana. The problem is data is getting into elasticsearch, but the gejson columns created in Logstash filter not gettin…
Ramya T
- 53
- 1
- 6
0
votes
0 answers
Logstash doesn't send logs to elastic (Windows)
I have a Spring boot application, that produces logs into a file.
I also have running Elastic search (in docker) and Kibana and Logstash (not in docker).
This is my Logstash config:
input {
file {
type => "java"
path =>…
Ondřej Burda
- 13
- 5
0
votes
1 answer
logstash GROK filter along with KV plugin couldn't able to process the events
i am new to ELK. when i onboarded the below log file, it is going to "dead letter queue" in logstash because logstash couldn't able to process the events.I have written the GROK filter to parse the events but logstash still couldn't not process the…
learning fun
- 519
- 1
- 5
- 12
0
votes
1 answer
how do i split message into 2 properties based on one of 2 tokens?
I think this is a simple case, but I have been having issues implementing it.
My input message is in the format: aaaaaaaaa;bbbbbbbbbb or aaaaaaa:bbbbbbb and what i was trying to do was to split on either of the colon or semicolon, and then assign…
Fallenreaper
- 10,222
- 12
- 66
- 129
0
votes
1 answer
Json Array splitting issue Logstash configuration : Unexpected end-of-input: expected close marker for Array (start marker at [Source: (S
This is how my json object looks like, i have verified that the json i am getting is a valid. I tries setting up configuration files for the same, but always get the same error
SON parse error, original data now in message field {:error=>#,…
vignesh harish
- 1
- 2
0
votes
1 answer
Logstash starting but not creating indices
I am trying to create an index in elasticsearch using a csv file. Below is the configuration.
input {
file {
path => "C:\Users\soumdash\Desktop\Accounts.csv"
start_position => "beginning"
sincedb_path => "NUL"
}
}
filter {
csv{
…
0
votes
1 answer
Stored Query from Database as JDBC input to Logstash
I have table eg QueryConfigTable that holds a query in one column eg ,select * from customertable .I want the query in the column to be hold query to be executed as input to JDBC in logstash I
its taking the column query as value and storing in…
David
- 17
- 3
0
votes
1 answer
Logstash: Nothing displayed on console (Mac)
I am trying to set up a very simple logstash config
input {
file {
path => "/path/to/my/log/file"
start_position => "beginning"
ignore_older => 0
}
}
filter {
}
output {
stdout {
codec => rubydebug
}
}
and here is how i…
AbtPst
- 7,778
- 17
- 91
- 172
0
votes
1 answer
Logstash file is missing in /etc/init.d after installing logstash ubuntu
I am installing logstash 6.3.0 in Ubuntu with the following commands
curl -L -O https://artifacts.elastic.co/downloads/logstash/logstash-6.3.0.deb
sudo dpkg -i logstash-6.3.0.deb
Although the installation is completed, Still no logstash file will be…
Sameera Manorathna
- 558
- 12
- 26
0
votes
1 answer
How to print or store all skipped lines of a large log file in logstash
Some times due incorrect pattern of some lines of logs inside complete log files are skipped by logstash.
It only sends all lines having pattern matched to grok syntax i have written.
I want to see which lines of logs are skipped or not read by…
Amit
- 7
- 5
0
votes
1 answer
logstash: File input not working, stdout does not show anything at all (Windows)
I am new to logstash, I was trying to give a sample log file as input through the logstash config file. But it does not seem to be working. Initially I gave input through stdin, it worked perfectly and showed the output in stdout. I placed the same…
Roseau
- 77
- 1
- 2
- 9
0
votes
1 answer
Logstash - Write file per split event
I have a Logstash conf where I split an incoming XML into multiple events. I would like to write a file per event. However, the file output writes all the events to a single file (so an event per line). Is there a way to achieve…
Romario
- 1
0
votes
0 answers
View Logstash result in Kibana depend on log folders
i'm new user to logstash and kibana
i try to view my logs in kibana separated depend on there folder
i run logstash service contain my pipe as below
input {
file {
{ type => "STAGE-LOG-ADMIN"
path =>…
Ayman Ali
- 211
- 2
- 12