How to debug the logstash file plugin

Question

Is it possible to log actions of the logstash file plugin? (i.e. what files it tries to send, what errors happen, etc)

score 55 · Accepted Answer · answered Apr 29 '14 at 12:55

55

In new version stdout format changed

stdout { codec => rubydebug }

answered Apr 29 '14 at 12:55

Max

4,292
1
20
14

I also want to know how to show only Logstash parse errors, like _jsonparsefailure – hsluoyz Oct 10 '18 at 15:55

score 15 · Answer 2 · edited Apr 30 '19 at 14:47

If you want to debug the process itself you may run it like this

/opt/logstash/bin/logstash -f yourconf.conf -v --debug --verbose

NOTE: According to @neeraj-gupta using --debug and --verbose at the same time may cause a problem when trying to see debug logs of cloudwatch and using only --debug is enough.

So realistically something like this is more apt:

/opt/logstash/bin/logstash -f yourconf.conf --debug

Becca Gaspard · Answer 3 · 2018-07-19T19:41:58.290

5

* * * This method of debugging is now deprecated - see Max's answer above! * * *

Try adding a stdout output with debug set to true. You should be able to see the entire event object and errors / warnings in your logstash --log or stdout.

input {
   file {
      ...
   }
}
output {
   stdout {
      debug => true
   }
   ...
}

Hope that helps!

edited Jul 19 '18 at 19:41

answered Sep 30 '13 at 16:55

Becca Gaspard

1,165
7
19

9

debug parameter is deprecated – Mariano Argañaraz Oct 27 '15 at 19:31
2

debug => true doesn't work any more (tested on v2.3). – jmreicha Jun 03 '16 at 21:12

score 2 · Answer 4 · edited Jun 03 '19 at 19:48

2

Yes, you can see what files it tries to send, what errors happening through the output section by applying:

stdout { codec => rubydebug }

Codec is responsible for giving output. So, here it outputs your event data using the ruby "awesome_print" library.

edited Jun 03 '19 at 19:48

slm

15,396
12
109
124

answered Nov 22 '15 at 06:14

Shalini Baranwal

2,780
4
24
34

How to debug the logstash file plugin

4 Answers4

Linked