Logstash not streaming to SolR

Question

I've got the following log-flow:

FileBeat -> Logstash -> SolR -> Banana

and I know that filebeat is streaming to logstash successfully, since I can log the output to terminal. For some reason, the data is not being channelled into SolR for indexing... I'm using a the solr_http plugin, and the config looks like this:

input {
  beats {
    port => 5044
  }
} 
output {
  stdout { codec => rubydebug }
  solr_http { solr_url => "http://localhost:8983/solr/gettingstarted" }
}

Is there something I have to configure in SolR?

I haven't used the solr output, but I'd look in the logstash and solr logs. — Alain Collins, Jan 20 '16 at 16:52
...so far 2 things, the http payload was too large, but my latest issue is adding the event_timestamp field into the log — TheRealJimShady, Jan 21 '16 at 09:55

score 2 · Answer 1 · edited May 23 '17 at 10:29

2

It seems that a problem in the logstash-output-solr_http plugin. See the following issue: https://github.com/logstash-plugins/logstash-output-solr_http/issues/3

You can try to check is it exactly the problem just sending a call to the Solr API like here How to optimize solr index.

I've used this one: https://github.com/mosuka/logstash-output-solr.

edited May 23 '17 at 10:29

Community

1
1

answered Mar 15 '17 at 11:13

AlexeyBelous

33
7

score 1 · Answer 2 · edited Mar 11 '17 at 13:56

1

I had the same problem and for more that I searched on the internet I did not find a solution, what I had to do was configure apache flume with a morphilines sink, because this works in a more native way, in my concept logstash with output solr plugin does not work.

I hope it's your help

edited Mar 11 '17 at 13:56

frb

3,738
2
21
51

answered Mar 09 '17 at 16:50

Jhon Mario Lotero

307
2
6

Logstash not streaming to SolR

2 Answers2