0

I am trying to integrate hadoop with ELK stack. My use case is " i have to get a data from a file present in HDFS path and show the contents on kibana dashboard"

Hive is not working there so I can't use hive. Are there any other ways to do that?

Anybody is having any article with step by step process?

I have tried to get logs from a linux location on a hadoop server through logstash and filebeat but that is also not working.

Yukti Agrawal
  • 66
  • 5

1 Answers1

0

I'm doing this for some OSINT work it is quite easy to do once one can get the content out of hdfs into a local filesystem. That's done by setting up a HdfsNfsGateway. Once that's done use filebeat and logstash to import your content into elasticsearch. After that just configure your kibana dashboard for the index your using.

Dwight Spencer
  • 1,472
  • 16
  • 22