0

Good afternoon. I need to collect application logs in an eks cluster using fargate, in a node group environment I use a fluentbit running with daemon set to collect this and send it to a logstash. But as fargate doesn't support the set daemon, I'm trying some alternatives for that, without using AWS elastic, because we need to send the collections to a logstash. Has anyone done something like this using these products?

Felipe Pereira
  • 1

1 Answers1

0

You probably already have the config using Filebeat to send logs to Logstash, thus you can use FileBeat as the sidecar to do the same. If you would like to stick with FluentBit (NOT the AWS Fluentbit provided by Fargate), you can leverage on the HTTP plugin of OSS FluentBit and Logstash.

gohm'c
  • 13,492
  • 1
  • 9
  • 16
  • Setting it up as a sidecar I can't bind the volumes to collect the logs in /var/containers/*.log. I saw that fargate has a native fluentbit, but I couldn't use it with the output name HTTP, to send it to logstash. – Felipe Pereira Sep 10 '21 at 13:42
  • You need to create an emptyDir volume where both the app. and sidecar containers can access (volumeMounts). Your app. then write log to this location and the logs are pick up by the sidecar; send to Logstash using HTTP plugin. – gohm'c Sep 11 '21 at 03:23