My log file name in s3 looks like kube.var.log.containers.development-api-connect-green-58db8964cb-wrzg5_default_api-connect-fa7cafd99a1bbb8bca002c8ab5e3b2aefc774566bb7e9eb054054112f43f1e87.log/ here I want to extract only container name from tag so…
We are sending node.js code to OpenSearch using FluentBit. We are having issues because log key contains nested value as message. We need to split the values mentioned in the below log message -
log- {"level":"info","message":"\"{\"method:\" GET…
I would like to throttle logs per kubernetes service - in other other words apply throttle filter for specific tags or keys.
Fluentd had a group_key attribute that enables throttling at a service level but Fluent-bit does not.
This is the…
In my scenario, I'm using a fluent-bit (version 1.6.1) filter to identify a particular log pattern and tag (from.solr.out) it.
[FILTER]
Name rewrite_tag
Match test_tag
Rule $msg "^\d{4}-\d{2}-\d{2}…
I tried the rewrite-tag example written in the documentation with fluent-bit 1.6.0
I was able to get rid of the following warning with the fix mentioned in the Git
[2020/10/19 15:17:31] [ warn] [input chunk] no matching route for input chunk…
I am using fluentbit with ecs - rewrite_tag filter plugin to differentiate both access and application logs but it is not working when i am trying with latest version of fluentbit image and working properly as expected when trying with old version…
I am using fluentbit with Fargate with mount volume where logs input is from stdout and using rewrite tag to separate access and application logs to two different indices, When I am using single index all the logs are parsing fine and everthing…
Overall goal
I have a huge application specific log-file, easily per-line-parsable, with two (or more) types of log lines I would like to tail and extract with fluent-bit for further processing in a time series database / elastic / etc.
First…