Questions tagged [fluent-bit-rewrite-tag]

Official docs:

https://docs.fluentbit.io/manual/pipeline/filters/rewrite-tag

8 questions
2
votes
1 answer

FluentBit S3 upload with container name as key in s3

My log file name in s3 looks like kube.var.log.containers.development-api-connect-green-58db8964cb-wrzg5_default_api-connect-fa7cafd99a1bbb8bca002c8ab5e3b2aefc774566bb7e9eb054054112f43f1e87.log/ here I want to extract only container name from tag so…
2
votes
1 answer

How to split log (key) field with fluentbit?

We are sending node.js code to OpenSearch using FluentBit. We are having issues because log key contains nested value as message. We need to split the values mentioned in the below log message - log- {"level":"info","message":"\"{\"method:\" GET…
1
vote
2 answers

How to create a lua script for fluentbit throttle by specific key

I would like to throttle logs per kubernetes service - in other other words apply throttle filter for specific tags or keys. Fluentd had a group_key attribute that enables throttling at a service level but Fluent-bit does not. This is the…
fledgling
  • 991
  • 4
  • 25
  • 48
1
vote
1 answer

How to overwrite a rewrite_tag in fluent-bit

In my scenario, I'm using a fluent-bit (version 1.6.1) filter to identify a particular log pattern and tag (from.solr.out) it. [FILTER] Name rewrite_tag Match test_tag Rule $msg "^\d{4}-\d{2}-\d{2}…
AnujAroshA
  • 4,623
  • 8
  • 56
  • 99
1
vote
1 answer

rewrite-tag filter in fluent-bit 1.6.0 hangs on

I tried the rewrite-tag example written in the documentation with fluent-bit 1.6.0 I was able to get rid of the following warning with the fix mentioned in the Git [2020/10/19 15:17:31] [ warn] [input chunk] no matching route for input chunk…
AnujAroshA
  • 4,623
  • 8
  • 56
  • 99
0
votes
0 answers

Rewrite_tag filter plugin is not working properly when trying with latest Fluentbit Image version

I am using fluentbit with ecs - rewrite_tag filter plugin to differentiate both access and application logs but it is not working when i am trying with latest version of fluentbit image and working properly as expected when trying with old version…
Farha
  • 1
  • 1
0
votes
0 answers

Records are missing while using Rewrite_Tag filter in fluentbit output to elasticsearch

I am using fluentbit with Fargate with mount volume where logs input is from stdout and using rewrite tag to separate access and application logs to two different indices, When I am using single index all the logs are parsing fine and everthing…
Farha
  • 1
  • 1
0
votes
0 answers

Fluent-bit: Extract two or more line types from a single log file into separate tags / outputs

Overall goal I have a huge application specific log-file, easily per-line-parsable, with two (or more) types of log lines I would like to tail and extract with fluent-bit for further processing in a time series database / elastic / etc. First…
Mr.Rulez
  • 25
  • 1
  • 5