Stack Overflow
Stack Overflow

Questions tagged [fluent-bit]

Fluent-Bit (not to be confused with Fluentd), is an open-source, light weight data collector which can act as both an aggregator and forwarder. It allows you to collect data/logs from different sources, unify and send them to multiple destinations.

Fluent bit links :

379 questions
1
vote
1 answer

rewrite-tag filter in fluent-bit 1.6.0 hangs on

I tried the rewrite-tag example written in the documentation with fluent-bit 1.6.0 I was able to get rid of the following warning with the fix mentioned in the Git [2020/10/19 15:17:31] [ warn] [input chunk] no matching route for input chunk…
AnujAroshA
  • 4,623
  • 8
  • 56
  • 99
1
vote
1 answer

Include information from file name (Tag) in output

Using the 'tail' input plugin I'd like to include information from the filename into the message. I can parse the filename (from the tag) and modify it, but not able to include any info from it in the (stdout) output.
vbence
  • 20,084
  • 9
  • 69
  • 118
1
vote
2 answers

How to configure Fluentbit / Fluentd input from Azure Blob Storage? What input type?

We're currently collecting IIS logs using the tail input and shipping them to New Relic using fluentbit. fluent-bit.conf [SERVICE] Flush 1 Log_File C:\inetpub\logs\LogFiles\W3SVC1\*.log Parsers_File C:\Program Files\New…
pijemcolu
  • 2,257
  • 22
  • 36
1
vote
1 answer

How to parse a specific message and send it to a different output with fluent bit

I need to parse a specific message from a log file with fluent-bit and send it to a file. All messages should be send to stdout and every message containing a specific string should be sent to a file. I have managed to do it with a filter with the…
sotiris
  • 315
  • 6
  • 13
1
vote
1 answer

How to handle intermittent disconnections and send the right timestamp through HTTP in Fluent Bit?

I'm running Fluent Bit in a warehouse environment where internet connection drops quite often. Still, I want to upload data from fluent bit to my logstash server (HTTP output). I ran some tests by disconnecting from the internet, sending the data,…
David Bensoussan
  • 2,887
  • 2
  • 38
  • 55
1
vote
3 answers

fluent-bit cannot parse kubernetes logs

I would like to forward Kubernetes logs from fluent-bit to elasticsearch through fluentd but fluent-bit cannot parse kubernetes logs properly. In order to install Fluent-bit and Fluentd, I use Helm charts. I tried both stable/fluentbit and…
Tireli Efe
  • 160
  • 2
  • 11
1
vote
0 answers

Is there fluent-bit.conf reference for syslog input plugin for TLS setup

Is there a Documentation or examples of the conf files for the Syslog Input plugin with TLS setup for the Fluentbit?
soura49
  • 71
  • 2
1
vote
0 answers

Configure Fluentbit "Docker Json parse depth"

Using one of these parser plugin configurations: [PARSER] Name docker Format json Time_Key time Time_Format %Y-%m-%dT%H:%M:%S.%L Time_Keep On # Command | Decoder | Field | Optional Action #…
Quinten Scheppermans
  • 954
  • 1
  • 10
  • 29
1
vote
3 answers

How to include or exclude specific namespaces in cluster role kubernetes

I am trying to create a daemonset that will collect logs from all the pods in a node from a specific namespace. I am not sure how I would specify a namespace name. I have a namespace logging in which i deploy the daemonset. I created a serviceccount…
fledgling
  • 991
  • 4
  • 25
  • 48
1
vote
1 answer

How to change the timestamp to UTC for the logs that a fluent-bit docker container receives via stdin?

My Fluent Bit Docker container is adding a timestamp with the local time to the logs that received via STDIN; otherwise all the logs received via rsyslog or journald seem to have a UTC time format. I have a basic EFK stack where I am running…
Shōgun8
  • 482
  • 10
  • 20
1
vote
0 answers

Fluent bit - TCP Output plugin - Constant connection and JSON stream

I have been trying to configure Fluent bit to TCP output plugin. As far as I could observe Fluent bit has been initiating and closing a TCP connection to destination server in every JSON log flush. However, we would like to have a constant…
rsilva
  • 29
  • 4
1
vote
3 answers

Fluent-bit unable to ship logs to fluentd in docker due to EADDRNOTAVAIL

I'm trying to setup the EFK stack with fluent-bit on docker containers. While I could push the logs from fluent-bit to elasticsearch, when I tried to integrate fluentd, I'm facing issues with it. This's the exact error msg: unexpected error…
megamind79
  • 69
  • 3
  • 11
1
vote
1 answer

How to extract fields from existing logs (fluent-bit in ECS)

I have configured Fluent-bit on my ECS cluster . I can see the logs in Kibana. But all the log data are sent to a single field "log". How can I extract each field into a separate field. There is a solution for fluentd already in this question. But…
misha
  • 122
  • 6
1
vote
0 answers

Is there any parser present for java ant logs in fluent-bit

As we know we have inbuilt parser present for docker, k8s and etc. I was wondering if we have parser present for java ant in fluent-bit.
user7131571
  • 239
  • 2
  • 3
  • 12
1
vote
0 answers

EFK. Logs entries doesn't get parsed

We use EFK-stack, where F stands for fluent bit. In my kotlin spring boot application I configured logging as follows with logback and logstash
Roman T
  • 1,400
  • 5
  • 18
  • 31
1 2 3
…
25 26