Stack Overflow
Stack Overflow

Questions tagged [fluent-bit]

Fluent-Bit (not to be confused with Fluentd), is an open-source, light weight data collector which can act as both an aggregator and forwarder. It allows you to collect data/logs from different sources, unify and send them to multiple destinations.

Fluent bit links :

379 questions
0
votes
0 answers

How can I remove the key from fluent-bit output?

I am using the following input in fluent-bit configuration of Kubernetes ConfigMap (YAML): [INPUT] Name mem Tag memory_usage Interval_Sec 60 Interval_NSec 0 which provides output like: { …
Viji
  • 412
  • 4
  • 15
0
votes
1 answer

Regex to extract capture groups from two different log entries

I have two types of logs (different formats) in one log file: First Log Format: 2019-09-01 18:58:05,898 INFO Thread: qtp1497973286-16 - com.xyz.soap timestamp:2019-09-01 18:58:05,898,…
Payam
  • 1,068
  • 12
  • 15
0
votes
1 answer

In the K8S environment, FluentBit outputs to Kafka, can establishes a connection and creates a topic, but generates data report error

Ask a question. In the K8S environment, FluentBit outputs to Kafka, can establishes a connection and creates a topic, but generates data report error. [error] [output:kafka:kafka.0] fluent-bit#producer-1: [thrd:data39:9092/176]: data39:9092/176:…
user3804623
  • 165
  • 1
  • 1
  • 9
0
votes
1 answer

Can't communicate with Elasticsearch endpoint from FluentBit

Problem: Connection by AWS Elasticsearch endpoint is refused when pushing Kubernetes logs through a fluentBit forwarder. Here is the fluentBit set up: apiVersion: v1 kind: ConfigMap metadata: name: fluent-bit-config namespace: logging labels: …
Raoul_2992
  • 3
  • 1
  • 2
0
votes
1 answer

Fluent Bit output to Splunk on Windows

I tried following command to send logs to Splunk fluent-bit -i dummy -o splunk -p host=10.16.0.41 -p port=8088 -p tls=off -p tls.verify=off -p splunk_token=my_splunk_token_value -m '*' It works with Mac OS but not working when it runs on…
AnujAroshA
  • 4,623
  • 8
  • 56
  • 99
0
votes
1 answer

Fluentbit kubernetes - How to add kubernetes metadata in application logs which exists in /var/log// path

I have created Python Application which is writing 3 types of log files in /var/log/{envName}/{applicationName} directory. One is stats logs, second is exception logs and third is access logs/application logs Now I am using Fluentbit DaemonSet for…
user3645742
  • 111
  • 1
  • 11
0
votes
0 answers

Specify file inside container as Fluent bit's input

If I have a container writing its log to a file e.g /var/log/app.log, how can I configure Fluent bit to read the container's log from that file?I have this configuration inside my K8S ConfigMap: input-kubernetes.conf: | [INPUT] Name …
El ktiba
  • 326
  • 1
  • 6
0
votes
1 answer

fluentbit fails to communicate with fluentd

I am trying a simple fluentbit / fluentd test with ipv6, but it is not working. Configuration from fluentbit side: [SERVICE] Flush 5 Daemon off [INPUT] Name cpu Tag fluent_bit [OUTPUT] …
kiwo
  • 128
  • 1
  • 8
0
votes
0 answers

How to list log files in fluent-bit?

I am using fluent-bit version 1.6.2 in docker with the following INPUT section: [INPUT] Name tail Path /fluent-bit/log/containers/*/*-json.log Tag docker.log Parser docker How can I list those log files? I can't get a…
markhorrocks
  • 1,199
  • 19
  • 82
  • 151
0
votes
3 answers

How to configure aws credentials to setup cloudwatch with fluentbit

I need to send logs to cloudwatch using fluentbit, from the application hosted on my local system, but i am unable to configure the aws credentials for fluent bit to send logs to cloudwatch. It will be of great help if anyone can help me with the…
Raghu kapur
  • 9
  • 1
  • 2
0
votes
1 answer

Issue with TLS between Fluent-bit client and Fluentd server

I am trying to connect a fluent-bit client (running in Docker container) to a server running Fluentd with TLS. Fluent-bit Client config: [SERVICE] Flush 2 Daemon Off Log_level debug [INPUT] Name Dummy [OUTPUT] Name …
joeschneids
  • 99
  • 2
  • 9
0
votes
1 answer

Fluent-bit Filter seems to only work when Match is *

I'm using docker-compose, that generates over 20 services. Most of them are similar, but parses different datetime format or values differ slightly. My logging idea is logging everything to systemd and then getting it over fluent-bit. most of the…
Simas Paškauskas
  • 433
  • 8
  • 20
0
votes
0 answers

Logs are not sent to elasticsearch using fluentd. The log is written in one line

The Java module writes a single-line log: {"timestamp":"2020-09-29 10:46:18.761","level":"INFO","message":"status: OK","logger":"thrift.handler.CheckTokenThriftHandler","system":"-","service":"AUTH BE","conf_item":"-"}{"timestamp":"2020-09-29…
Aleksandr Bryanskiy
  • 1
  • 1
0
votes
1 answer

How to read unescaped json in fluentd?

I have a setup with Fluent Bit sending data in Elasticsearch format to Haproxy in SSL. Haproxy terminates the SSL and forwards the data to Fluentd. Now here is the issue, Fluentd receives the data unescaped and thus can't forward it to ES. Fluentd…
David Bensoussan
  • 2,887
  • 2
  • 38
  • 55
0
votes
0 answers

Configure AWS Sigv4 Authentication for Amazon ElasticSearch Service for Fluentbit

I have AWS EKS and AWS ES running. I deployed Fluentbit as a Daemonset in EKS and now I want to enable AWS Sigv4 authentication to allow Fluentbit to send logs to the ES cluster. As far as I understand, I need to create an IAM role and provide…
Anton
  • 1,793
  • 10
  • 20
1 2 3
…
25 26