Stack Overflow
Stack Overflow

Questions tagged [fluent-bit]

Fluent-Bit (not to be confused with Fluentd), is an open-source, light weight data collector which can act as both an aggregator and forwarder. It allows you to collect data/logs from different sources, unify and send them to multiple destinations.

Fluent bit links :

379 questions
3
votes
0 answers

How to use fluentbit in my Rails App to log to EFK?

I did some research to implement logging possibilities in my Rails App. There are a lot of good blocks and gems description to use Logstash or fluentd to send my logs to ElasticSearch. But so far I didn't find any documentation using fluentbit. Did…
F.M.
  • 193
  • 2
  • 8
3
votes
1 answer

Fluentbit creates TCP connections

Fluentbit creates TCP connections to itself? What are these used for? fluent.conf file: [SERVICE] Flush 5 Daemon Off Log_Level debug [INPUT] Name tail Tag format.logging path C:\Logs\*main.log …
Kavinda Gayashan
  • 387
  • 4
  • 17
3
votes
1 answer

FluentBit - Is there a way to Truncate the Logs if they are too long?

FluentBit - Is there a way to Truncate the Logs if they are lets say greater that 1500 characters??? Do not want to have like the entire stack Trace printed.... Is there a config for this???
Savio Coelho
  • 33
  • 4
3
votes
0 answers

fluentbit configmap logs distribution as per namespace

Scenario:- I have fluent bit configmap, which helps to send container logs to ES as per their namespaces. Problem:- When I started we have 3 to 4 namespaces and I make the changes manually in my fluent bit config map and applied it. but now we have…
me25
  • 497
  • 5
  • 18
3
votes
1 answer

Fluentbit - parsing log with multiple format (log+json)

I'm trying to send to elasticsearch the following log line through fluentbit, but I didn't find the right solution to extract both time and the json structure after the [MLP] part: 2020-12-29 08:00:03,230 INFO [http-nio-3410-exec-7]…
Meekly
  • 31
  • 2
3
votes
2 answers

Duplicate and missing log entries with FluentBit and ES

We're using FluentBit to ship microservice logs into ES and recently found an issue on one of the environments: some log entries are duplicated (up to several hundred times) while other entries are missing in ES/Kibana but can be found in the…
Yuri
  • 1,695
  • 1
  • 13
  • 23
3
votes
1 answer

use tls and elastic in fluentbit

I'm trying to send logs to my elastic pod with FluentBit service on a different VM. I configured ingress for elastic. I configured the FluentBit that way: [OUTPUT] Name es Match * Host Port 443 #Retry_Limit 1 URI…
NoamiA
  • 521
  • 4
  • 19
3
votes
1 answer

How to access logs logged in journald using fluent-bit that's inside a docker container

I'm using docker-compose.yml that launches my services. All services look something like this: A-service: image: A-service restart: always network_mode: host logging: driver: journald options: tag:…
Simas Paškauskas
  • 433
  • 8
  • 20
3
votes
3 answers

Fluent Bit: Logstash_Prefix_Key is not working as expected with 'es' output plugin

I am trying to lookup a key from a record and use it as logstash prefix in fluent bit. But that's not happening and Logstash_Prefix is not being replaced by Logstash_Prefix_Key even though the specified key exists in the enriched log from kubernetes…
coder here
  • 179
  • 3
  • 10
3
votes
1 answer

Fluent bit - How can I check for internal errors?

I installed fluent bit using YAML files on my K8s instance following the documentation. I just modified the Elasticsearch instance pointing to my own instance. All fluent-bit daemonsets are running but it is not sending any logs to my ES. I checked…
gtama
  • 33
  • 1
  • 3
3
votes
0 answers

Forward logs to Index Template in stead of directly to Index from Fluent-bit to ElasticSearch

I´m using Fluent-bit (v1.3.7) with output to ElasticSearch. Is it possible to configure Fluent-bit to use the Elastic Index Template name in stead of default Index Name in the output plugin configuration? Reason for this is that I don't want…
Ismar Slomic
  • 5,315
  • 6
  • 44
  • 63
3
votes
1 answer

Adding Kubernetes Metadata To Custom FluentD Non DaemonSet @tail Event

I have a pod that runs Fluentd as a sidecar that collects the logs from another container (sample application) and the common volume have been mounted on both containers (volumeMounts). Sample Application Code writes a UTC timestamps to a file …
Jninja
  • 149
  • 1
  • 3
  • 13
3
votes
0 answers

Configure fluent-bit helm chart for docker

I'd like to send my logs to elastic search via fluent-bit. I've configured values.yaml as follow. parsers: enabled: true json: - name: docker timeKey: time timeFormat: "%Y-%m-%dT%H:%M:%S.%L" timeKeep: on …
Vicky Thakor
  • 3,847
  • 7
  • 42
  • 67
2
votes
1 answer

Is it possible to have multiple named capture groups with the same name?

I'm trying to develop a ruby based regular expression to parse http response. My question is: how can I have all the http header names and values as captured groups? I can only capture the last one. Here is my…
l4t3b0
  • 39
  • 1
  • 4
2
votes
0 answers

What's the purpose of `Time_Key` in Fluent Bit parsers?

I'm new to learning Fluent Bit, and I can't wrap my head around the benefit of specifying the Time_Key field in a parser. An example from the documentation is below, but I don't know what the point of defining this is. By declaring Time_Key and a…
foxmag86
  • 21
  • 1
1 2
3
…
25 26