Stack Overflow
Stack Overflow

Questions tagged [fluent-bit]

Fluent-Bit (not to be confused with Fluentd), is an open-source, light weight data collector which can act as both an aggregator and forwarder. It allows you to collect data/logs from different sources, unify and send them to multiple destinations.

Fluent bit links :

379 questions
0
votes
1 answer

Fluent-bit unable to find parser event if define in config file

I want to create a parser in fluent-bit to parse the logs, which are sent to a elastic search instance but filter is unable to pick parser even when it is created. Here are the logs: Fluent Bit v1.0.4 Copyright (C) Treasure Data [2020/07/27…
Aman Kumar Soni
  • 55
  • 1
  • 5
0
votes
1 answer

fluentbit writes to /var/log/messages

I'm running fluentbit (td-agent-bit) on a CentOS system in order to output all logs in a centralized system. Everytime fluentbit pushes a record to the remote location, it adds a record in /var/log/messages as well, leading up to a huge log…
Lemnaru Eduard-Mihai
  • 11
  • 5
0
votes
1 answer

FluentBit - Parsing from Path_Key

Currently im adding the filepath using Path_Key. I am trying to grab multiple variables that exist in the Path_key. /var/log/containers/**Application_Name**-**Application_Version**.log Is it possible to extract these values from an existing field…
leopold
  • 13
  • 1
  • 4
0
votes
2 answers

Installing Fluent Bit on Mac

I want to install Fluent Bit on macOS Catalina. All the resources available are for Ubuntu and Windows. I followed this guide for Ubuntu [1]. Can anyone guide me on this? [1] https://docs.fluentbit.io/manual/installation/linux/debian
N.Chandimali
  • 799
  • 1
  • 8
  • 23
0
votes
1 answer

Is it possible to write multiple regex for the same input in Fluent Bit?

My logs look like this: 200 59903 0.056 - [24/Jun/2020:00:06:56 +0530] "GET /xxxxx/xxxxx/xxxxx HTTP/1.1" xxxxx.com [xxxx:4900:xxxx:b798:xxxx:c8ba:xxxx:6a23] - - xxx.xxx.xxx.xxx - - - "http://xxxxx/xxxxx/xxxxx" 164551836 1 HIT "-" "-" "Mozilla/5.0…
lycanthrope10100
  • 111
  • 1
  • 2
  • 12
0
votes
0 answers

Installation of FluentBit failing at make stage

I'm trying to install FluentBit on Centos. While running make it fails at 83% and I'm unable to understand the error. Cannot find anything in the web relating to this. Can someone please help me. [ 83%] Building C object…
Red Bottle
  • 2,839
  • 4
  • 22
  • 59
0
votes
1 answer

aws fargate and firelens with fluentbit, ES output plugin TCP connection failed randomly

I am running AWS ECS task with Fargate type with Firelens and custom Fluentbit configuration(attached below). While i could run successfully, when i re-deploy tasks(update ECS Service by increasing number of tasks etc.), very often there are tasks…
SallGood
  • 17
  • 3
0
votes
1 answer

Fluent Bit part of a string in one of the output field?

I am using AWS Firelens to send logs to Cloudwatch. Firelens sends these below fields by default to fluentbit container along with the log message. { "container_id": "asdfasdfasdfadsf", "container_name":…
karthikeayan
  • 4,291
  • 7
  • 37
  • 75
0
votes
1 answer

Why are my parser types not picked up in my elastic index?

I'm using fluent-bit to forward logs to an elastic db. All my fields are being indexed in elastic under the default string type but I want some fields indexed as numbers. I've attempted to set the types in my fluent-bit config by adding a types…
kapowie
  • 1
0
votes
1 answer

Using Fluent Bit Modify Filter on Kubernetes properties

I'm using Fluent Bit (1.3.11) to collect logs from containers running on k8s. What I would like to do is some basic processing using Fluent Bit Modify filters (i.e. to standardize log level names). I added two modify filters (see below). The first…
jasper
  • 521
  • 4
  • 17
0
votes
1 answer

Getting permission denied in fluent-bit docker container

I have created docker container with fluent-bit but when I try to execute the docker entrypoint.sh I'm getting permission denied. below i attached the docker file FROM fluent/fluent-bit:1.4-debug USER root ADD ./docker-fluentbit-entrypoint.sh…
HARINI NATHAN
  • 217
  • 3
  • 12
0
votes
1 answer

How to limit the size of log file when using fluentbit file OUTPUT plugin?

Based on this guide: https://kevcodez.de/posts/2019-08-10-fluent-bit-docker-logging-driver-elasticsearch/ I have started a fluentbit container that collects logs from another ubuntu container and writes the logs to the…
u123
  • 15,603
  • 58
  • 186
  • 303
0
votes
0 answers

How to create a repeating non-capturing group with multiline text?

I am new to Regex and I cannot solve this problem with all the tutorials I've found. Maybe you experts know how to solve it. I have a logfile with timestamps at the beginning of each line. The log entries are separated trough double space lines \n\n…
drbugfinder
  • 1
0
votes
0 answers

How to make fluent-bit categorically write POD logs to the file system?

Can someone please help me with this question ? Per our usecase, I have changed the logging driver to "fluentd" in /etc/docker/daemon.json So all pods that gets deployed on the kubernetes nodes will directly forward the log events to the fluentd…
Venu S
  • 3,251
  • 1
  • 9
  • 25
0
votes
0 answers

Problem parsing Fluentbit Docker Logs(Systemd) to GELF message Output in Kubernetes

I'm getting Docker(Systemd) logs and trying send it in GELF format to Graylog 3 output but the log is not in the correct format, and Graylog discart it. I'm folow this…
rafambbr
  • 570
  • 8
  • 15
1 2 3
…
25 26