Stack Overflow
Stack Overflow

Questions tagged [fluent-bit]

Fluent-Bit (not to be confused with Fluentd), is an open-source, light weight data collector which can act as both an aggregator and forwarder. It allows you to collect data/logs from different sources, unify and send them to multiple destinations.

Fluent bit links :

379 questions
2
votes
1 answer

Contacting loki from fluentbit output plugin

I am collecting logs from a kubernetes cluster using fluentbit, having an output that connect to loki to send them there. This is my loki configuration at fluentbit configmap file Since loki is deployed at loki namespace, and fluentbit at fluentbit…
bgarcial
  • 2,915
  • 10
  • 56
  • 123
2
votes
0 answers

fluentbit conf help for stacktrace in k8s logs

I want to properly parse my pod logs to see stack trace as well using fluent-bit (1.8.7) and view them in Kibana if possible. With the below configuration I'm able to get the stacktrace as a single log but they still seem to be in json format. Any…
mechanicum
  • 699
  • 3
  • 14
  • 25
2
votes
1 answer

How to disable JSON format and send only the log message to Cloudwatch with Fluentbit?

I am trying to setup Firelens for my Fargate tasks. I would like to send logs to multiple locations, Cloudwatch and Elasticsearch. But only to Cloudwatch I want to disable JSON format and send only the log message as it is. I have the below…
karthikeayan
  • 4,291
  • 7
  • 37
  • 75
2
votes
0 answers

fluent-bit parser not working. Field is not being parsed/filtered

Need help. I send logs from fluent-bit to grafana/loki but fluent-bit cannot parse logs properly. I use Helm charts fluent-bit.conf: |- [SERVICE] HTTP_Server On HTTP_Listen 0.0.0.0 HTTP_PORT 2020 Flush 1 …
Амангельды Омаров
  • 66
  • 6
2
votes
1 answer

Fluentd : Is there a way to add multiple tags in single match block

I have multiple source with different tags. Im trying to add multiple tags inside single match block like this. @type tail @label @TESTLABEL path /var/log/containers/app-one-*.log pos_file /var/log/app-one.log.pos tag app.one …
Prakash26790
  • 727
  • 9
  • 29
2
votes
2 answers

Why does EKS say my fluent-bit.conf is not valid

I am trying to setup Fluent Bit for Kuberentes on EKS + Fargate. I was able to get logs all going to one general log group on Cloudwatch but now when I add fluent-bit.conf: | to the data: field and try to apply the update to my cluster, I get this…
Frederick Haug
  • 245
  • 2
  • 14
2
votes
1 answer

fluent-bit to Loki - "log" field is not being parsed/filtered

I have: a simple Python app ("iss-web") writing JSON log output to stdout the Python app ("iss-web") is within a Docker Container the Python app ("iss-web") Container logging driver is set to "fluentd" a separate Container running…
wurzel
  • 43
  • 5
2
votes
0 answers

Fluent-bit doesn't collect logs recursively

I am trying to create a forwarder base on fluent-bit instance and I encountered following issue related to collecting log files recursively. I found similar question but without response: How to upload all logs in directory recursively with Fluent…
PumpR
  • 21
  • 2
2
votes
0 answers

Multiline Spring Boot logs from CRI-O logs on OpenShift

Software Stack Software Version OpenShift 4.4 Fluent-Bit 1.7.0-rc4 ElasticCloudStack 7.10.2 I have a DaemonSet for fluent-bit pods to read OpenShift logs from /var/log/containers on the worker nodes. Logs are coming to Elastic and…
n002213f
  • 7,805
  • 13
  • 69
  • 105
2
votes
0 answers

Logging presto queries on grafana dashboard using event-listener and fluent-bit

I have a presto instance running on a namespace and it has a custom plugin and event-listener configured that gets all the logs and forwards them to 24224 port. I can see the logs if they are written as log.info("any string here") but…
jarvo69
  • 7,908
  • 2
  • 18
  • 28
2
votes
1 answer

Does Rancher 2.5+ logging support Grafana Loki?

I'm trying to setup logging using the new rancher 2.5 logging system, that's using the Banzai operator. I was thinking to use the Banzai Operator for ingestion and push to a Grafana Loki output. The problem is that I'm getting some "entry out of…
Lucian
  • 41
  • 5
2
votes
1 answer

Fluent-bit - Parse kubernetes JSON log message into structured fields

I have a basic fluent-bit configuration that outputs Kubernetes logs to New Relic. The log message format is just horrible and I couldn't really find a proper way to parse them, they look like…
Zhulian Ginev
  • 141
  • 3
  • 14
2
votes
1 answer

Fluent-Bit sending kubernetes logs to AWS Cloudwatch. How to change log stream prefix based on kubernetes namespace?

I'm using Fluent-Bit to ship kubernetes container logs into cloudwatch. This config is working fine. Instead of output-elasticsearch.conf I have following: output-cloudwatch.conf: | [OUTPUT] Name cloudwatch_logs …
Shinebayar G
  • 4,624
  • 4
  • 18
  • 29
2
votes
0 answers

FLUENT-BIT: [io_tls] flb_io_tls.c:359 X509 - Certificate verification failed, e.g. CRL, CA or signature check

I am trying to push the logs from MacBook pro to s3 using fluent-bit, but getting the following error. [2020/12/01 03:17:00] [error] [io_tls] flb_io_tls.c:359 X509 - Certificate verification failed, e.g. CRL, CA or signature check [2020/12/01…
Rajan
  • 392
  • 2
  • 5
2
votes
3 answers

Add Sidecar container to running pod(s)

I have helm deployment scripts for a vendor application which we are operating. For logging solution, I need to add a sidecar container for fluentbit to push the logs to aggregated log server (splunk in this case). Now to define this sidecar…
Obaid Maroof
  • 1,523
  • 2
  • 19
  • 40
1 2 3
…
25 26