Questions tagged [grafana-loki]

Like Prometheus, but for logs.

Loki is a horizontally-scalable, highly-available, multi-tenant log aggregation system inspired by Prometheus

https://github.com/grafana/loki

521 questions
3
votes
1 answer

Taking backup of grafana

I am new with grafana and trying to take it's backup. I found that it can be done by just storing the grafana.db file. I tried to use it in another grafana instance and it worked perfectly and showed me all the dashboards. Is this the correct way of…
Nitz
  • 31
  • 1
3
votes
0 answers

Configure Loki log-based alerts with kubernetes CRD

I like the idea of Prometheus Operator where alerting configurations are deployable kubernetes objects defined with CRDs. apiVersion: monitoring.coreos.com/v1 kind: PrometheusRule metadata: labels: prometheus: example role: alert-rules …
pizycki
  • 1,249
  • 4
  • 14
  • 26
3
votes
3 answers

extract single label as column in log panel

I've just started exploring Loki to aggregate my logs and I'm assuming I've missed something obvious. I have a bunch of machines/vms/containers with promtail forwarding systemd's journal to a single loki server (just the default example config) and…
Richard Huxton
  • 21,516
  • 3
  • 39
  • 51
3
votes
0 answers

Promtail to parse all available objects in nested JSON array for Grafana Loki

Using Loki and Promtail and I have some JSON which I am looking to parse with a pipeline stage. I have defined expressions and created a new JSON stage for every nested object/array, however the logs that I am parsing do not have a definite number…
snorkrat
  • 41
  • 4
3
votes
0 answers

Loki LogQL corellate maillogs

please assist me on parsing mail logs using Loki & Grafana :) My logging server collects maillog files from Linux server, and I want to use Loki to check status (sent, deferred, etc) of messages from specific user. The problem is that mail logs are…
Dmitri
  • 111
  • 1
  • 7
3
votes
2 answers

Loki Ruler not sending alerts to alert Manager

I have loki + grafana + prometheus running in EKS using official helm charts. I want to send alerts based on error log messages and for that i'm trying to use the loki ruler. following is the ruler config ruler: storage: type: local local: …
Mujahid
  • 114
  • 1
  • 3
  • 14
3
votes
1 answer

Drop logs from promtail

I have prometheus + loki + grafana + promtail setup. I need to drop the logs which have the words healthcheck or health-check. My values.yaml file: https://github.com/grafana/helm-charts/blob/main/charts/promtail/values.yaml Please help me how can I…
3
votes
0 answers

Grafana-loki not showing labels of all the deployments

I somehow broke my Grafana+loki+promtail setup and was not able to fix it. In grafana, I am seeing only two values in app labels. It supposes to show 21 values(it was working fine some days back) I also checked the promtail as well I see all the…
gamechanger17
  • 4,025
  • 6
  • 22
  • 38
3
votes
1 answer

Injected traces data into Logs is not showing on Loki-Grafana

SETUP: i'm using the python-logging-loki library to manually instrument my code for logs. I have a single running instance of Loki (promtail not used, i'm pushing directly to loki). On Grafana i have Jaeger and Loki up and running as data sources.…
3
votes
4 answers

Helm Grafana/Loki chart installation error. Rendered manifests contain a resource that already exists

I need to install Grafana Loki with Prometheus in my Kubernetes cluster. So I followed the below to install them. It basically uses Helm to install it. Below is the command which I executed to install it. helm upgrade --install loki…
Container-Man
  • 434
  • 1
  • 6
  • 17
3
votes
0 answers

Use Persistent Volume with loki installed with helm

Do you know how to use the AWS EBS volume prepared in advance as the Persistent Volume of the pod when installing loki with helm? Should I create a PersistentVolume like the one below and specify the required parameters in persistence: at…
3
votes
2 answers

Remove a part of a log in Loki

I have installed Grafana, Loki, Promtail and Prometheus with the grafana/loki-stack. I also have Nginx set up with the Nginx helm chart. Promtail is ingesting logs fine into Loki, but I want to customise the way my logs look. Specifically I want to…
eikooc
  • 2,363
  • 28
  • 37
3
votes
1 answer

Correct way to parse docker JSON logs in promtail

I've created some monitoring with grafana, loki and promtail. The container i'm getting the logs from outputs them in JSON format…
Inbell1s
  • 31
  • 2
3
votes
0 answers

Advanced Loki searches from inside json map/list

I have a WAF log like { "terminatingRuleId": "Default_Action", "action": "ALLOW", "nonTerminatingMatchingRules": [{ "ruleId": "AWS-AWSManagedRulesSQLiRuleSet", "action": "COUNT", "ruleMatchDetails": [{ …
Mike
  • 7,769
  • 13
  • 57
  • 81
3
votes
2 answers

How to reduce the amount of chunks to prevent running out of disk space for Loki/Promtail?

I'm currently evaluating Loki and facing issues with running out of disk space due to the amount of chunks. My instance is running in Docker containers using a docker-compose setup (Loki, Promtail, Grafana) from the official documentation (see…
Selwyn Rogers
  • 101
  • 2
  • 5