Stack Overflow
Stack Overflow

Questions tagged [promtail]

Promtail is an agent which ships the contents of local logs to a private Grafana Loki instance or Grafana Cloud. Use with grafana-loki tag.

See documentation

145 questions
0
votes
1 answer

Loki not sending alerts to alertmanager

Trying to setup a Promtail-Loki-Alertmanager log pipeline but Loki is not sending any alerts to AM. Each of those services are running in Docker containers. Versions: Promtail: 2.8.2 Loki: 2.8.2 Alertmanager: 0.25.0 My line in test log file…
NIGHTSCROLLER
  • 89
  • 1
  • 5
0
votes
0 answers

Promtail: error writing positions.yaml (too many open files)

I’m trying to collect almost 3GB of log files everyday with promtail. Promtail runs fine until some hours and starts to throw the error such as: Jul 07 14:54:53 ip-127.0.0.1 promtail-linux-arm64[74099]: level=error ts=2023-07-07T14:54:53.188346106Z…
ranjith
  • 1
0
votes
0 answers

How to make a pie chart with all the different log codes in Grafana

I have logs with all kind of different codes (there could be more codes added in the future). I want a pie chart that shows the percentage of the number of times each code appears in the logs. For example: If I have four times the code "01" and six…
Etienne
  • 1
  • 2
0
votes
0 answers

How to remove deleted log lines in Loki Grafana

I have a Promtail instance that reads log files and sends them to a Loki instance. When a new log line is generated, Promtail sends it to Loki, and it appears as a new log line in my Grafana dashboard, which is great. However, if my application that…
Etienne
  • 1
  • 2
0
votes
0 answers

loki Grafana - promtail install error - page not founded

Hi everyone! I'm trying to install loki grafana, but get the next error: Page http://localhost:3100/metrics is work. Page http://localhost:3100/loki/api/v1/push is not work (page not founded) promtail-config: \`server: http_listen_port:…
Lancy
  • 1
0
votes
0 answers

How to use the timestamp from the systemd-journal with promtail / loki instead of the generated one?

I use promtail to scrape my systemd journal and sent it to a Grafana Loki server. My problem is, that on busy systems the timestamp is quiet a bit off (between the timestamp shown in the journal on the host and the timestamp shown in…
Brutus
  • 7,139
  • 7
  • 36
  • 41
0
votes
0 answers

Kubernetes: AWS EKS: HELM: Promtail Grafana Loki Stack: Storage Optimization

For our Test infrastructure in AWS EKS (1.26), I am configuring Promtail Loki and Grafana Stack using Helm Charts where I am finding some difficulties storing logs and need help with retention. Requirements: Storage Type: Gp2 Max allowable storage:…
Arani
  • 33
  • 4
0
votes
0 answers

Please review my Promtail configuration file

Please review my Promtail configuration file. I am unclear on the purpose of positions.yaml and how the client URL http://localhost:3100/loki/api/v1/push works. Additionally, what is the significance of the path /loki/api/v1/push in the client…
Rudresh
  • 1
0
votes
0 answers

Reorder log timestamp order to meet Promtail timestamp

I am using Promtail to send in text file based logs to Loki. The timestamp I have are in MM/DD/YYYY HH:MM:SS:SSSSSS format. My log looks something like: 11/15/2022 21:28:53:947780 -I- Lets now start logging I am now trying to convert this timestamp…
Kermit the Frog
  • 146
  • 2
  • 7
0
votes
0 answers

Promtail template to change regex detection group to required value

I am writing Promtail syslog receiver of (Pfsense)Openvpn logs and normalize them into lables the log line example as follows below including my Promtail config, i managed to get most of my desired data into labels, but i would like to set label as…
tbaror
  • 43
  • 2
  • 11
0
votes
0 answers

Labels in file_sd_config - promtail

How to assing label form path for scrape_configs when using file_sd_config? In file_sd_config file I have paths like this: /opt/app/node01/server1/out.log /opt/app/node02/server2/out.log /opt/app/node03/server3/out.log and I would like to have…
mila002
  • 327
  • 3
  • 14
0
votes
0 answers

Promtail/Grafana: Can not have at the same time labels and timestamp

I'm working on Promtail configuration in order to retrieve some information from logs through Loki on Grafana. Each line contains the timestamp at the beginning, and after the cpu usage. The regex allows to get both. I can set properly the timestamp…
Pierre
  • 490
  • 1
  • 7
  • 26
0
votes
0 answers

Custom pipeline stages not getting picked up (applied) by the Promtail agent

Promtail deployed on a local minikube cluster via helm chart not applying custom pipeline stages defined in the config section of the values.yaml file. I have a simple loki stack setup (loki + promtail + grafana) for monitoring deployed on a local…
Dimitar Penev
  • 1
  • 1
0
votes
1 answer

Setting up multiple logs with Promtail and Loki, why can I only see 2 jobs in dashboard out of 11 configured?

I recently setup my log monitoring instance and from my setup, about 11/12 log locations were selected, but when I check my Loki dashboard, I can only see 2 jobs and few directories listed compared to what I configured. Here is my Promtail config…
Damola
  • 1
  • 2
0
votes
0 answers

When storing AWS load balancer logs in S3, how do I pass the S3 prefix to Loki when using lambda-promtail?

I am ingesting application load balancer logs into Loki using lambda-promtail. This works great, however, the default labels only include the account and load balancer ID. I would like to use the S3 prefix as a label to use as variable in Grafana (I…
mp13
  • 23
  • 3
1 2 3
…
9 10