Questions tagged [kube-prometheus-stack]

78 questions
1
vote
2 answers

Installing a custom grafana datasource through helm / terraform

I would like to install the alertmanager datasource (https://grafana.com/grafana/plugins/camptocamp-prometheus-alertmanager-datasource/) to my kube-prometheus-stack installation which is being built using terraform and the helm provider. I cannot…
1
vote
3 answers

Helm / kube-prometheus-stack: Can I create rules for exporters in values.yaml?

I want to be able to specify all my rules for, say prometheus-blackbox-exporter so have added this to a rules-mine.yaml and deployed with helm upgrade --install -n monitoring blackbox -f values.yaml -f rules-mine.yaml . I cannot see any rules…
1
vote
1 answer

coalesce.go:200: warning: cannot overwrite table with non table for notifiers (map[])

In grafana charts I try to add notifiers and getting the error. The notifiers conf is below: notifiers: {} - name: email-notifier type: email uid: email1 # either: org_id: 1 # or org_name: Main Org. …
Eljah
  • 4,188
  • 4
  • 41
  • 85
1
vote
1 answer

How to add Grafana's provisioned notification channel in kube-prometheus-stack?

I'm looking for example, how to set up the provisioned notification channel and it's uid in the helm chart https://github.com/prometheus-operator/kube-prometheus The dashboards are referencing the notification channel, but what is the sample yaml to…
Eljah
  • 4,188
  • 4
  • 41
  • 85
0
votes
1 answer

How to disable the k8s scrape pool for some containers (Prometheus Operator)

I'm using the kube-prometheus-stack which uses the prometheus-operator and I am seeing a lot of logging messages because prometheus is trying to access the /metrics endpoint of my application, which is not allowed (because not existing). When I open…
0
votes
0 answers

kube-prometheus-stack PersistentVolumeClaim with Helm

I've installed kube-prometheus-stack with Helm. Everything works out of the box. Now, how do I specify volumes/pvc for my Prometheus and Grafana instances using Helm values? I followed the documentation and none of the procedures described there…
0
votes
1 answer

AlertManagerConfig and PrometheusRule does not work for targets that are not in the monitoring namespace

I have an existing CronJob for which I have setup alerts. The alerts are working when the CronJob is scheduled in the 'monitoring' namespace. I am using Kube-Prometheus stack and it is also deployed in the 'monitoring' namespace. When I schedule the…
0
votes
0 answers

Prometheus remote write drop entire job

Anyone had success dropping entire job from remoteWrite ? Tried with the following config but does not seems to work. remoteWrite: - url: >- https://xxxxxxxxxxxxxxxxxxxxx.com writeRelabelConfigs: - action: drop …
Jonathan Chevalier
  • 993
  • 1
  • 9
  • 18
0
votes
0 answers

how to get an automatic name tag for persistent volume when it is bound to an EKS pod

I have an existing prometheus-stack running with dynamic pv allocated. it has got the ebs volume with name tag as "kubernetes-dynamic-pv-23234324" in the aws ui under volumes, but when i did the same changes of adding volumeclaim with same storage…
0
votes
1 answer

AlertmanagerConfig not sending alerts to email receiver

I have a deployment of a pod that continuously goes into CrashLoopBackoff state. I have setup an alert forthis event but the alert is not firing on the configured receiver. The alert is only firing on the default AlertManager receiver that is…
Golide
  • 835
  • 3
  • 13
  • 36
0
votes
1 answer

How do I verify a configuration change on a bitnami/kube-prometheus deployment?

I have an existing deploy of bitnami/kube-prometheus deployed via : helm upgrade --install prometheus -n monitoring -f .\input\prom-values.yaml bitnami/kube-prometheus I have made some changes to prom-values.yaml and did a corresponding 'helm…
0
votes
0 answers

Unable to reduce the checkpointing time by "storage.tsdb.max-block-duration

I am using the "prometheus-community/kube-prometheus-stack" --version 47.1.0 I am getting OOM so I wish to reduce the memory footprint by triggering the checkpointing early. In order to do so, I passed the following in…
0
votes
0 answers

Grafana access not working in Kube Prometheus Stack 46.4.1

I'm trying to access grafana but I'm not able to access with admin/my_password, where my_password is the value set in my custom_values.yaml file. I get username/password doesn't exist error. I can confirm the password value has been set with…
0
votes
0 answers

Alert manager add custom notification template

I am using Alertmanager for Prometheus, installed through the Helm kube-prometheus-stack. I wish to add a new notification template. For code clarity reason, I am trying to isolate the template on its own file. Doc leads me to do it through a…
0
votes
0 answers

whenever I upgrade my helm chart all my previous configrations are lost

I have deployed Prometheus and Grafana with the help of Helm using kube-Prometheus-stack on the Kubernetes cluster to monitor the Kubernetes cluster. After installing kube-prometheus-stack to the grafana dashboard and some configuration files, I…