Questions tagged [kube-prometheus-stack]

78 questions
0
votes
1 answer

Changing timezone of alertmanager in kube-prometheus-stack helm chart

I am currently using emailing alerts for our application. One of the contents of the email is the start and end time of the alert but they are displaying as UTC+0000. Tried using .Start.Local.Format but realized that the only time that alertmanager…
0
votes
0 answers

Prometheus-node-exporter alert rule for new node

I have kube-prometheus stack setup in my cluster. I need a rule that alerts me whenever a new node is created. My cluster is in AWS EKS and a monitoring stack setup with these components, Alertmanager, prometheus, prometheus-operator, node-exporter,…
0
votes
1 answer

Remove Grafana and Alertmanager while installing kube-prometheus-stack

I want to install the kube-prometheus-stack (https://github.com/prometheus-operator/kube-prometheus) but exclude Grafana and Alertmanager from the helm install as I am installing them separately. I would like to install only the following…
0
votes
0 answers

AlertmanagerConfig receivers always use continue: true

I'm using the next config: apiVersion: monitoring.coreos.com/v1alpha1 kind: AlertmanagerConfig metadata: name: slack-alertmanager labels: alertmanagerConfig: slack namespace: default spec: route: continue: false groupBy:…
Roman
  • 359
  • 4
  • 7
0
votes
1 answer

Helm kube-prometheus-stack stuck in pending-install

Problem: For some reason, helm release of kube-prometheus-stack is stuck in Pending-install status. What is the correct to install a helm release for this using helm cli? Details: Due to Docker registry k8s.gcr.io getting frozen, I had to update the…
0
votes
0 answers

Failed pre-install: job failed: BackoffLimitExceeded when install prometheus helm chart

I am trying to install prometheus helm chart with default configuration in values.yaml helm install prometheus prometheus-community/kube-prometheus-stack I face error "Error: INSTALLATION FAILED: failed pre-install: timed out waiting for the…
0
votes
0 answers

Custom Labels to Service Monitor Scraped Metrics

I have a setup similar to https://fabianlee.org/2022/07/07/prometheus-monitoring-a-custom-service-using-servicemonitor-and-prometheusrule/ that uses kube-prometheus-stack with service monitor to scrape the actuator prometheus end point. I would want…
user3221430
  • 71
  • 1
  • 6
0
votes
0 answers

Migrate prometheus values to kube-prometheus-stack

I used to use prometheus-community/prometheus. Now I want to try prometheus-community/kube-prometheus-stack. I used to have this value override serverFiles: alerting_rules.yml: groups: - name: node rules: - alert:…
user3908406
  • 1,416
  • 1
  • 18
  • 32
0
votes
0 answers

Unable to see scrape_configs job in prometheus targets kube-promtetheus-stack

I created a configmap target-json-cm. Below is my prometheus values.yaml configuration: prometheusSpec: configMaps: ['target-cm'] scrape_configs: - job_name: 'node' file_sd_configs: - files: -…
0
votes
0 answers

oauth2: cannot fetch token: 400 Bad Request Response: in Prometheus targets, while federating metrics

I am trying to use oauth2 in the kube-prom-stack for the authetication for metrics federate from a https node. Below is my configuration: `additionalScrapeConfigs: - job_name: 'test-federation' scrape_interval: 20s …
0
votes
1 answer

Using variables in PrometheusRule expr field instead of contant values

I am trying to create a 'PrometheusRule' inside my cluster with some alert rules using promql expressions. However, I want these resources to be used and configurable for different services inside my same cluster. All I want to do is have Variable…
0
votes
0 answers

I want to configure the Prometheus using kube-prom-stack to federate metrics from https server

I have kube-prom-stack runnning on a node and i have configure it using federate endpoint to scrape metrics from a remote server as below in my values.yaml file: additionalScrapeConfigs: - job_name: 'sp-federation' …
0
votes
0 answers

prometheusSpec retentionSize parameter doesn't work for Prometheus

I am using prometheus from kube prom stack. Version of Prometheus is 2.36. I have configured the values.yaml file for prometheus and also after the deployment, i can observe the cofiguration of retention size and scrape interval etc as…
0
votes
0 answers

Override Prometheus values in Kube Prometheus Stack

I want to override default values of Prometheus in Kube Prometheus Stack. I put values under helm values in argocd application but it has not been deployed. Can I override it this way? I mean I want to put a scrape endpoint in this values. It works…
Danny88
  • 1
  • 1
0
votes
0 answers

Prometheus/Alertmanager - many alerts firing - Why?

I have a 4 node K8s cluster set up via kubeadm on a local VM cluster. I am using the following: Kubernetes 1.24 Helm 3.10.0 kube-prometheus-stack Helm chart 41.7.4 (app version 0.60.1) When I go into either Prometheus or Alertmanager, there are…