How can I drop a specific label in a specific Prometheus ServiceMonitor metric using relabeling/metricRelabeling?

Question

For example, I have teo metrics with different label

node_metrics_first{foo="bar",AAA="aaa"}
node_metrics_second{BBB="bbb",CCC="ccc"}

how can I use relabeling/metricRelabeling drop/labeldrop in servicemonitor to remove foo label in node_metrics_first, which means I should get the result:

node_metrics_first{AAA="aaa"}
node_metrics_second{BBB="bbb",CCC="ccc"}

score 0 · Answer 1 · answered May 08 '23 at 05:07

In Prometheus operator ServiceMonitors, you can use spec.endpoints[*].relabelings to alter labels and metrics:

apiVersion: monitoring.coreos.com/v1
kind: ServiceMonitor
spec:
  endpoints:
  - interval: 30s
    port: metrics
    scheme: http
    relabelings:   <-- here you shine!
    - action: labeldrop
      regex: (foo|otherlabeltodrop)

score -1 · Answer 2 · answered Oct 05 '22 at 06:36

-1

There is an extensive blog from Grafana about how the relabeling works. In your case:

  - job_name: some_job
    metric_relabel_configs:
      - regex: "foo"
        action: labeldrop

answered Oct 05 '22 at 06:36

Rick Rackow

1,490
8
19

The question is about ServiceMonitors not the usual Prometheus configuration. – Aref Riant May 08 '23 at 04:48
1

Same thing. Servicemonitors only give you an abstraction to configure prometheus including relabelings – Rick Rackow May 08 '23 at 06:48

How can I drop a specific label in a specific Prometheus ServiceMonitor metric using relabeling/metricRelabeling?

2 Answers2