Questions tagged [prometheus-pushgateway]

Pushgateway is part of the official prometheus ecosystem. You don't need to include the tag prometheus unless the question relates to metrics collection. Please, check the official documentation of PushGateway before asking a question.

New to Prometheus ecosystem?

Pushgateway is part of the official ecosystem. It is a metric cache written in Go. Metrics are pushed, updated and deleted through an API. It is not a replacement for push based monitoring like statd. But rather, as explained on GitHub, a proxy to make batch job appear as if they were still running, giving time to Prometheus, which is pull based monitoring, to come and collect the resulting metrics.

Tag usage

When posting questions about Prometheus PushGateway, remember there are three main aspects:

  • the API side to metrics lifetime management
  • the Prometheus collection an exploitation
  • the PushGateway exploitation and design decision

If it is about metrics collection and exploitation, include the tag as well.

For the API side, specif the system you are using for accessing the API and give curl equivalent of the operations you question relates to.

For the exploitation and design decision, please first check the documentation which details the use cases and intent of PushGateway.

70 questions
2
votes
1 answer
2
votes
2 answers

Push metrics to Prometheus Pushgateway in Spring Boot

I would like to push metrics, e.g. processing time of an HTTP request or current heap size, to Prometheus through a Pushgateway in a Spring Boot application. I'm struggling because there are many documents, either from Spring Metrics or Prometheus…
user3105453
  • 1,881
  • 5
  • 32
  • 55
1
vote
1 answer

Why Multiple PushGateway may cause some problems, such as data inconsistency?

I have read an article about multiple pushgateway instances may cause data confusion. But I don't understand how it happen. "When the same indicator data is pushed from different Pushgateway instances, there may be a time stamp synchronization issue…
esther lee
  • 33
  • 4
1
vote
1 answer

PromQL, Grafana - Count how many times metric's labels values has changed

I'm trying to count how many times Metric_x changed it's labels. In Prometheus I have 4 metrics: Metric_1, Metric_2, Metric_3, Metric_4. If I use the query {__name__=~"Metric_\d"}, I get the following output: In…
Tikito
  • 13
  • 4
1
vote
2 answers

Stop sending Spring boot metrics to Prometheus with Micrometer

I have a Spring boot application where I am sending custom metrics generated within the service to Prometheus via Pushgateway. I am using Prometheus Pushgateway with Micrometer, mainly based on this tutorial:…
1
vote
1 answer

Micrometer with Prometheus Pushgateway not sending the recent metrics

I have a Spring boot application based on CommandLineRunner, when it starts it does some calculations, sends the metrics to Prometheus and shuts down. I am using Prometheus Push Gateway with Micrometer, mainly based on this…
adesai
  • 370
  • 3
  • 22
1
vote
0 answers

Metrics from spring batch are not pushed to prometheus push gateway

I followed the approaches mentioned in this post. Basically I have my local prometheus and push gateway setup using docker from spring batch examples. I have the below dependencies added in my build.gradle which means PrometheusPushGatewayManager…
1
vote
1 answer

How to convert docker stats metrics to the Prometheus supported metrics type?

I'm trying to implement a docker monitoring solution in my organization, which will be used for internal monitoring. The problem is the box which is used, does not allow any http port to be exposed due to security reasons and also does not allow to…
1
vote
0 answers

How to store measurements scraped from Pushgateway in Prometheus db?

please advise I am using Pushgateway to monitor custom service. As far as I understand, all the metric measurement we send, are stored by the Pushgateway in its own internal DB and is then exposed to Prometheus. If this is true, I have the following…
1
vote
1 answer

How to see the hostname of the instance that has generated the data for Pushgateway

I have prometheus server that is using self discovery for Azure VMs which are running WMI exporter. In Grafana I am using dashboard variables for filtering (see screenshot). On the VMs I have created a custom exporter that outputs the metric with…
1
vote
1 answer

Use Flink Prometheous PushGateway Repoter but happened OOM

The FLink version is 1.12, I follow the step(https://ci.apache.org/projects/flink/flink-docs-release-1.12/deployment/metric_reporters.html#prometheuspushgateway-orgapacheflinkmetricsprometheusprometheuspushgatewayreporter), fill my config, run my…
1
vote
0 answers

Push aggregated metrics to the Prometheus Pushgateway from clustered Node JS

I've ran my node apps in a cluster with Prometheus client implemented. And I've mutated the metrics (for testing purpose) so I've got these result: # HELP otp_generator_generate_failures A counter counts the number of generate OTP fails. # TYPE…
1
vote
1 answer

Pushing metrics to Prometheus Pushgateway fails frequently

I am using the Prometheus Client library to push metrics to pushgateway. Frequently I am getting below error while pushing the metrics. How can I find the root cause of this issue? push_to_gateway( File…
Sirish
  • 9,183
  • 22
  • 72
  • 107
1
vote
1 answer

Prometheus alerts based on non-periodic metrics from batch jobs

I have a CronJob which runs every 20 minutes and collects only active builds on Jenkins multibranch jobs whose build duration has exceeded certain value and publishes these metrics with build duration as value to Prometheus Pushgateway. So this…
Sirish
  • 9,183
  • 22
  • 72
  • 107
1
vote
1 answer

Multiple instances send the same prometheus metric to pushgateway

My task is ran on multiple machines, and for each machine, I set up the same metric as following: myCounter = Counter .build() .name("my_counter") .help("Dummy counter") …
Xitrum
  • 7,765
  • 26
  • 90
  • 126