0

How can I view the custom counters defined in my dataflow job to the stackdriver monitoring.

As the google documents says the any custom counters defines in the dataflow will be reported as the custom metrics in the stackdriver.

But I cant see any custom metrics in the Stackdriver Metrics Explorer page when I am filtering it in the "Find resource type and metric" box.

Thanks,

ganesh_patil
  • 356
  • 3
  • 18
  • Which version of the SDK are you using? How did you define your custom counters? Have you looked at [this page](https://cloud.google.com/dataflow/pipelines/stackdriver-monitoring)? – Ben Chambers May 16 '17 at 16:01
  • I am using dataflow sdk 1.9, I defined the custom counter using Aggregator in DoFn, and I also gone through that page, in dataflow UI I can see the Custom counter, but not in the stackdriver. – ganesh_patil May 17 '17 at 03:18
  • Could you share the job ID for which you expected the aggregator to show up in Stackdriver? – Ben Chambers May 17 '17 at 16:22
  • 2017-05-18_01_55_40-1851465512781927465 – ganesh_patil May 18 '17 at 12:49
  • 2
    In order for Dataflow to report or for you to consume custom metrics through Stackdriver, the project needs to have Stackdriver Premium enabled. Is the project used to execute the job configured for Stackdriver Premium? – Andrea May 18 '17 at 23:34
  • No, we are using Basic tire, I get it now , thank you for your suggestion... – ganesh_patil May 19 '17 at 09:04

0 Answers0