0

I tried various metrics options using glue.driver.* but there is no clear way to get Job name, job Status, Start time, End time and Elapsed time in Cloudwatch metrics. This info is already available under Job Runs history but no way to get this on Metrics.

I found few solutions where this can be achieved using Lambda function but there should be an easy way.

Please share ideas. thanks.

Sam
  • 392
  • 1
  • 6
  • 18

1 Answers1

0

We had the same issue. In order to track glue job runs we ended up writing a small shell script which transformed the JSON Output of -> https://docs.aws.amazon.com/cli/latest/reference/glue/list-jobs.html to CSV. The final Output resembled the following :

enter image description here

Satheesh V
  • 96
  • 7
  • that's an awesome idea, I will check on how can I push this to metric as I want to create a graph showing Job name, job Status, Start time, End time and Elapsed time – Sam Sep 06 '22 at 20:59
  • @Sam, please upvote if you were able to implement the above workaround – Satheesh V Dec 05 '22 at 10:42