I am trying to understand the metrics emited by argo workflow but their explination isn't helping enough:
For example argo_workflows_pods_count
It is possible for a workflow to start, but no pods be running (e.g. cluster is too busy to run them). This metric sheds light on actual work being done.
Does it mean the count of all the running pods for all the workflows (if this is the case, then, at least for me, doesn't seem correct) from all the namespaces?
There is a difference between this metric and kubernetes_state.pod.*
metrics (which would give me the pods with different states, eg: running)?