2

I have enabled the logging API by below command :

gcloud services enable logging

I have followed the steps: https://cloud.google.com/dataflow/docs/quickstarts/create-pipeline-java to create the pipeline.

I am using slf4j logger lib for logging the jobs. still, no logs are visible in GCP dataflow console.

enter image description here

Siddhanta Rath
  • 976
  • 3
  • 21
  • 37

2 Answers2

2

Creating a new sink in Logs Router with an inclusion filter of resource.type="dataflow_step" solved the issue as dataflow logs are excluded in the default sink present at the log router under logging.

Siddhanta Rath
  • 976
  • 3
  • 21
  • 37
0

Are you using a service account? Besides enabling the Logging service, you may not have permission to write the the logs.

If that is the case, please double-check if you are following all the instructions from Security and permissions for pipelines on Google Cloud.

Bruno Volpato
  • 1,382
  • 10
  • 18