My goal is creating a mechanism that when a new file is uploaded into the Cloud Storage, it'll trigger a Cloud Function. Eventually, this Cloud function will trigger a Cloud Dataflow job. I have a restriction that the Cloud Dataflow job should be written in Python, and the Cloud Function also should be in Python. he problem I have been facing right now is, I cannot call Cloud Dataflow job from a Cloud Function.
Asked
Active
Viewed 999 times
1 Answers
4
Yes you can! Start by packaging your Dataflow Job in a template. There is some update to perform for reading the input values. This change only the job header/configuration, not the "real" processing
Then, trigger your template with API Rest. There is no python library for that, but there is a answer here with code example
guillaume blaquiere
- 66,369
- 2
- 47
- 76