Questions tagged [google-workflows]

Cloud Workflows is a Google Cloud Platform providing orchestration and automation of Google Cloud and HTTP-based API services with serverless workflows.

Cloud Workflows is a service that lets you build multiple steps workflows either chaining internal Google Cloud APIs or external HTTP-based API services.

Official sites:

113 questions
6
votes
1 answer

Is there a way to run GCP workflows locally?

Recently I started working with GCP workflows, and functions. We are using serverless framework for the functions and we can run them in our on computers with the command serverless invoke local --function so we don't have to spend…
5
votes
3 answers

How to retrieve the URL of a Cloud Run service with Google Workflow?

I am used to using CI / CD architecture for my deployments on Cloud Run. Each time a deployment has taken place, I have to manually retrieve the URL that I send to my employees by email. My goal is to automate this task with Google Workflow. How do…
Ezekias BOKOVE
  • 148
  • 1
  • 7
4
votes
1 answer

Cloud Functions returns 403 error also with Cloud Functions Invoker permissions

Within GCP: I created a function in Google Cloud Functions. I want to invoke that function from Google Workflows. I added a service account with "Cloud Functions Invoker" permissions. I created a workflow in Google Workflows, it uses the service…
3
votes
3 answers

Google Cloud Workflow: Reach Private VPC

Is it possible for the Google Cloud Workflow to reach the Private VPC (perhaps via a serverless VPC connector)? I can't find anything about it in the documentation. We want to use Workflow to trigger certain things via API on the internal network…
Niklas B
  • 1,839
  • 18
  • 36
3
votes
1 answer

Issue while inserting Data in Firestore using cloud workflows firestore connector with Json object coming from previous step which is a cloud function

I am trying to build a workflow where in step1 I am running a cloud function which returns a Json Object in the form of python dictionary and I want the same to be inserted in Firestore using firestore connector. But I am getting the below error: …
3
votes
1 answer

Whats the maximum timeout on GCP Workflows?

I am trying to invoke cloud run endpoint using GCP Workflows. Even though cloud run has a maximum timeout of 1 hour, workflows is giving me error like Request timeout was 2500s, max allowed timeout is 1800s Is this specific to workflows? Couldn't…
Bagio
  • 45
  • 2
  • 4
3
votes
1 answer

How to get execution ID in workflow

When executing a workflow there is a unique Execution ID. Is it possible to access this value from within the workflow. For example, if I was to use the Execution ID as the filename in a step: url:…
Ed Kong
  • 59
  • 3
3
votes
2 answers

how do you start a workflow from another workflow and retrieve the return value of called workflow

I am testing google workflow and would like to call a workflow from another workflow but as a separate process (not a subworkflow) I am able to start the execution but currently unable to retrieve the return value. I receive instead an instance of…
Pascal DeMilly
  • 681
  • 1
  • 6
  • 16
3
votes
1 answer

pass arguments to Cloud Workflows using Python

I am developing a python script allowing me to trigger a cloud workflow service. In the script, I pass some arguments when I call the projects/{project}/locations/{location}/workflows/{workflow}/executions endpoint. But I do not find how to use…
Pentium10
  • 204,586
  • 122
  • 423
  • 502
2
votes
1 answer

Is there any provision to execute GCP workflow template from point of failure?

I have multiple pig jobs in a GCP workflow template with dependencies as below: export env=dev export REGION=us-east4 gcloud dataproc workflow-templates create test1 --region=$REGION gcloud dataproc workflow-templates set-cluster-selector test1…
2
votes
1 answer

Trouble authenticating a request to a Google Workflows callback from a Cloud Function

I have a data pipeline set up with Google Workflows where I have a step to wait for a Cloud Function that is triggered from Pub/Sub to complete by using the callback mechanism documented here. The Workflow and Cloud Function are both deployed with…
2
votes
0 answers

Can Cloud workflows generate trace context to be used in its steps?

I have a Cloud Run service which needs to run for more than the maximum timeout of 3600 seconds, so I'm setting up a Cloud Workflows workflow that can run it several times until it's complete. But this makes it harder to connect the logs because…
danmichaelo
  • 1,706
  • 1
  • 25
  • 30
2
votes
0 answers

How to execute workflow from gcp cloud tasks

Im trying to execute a workflow from cloud tasks but getting immediately 401 error. Here is the code to enqueue the task: req := &taskspb.CreateTaskRequest{ Parent: fmt.Sprintf("projects/%v/locations/us-central1/queues/myqueue", projectID), …
2
votes
1 answer

Creating Timestamp in Google Workflow YAML

Trying to create a file output with date extension yyy-mm-dd etc. Cloud workflow does not have the date format functions of bigquery. Closet I could get is ${time.format(sys.now())}, but that provides a timestamp. Any way to parse to required…
RaptorX
  • 113
  • 10
2
votes
1 answer

Authenticate to Container Registry when launching container on GCE via cloud workflows and compute engine API

I am trying to follow for the most part this guide to deploy a Google Workflow to launch a container optimized VM on compute engine, run a long running task, and then clean up the VM. I am also using the GCP docs in Creating a Workflow with…
1
2 3 4 5 6 7 8