Schedule batch predictions Vertex AI

Question

I have created a forecasting model using AutoML on Vertex AI. I want to use this model to make batch predictions every week. Is there a way to schedule this?

The data to make those predictions is stored in a bigquery table, which is updated every week.

score 2 · Answer 1 · answered Oct 04 '21 at 04:14

There is no automatic scheduling directly in Vertex AutoML yet but many different ways to set this up in GCP.

Two options to try first using the client libraries available for BigQuery and Vertex:

Cloud Scheduler to use cron https://cloud.google.com/scheduler/docs/quickstart
use either Cloud Functions or Cloud Run to setup a BigQuery event trigger, and then trigger the AutoML batch prediction. Example to repurpose https://cloud.google.com/blog/topics/developers-practitioners/how-trigger-cloud-run-actions-bigquery-events

score 1 · Answer 2 · answered Oct 21 '21 at 00:50

Not sure if you're using Vertex pipelines to run the prediction job but if you are there's a method to schedule your pipeline execution listed here.

from kfp.v2.google.client import AIPlatformClient  # noqa: F811

api_client = AIPlatformClient(project_id=PROJECT_ID, region=REGION)

# adjust time zone and cron schedule as necessary
response = api_client.create_schedule_from_job_spec(
    job_spec_path="intro_pipeline.json",
    schedule="2 * * * *",
    time_zone="America/Los_Angeles",  # change this as necessary
    parameter_values={"text": "Hello world!"},
    # pipeline_root=PIPELINE_ROOT  # this argument is necessary if you did not specify PIPELINE_ROOT as part of the pipeline definition.
)

Thanks Manu! Unfortunately, this is not possible for forecasting models, but it seems to be possible for classification for example. Vertex does not support creating an endpoint for a forecasting model as fas as I understand. — Rita, Oct 22 '21 at 07:19

Schedule batch predictions Vertex AI

2 Answers2