Questions tagged [google-cloud-vertex-ai]

Usage questions relating to Google Cloud Platform's Vertex AI: https://cloud.google.com/vertex-ai/docs

692 questions
3
votes
0 answers

Access information from a previous Kubeflow component

I have a ModelBatchPredictOp component in my pipeline. This component generates 3 artifacts: batchpredictionjob, big_query_table, and gcs_output_directory. The pipeline is running fine. What I need is a way to access the tableId property of artifact…
3
votes
2 answers

Generate instances and prediction schema files for Vertex AI model evaluation (Google Cloud pipeline components)

I build a custom model and try to use Google Cloud pipeline components for model evaluation on Vertex AI. According to the model_upload_predict_evaluate notebook sample, I need to prepare instance_schema.yaml and prediction_schema.yaml to import…
Amy Wu
  • 31
  • 1
3
votes
1 answer

How do you make vertex ai prediction endpoint access public with simple authentication?

I have created a custom container model on the Google Vertex Ai platform to deploy a model, I have also deployed it to an endpoint,I can access it using bearer token and OAuth 2.0 set up but i was wondering if there is a way to make this prediction…
3
votes
1 answer

dataset versioning in vertex AI

I have my machine learning datasets in DVC. It's relatively simple to version the dataset with DVC + git. Now, as all of the training and deployment have been moved to Vertex AI, I'm trying to version my datasets. My dataset changes a lot, for…
Zabir Al Nazi
  • 10,298
  • 4
  • 33
  • 60
3
votes
1 answer

Vertex AI endpoints - dataset creation after every batch prediction

Vertex AI endpoints provide Batch Prediction functionality that is very useful to perform predictions on a large amount of data. However, every time I make a new batch prediction the endpoint creates a new Dataset inside BigQuery. This is very…
3
votes
1 answer

Vertex AI automatic retraining

I’m trying to create a Vertex AI endpoint with Monitoring enabled that can trigger a Vertex AI pipeline execution when one of the deployed models drops its performance. However, Vertex AI does not provide any built-in feature to do it. Is there a…
3
votes
1 answer

Vertex AI model version using Python SDK

Vertex AI offers a very interesting Model Registry that allows you to store all trained models and track all their versions. However, I don't manage to create new versions of the same model using the Python SDK. In particular, I have a Vertex AI…
3
votes
1 answer

Vertex AI quota limit error when current usage percentage is zero

In the context of a personal project, Im trying to use Vertex AI to run a TFX pipeline to train a model using custom training, based on this guide. When I run the pipeline I get the…
3
votes
3 answers

Vertax AI pipeline quota

I got a custom_model_training_cpus error when runing a submitted pipeline on Vertex AI. I could not find any documents. And I am using the n1-standard-4 for the deployment machine, I do not see any issue. Any commnents would be much…
FEI XIA
  • 31
  • 3
3
votes
1 answer

Error Code 429 on Vertex AI (Google Cloud Platform)

I'm currently running jobs on Vertex AI and I encountered the following problem : "error": { "code": 429, "message": "The following quota metrics exceed quota limits: aiplatform.googleapis.com/custom_model_training_nvidia_p4_gpus", …
3
votes
2 answers

How does one move python and other types of files from one GCP notebook instance to another?

I have a Vertex AI notebook that contains a lot of python and jupyter notebook as well as pickled data files in it. I need to move these files to another notebook. There isn't a lot of documentation on google's help center. Has someone had to do…
Jordan
  • 1,415
  • 3
  • 18
  • 44
3
votes
1 answer

How can I change the security setting and enable terminal for a Vertex AI managed notebook?

I created a notebook using Vertex AI without enabling terminal first, but I want to enable terminal now so that I can run a Python file from a terminal. Is there any way I can change the setting retrospectively?
3
votes
2 answers

VertexAI Tabular AutoML rejecting rows containing nulls

I am trying to build a binary classifier based on a tabular dataset that is rather sparse, but training is failing with the following message: Training pipeline failed with error message: Too few input rows passed validation. Of 1169548 inputs, 194…
3
votes
1 answer

kubeflow component - why so many ways to define a component and what are the differences?

Please help understand what are the meaningful/significant differences among different ways to create kubeflow pipeline components and the reason for having so many ways? from kfp.components import func_to_container_op @func_to_container_op def…
mon
  • 18,789
  • 22
  • 112
  • 205
3
votes
2 answers

Authenticate Custom Training Job in Vertex AI with Service Account

I am trying to run a Custom Training Job to deploy my model in Vertex AI directly from a Jupyterlab. This Jupyterlab is instantiated from a Vertex AI Managed Notebook where I already specified the service account. My aim is to deploy the training…
1 2
3
45 46