Usage questions relating to Google Cloud Platform's Vertex AI: https://cloud.google.com/vertex-ai/docs
Questions tagged [google-cloud-vertex-ai]
692 questions
2
votes
1 answer
Programmatically enable installed extensions in Vertex AI Managed Notebook instance
I am working in JupyterLab within a Managed Notebook instance, accessed through the Vertex AI workbench, as part of a Google Cloud Project. When the instance is created, there are a number of JupyterLab extensions that are installed by default. In…

user6135514
- 135
- 9
2
votes
1 answer
Error importing JSONL dataset into Vertex AI
I tried importing a JSONL dataset into Google's Vertex AI and get a weird and seemingly unrelated error:
Error: Could not parse the line, json is invalid or the format does not match the input schema: Cannot find field: classificationAnnotation in…

Jared
- 2,978
- 4
- 26
- 45
2
votes
1 answer
Library is not installed on PATH - How can I install on path?
I am running this notebook in my managed notebooks environment on Google Cloud and I'm getting the following error when trying to install the packages: "WARNING: The script google-oauthlib-tool is installed in '/home/jupyter/.local/bin' which is not…

RE Wolfe
- 29
- 3
2
votes
1 answer
Set the name for each ParallelFor iteration in KFP v2 on Vertex AI
I am currently using kfp.dsl.ParallelFor to train 300 models. It looks something like this:
...
models_to_train_op = get_models()
with dsl.ParallelFor(models_to_train_op.outputs["data"], parallelism=100) as item:
prepare_data_op =…

Optimus
- 1,354
- 1
- 21
- 40
2
votes
0 answers
Batch Prediction with scikit-learn using jsonl in Vertex AI
I have a scikit-learn model successfully trained and loaded onto Vertex AI, but I can't seem to do batch prediction with jsonl. I've tried using these formats with jsonl:
{"dense_input": [1, 2, 3, ...]}
{"dense_input": [4, 5, 6, ...]}
and
{"val_1":…

MathStudent
- 21
- 1
2
votes
1 answer
How to get image classification prediction from GCP AIPlatform in ruby?
I'm new with ruby and I want to use GCP AIPlatform but I'm struggeling with the payload.
So far, I have :
client = ::Google::Cloud::AIPlatform::V1::PredictionService::Client.new do |config|
config.endpoint =…

Maxime Vincent
- 51
- 4
2
votes
1 answer
Error while deploying a model on an endpoint- Vertex AI
I'm working on a model that I need to deploy on a Vertex AI endpoint. The model is a DNN developed in Tensorflow. I've saved the model locally, loaded to GCS and imported it in the Vertex AI Model section without problems. When I'm trying to deploy…

CopyPaster
- 21
- 3
2
votes
1 answer
Jupyter Lab instance crashes with 502 error
I am using a JupyterLab virtual notebook instance from GCP Vertex AI Workbench.
I am reading 2 billion rows of data where each row is comprised of 3 columns of
8 bytes each.
I am reading 100 million rows of data at a time and concatenating it to…

Nguai al
- 958
- 5
- 15
2
votes
0 answers
GCP Vertex AI Workbench custom image - persistence with gcs don't work
While creating a workbench with a custom jupyter image I choose backup/ persistence with GCS (google cloud storage) and it doesn't work.
For now, I tried to test with:
jupyter/base-notebook:python-3.8.8…

Santhin
- 21
- 1
2
votes
1 answer
GCP vertex - a direct way to get deployed model ID
Is there a way to directly acquire the model ID from the gcloud ai models upload command?
Either using JSON output or value output, need to manipulate by splitting and extracting. If there is a way to directly get the model ID without manipulation,…

mon
- 18,789
- 22
- 112
- 205
2
votes
1 answer
Vertex AI - how to monitor training progress?
Question
Is there a way to monitor the console output of model training progress during the Vertex AI training?
Background
Suppose we have a Tensorflow/Keras model training code:
model = keras.Sequential([
layers.Dense(64, activation='relu',…

mon
- 18,789
- 22
- 112
- 205
2
votes
1 answer
Run !docker build from Managed Notebook cell in GCP Vertex AI Workbench
I am trying to push a docker image on Google Cloud Platform container registry to define a custom training job directly inside a notebook.
After having prepared the correct Dockerfile and the URI where to push the image that contains my train.py…

Megapiro
- 53
- 5
2
votes
2 answers
Alter JSON file in CLOUD SHELL Terminal
this is my file :
$ cat INPUT-JSON
{"endpointId": "1411183591831896064", "instance": "[{age: 40.77430558, ClientID: '997', income: 44964.0106, loan: 3944.219318}]"}
I want to alter it to :
$ cat INPUT-JSON
{"endpointId": "1411183591831896064",…

M. D.
- 35
- 6
2
votes
1 answer
How to build custom pipeline in GCP using Vertex AI
I was exploring the vertex AI AutoML feature in GCP, which lets users import datasets, train, deploy and predict ML models. My use case is to do the data pre-processing on my own (I didn't get satisfied with AutoML data preprocessing) and want to…

Koushik J
- 552
- 3
- 10
- 23
2
votes
1 answer
Vertex AI cost and usage tracking
Is there a way to track and monitor the usage of Vertex AI by roles/projects? We wanted to calculate the cost per user group and charge back that amount to the respective groups.
Thanks

Rajib Deb
- 1,496
- 11
- 30