Questions tagged [google-cloud-vertex-ai]

Usage questions relating to Google Cloud Platform's Vertex AI: https://cloud.google.com/vertex-ai/docs

692 questions
3
votes
0 answers

Why do I occasionally get 'Post request fails. Cannot decode the prediction response' when running Vertex AI batch predictions?

I'm currently running batch predictions on Vertex AI with a custom FastAPI container and manualBatchTuningParameters set to {"batch_size": 2}. My JSONL file contains 646 predictions that mostly succeed except for the few that result in the following…
Imjohsep
  • 900
  • 8
  • 8
3
votes
0 answers

Vertex AI endpoint prediction error : ValueError: Unable to coerce value

I built and deployed an XGBoost regressor model on vertex AI and I am trying to make some predictions using Vertex AI python SDK. Here's my code: client =…
3
votes
1 answer

Vertex AI scheduled notebook doesn't work, though working manually

There is a scheduled notebook, that uses BigQuery client and service account with Owner rights. When I run the cells manually, it makes an update to BQ table. There is one project for both BQ and Vertex AI. I've found a similar question, but there…
3
votes
1 answer

Is real-time collaboration supported by "user-managed notebooks" on google vertex ai?

I use GCP's vertex ai platform's "user-managed notebook" service. how do i enable real-time collaboration for the jupyter lab server? it sounds like this can be enabled by adding --collaborative when running jupyter lab. but the command is not…
3
votes
1 answer

GCP Vertex AI "Enable necessary APIs" when already enabled

I am new to GCP's Vertex AI and suspect I am running into an error from my lack of experience, but Googling the answer has brought me no fruitful information. I created a Jupyter Notebook in AI Platform but wanted to schedule it to run at a set…
3
votes
1 answer

How to make a prediction to a private Vertex AI endpoint with Node.js client libraries?

Documentation on this is a bit vague at the time of posting https://cloud.google.com/vertex-ai/docs/predictions/using-private-endpoints#sending-prediction-to-private-endpoint , they only mention how to do it with curl. I would like to use the…
3
votes
2 answers

Update a custom container model in VertexAI in GCP

I have already deployed a custom container in VertexAI and it is working fine, but now I would like to update my model and endpoint. I have pushed the new version of my Docker image to the Artifact Registry and I was expecting this latest version…
3
votes
0 answers

How to specify document language while importing a dataset in Google Cloud AutoML?

I am trying to train a model for text classification in VertexAI AutoML (Google Cloud) using documents in Spanish. I imported the documents as JSON lines and tried specifying the language of each document as follows: {"textContent":"Esto está…
3
votes
0 answers

How to fix "Kernel Unknown" error in JupyterLab on Google Vertex AI notebooks (Python 3)

When I try to open an existing or new notebook on my Google Vertex Notebooks instance (on Python 3.7.6), no code cells run and it says "kernel unknown" at the top left. When I try to run a code cell, an asterisk appears as if it were running, but…
3
votes
1 answer

Vertex AI was unable to import data into dataset. It says maximum 1M lines while my dataset only have 600k

I'm importing a text dataset to Google Vertex AI and got the following error: Hello Vertex AI Customer, Due to an error, Vertex AI was unable to import data into dataset [dataset_name]. Additional Details: Operation State: Failed with…
ML_noob
  • 51
  • 5
3
votes
1 answer

Vertex AI endpoints timing out

I am using vertex-ai endpoints to serve a deep learning service. My service takes approximately 30s - 2 minutes to respond on CPU depending on the size of the input. I noticed that when the input size takes more than one minute to respond, the API…
user297904
  • 417
  • 1
  • 4
  • 12
3
votes
1 answer

How to pass environment variables to gcloud beta ai custom-jobs create with custom container (Vertex AI)

I'm running custom training jobs in google's Vertex AI. A simple gcloud command to execute a custom job would use something like the following syntax (complete documentation for the command can be seen here): gcloud beta ai custom-jobs create…
3
votes
0 answers

Custom Model for Batch Prediction on Vertex.ai

I want to run batch predictions inside Google Cloud's vertex.ai using a custom trained model. I was able to find documentation to get online prediction working with a custom built docker image by setting up an endpoint, but I can't seem to find any…
3
votes
2 answers

Read vertex ai datasets in jupyter notebook

I am trying to create a python utility that will take dataset from vertex ai datasets and will generate statistics for that dataset. But I am unable to check the dataset using jupyter notebook. Is there any way out for this?
3
votes
1 answer

Autoscaling VertexAI pipeline components

I am exploring VertexAI pipelines and understand that it is a managed alternative to, say, AI Platform pipelines (where you have to deploy a GKE cluster to be able to run Kubeflow pipelines). What I am not clear on is whether VertexAI will autoscale…