Stack Overflow
Stack Overflow

Questions tagged [vertex-ai-pipeline]

31 questions
0
votes
1 answer

ML pipeline for dataflow and DataflowPythonJobOp's support custom docker containers?

I use customer docker containers to run dataflow jobs. I want to chain it together with my tpu training job etc, so I'm considering running kubeflow pipeline on vertex ai. Is this a sensible idea? (There seems to be many alternatives like airflow…
bill
  • 650
  • 8
  • 17
0
votes
1 answer

Why am I receiving an INTERNAL ERROR OCCURRED 500 code when trying to tune a VertexAI Language Model?

I am attempting to tune a VertexAI Language model. When hitting 'Start Tuning' it loads for about a second and then stops. I also receive an internal error occurred message when attempting to train from the console. After following the recommend…
Kayden Humphries
  • 1
  • 2
0
votes
0 answers

GCP Vertext AI Java api: Is that possible to track progress of a long running job like import data or create training pipeline?

I am trying Vertex AI's Java api. For some long running task like import data, normally it will run about 30 minutes. During this period, is that possible to track progress like percentage of data imported? My code is like following: fun…
YongMu
  • 1
0
votes
0 answers

Python StudySpec parameter in Vertex AI custom job in Google Cloud

I have to specify Hyperparameters Tuning Variables in Python, for a custom Job in Vertex AI in google Cloud. https://cloud.google.com/vertex-ai/docs/training/using-hyperparameter-tuning?hl=en from google.cloud import aiplatform from…
RobyB
  • 684
  • 2
  • 11
  • 19
0
votes
0 answers

Vertex AI "Bigquery resource does not exist error" for custom training job

Currently running custom training job in Vertex AI with dataset in BigQuery in the same project. This was working last week but is now coming up with "Bigquery resource does not exist error" with no changes to configuration/permissions. This seems…
Vanita K
  • 1
0
votes
1 answer

How to modify a CustomJob for a specific component in vertexAI

I'm having trouble changing one component in my pipeline. In further detail, the component, which is a reusable component is loaded through a .yaml file, should operate on a different network (VPC) than the network that is by default assigned by…
EiJay
  • 43
  • 5
0
votes
1 answer

Kubeflow - how to pass Tensorflow Dataset and Tensors from one component to another?

I am implementing a Kubeflow pipeline in Vertex AI. Basically I have two components: prepare_data and train_model: @component( packages_to_install = [ "pandas==1.3.4", "numpy==1.20.3", "unidecode", "nltk==3.6.5", …
razimbres
  • 4,715
  • 5
  • 23
  • 50
0
votes
0 answers

Communicate with Firestore from inside Vertex AI pipeline job

I am trying to connect to and update some field in Firestore from inside a Vertex AI pipeline. The project is linked to Firebase. But the pipeline fails due to: PermissionDenied: 403 Cloud Firestore API has not been used in project…
CHRD
  • 1,917
  • 1
  • 15
  • 38
0
votes
1 answer

Can i upload multiple images for testing after deploying an object detection model on Vertex AI?

Under the "DEPLOY AND TEST" section of vertex ai after training an AutoML model, I only have the option of uploading one image at a time. I have an image that I have split into multiple images because i wanted to reduce the size of the image. Now is…
Nitya Rakhe
  • 41
  • 2
0
votes
1 answer

Configure subnetwork for vertex ai pipeline component

I have a vertex ai pipeline component that needs to connect to a database. This database exists in a VPC network. Currently my component is failing because it is not able to connect to the database, but I believe I can get it to work if I can…
DarioB
  • 1,349
  • 2
  • 21
  • 44
0
votes
1 answer

Migrate kubeflow docker image components to VertexAI pipeline

I am trying to migrate a custom component created in kubeflow to VertexAI. In Kubeflow I used to create components as docker container images and then load them into my pipeline as follows: def my_custom_component_op(gcs_dataset_path: str,…
DarioB
  • 1,349
  • 2
  • 21
  • 44
0
votes
0 answers

Match individual records during Batch predictions with VertexAI pipeline

I have a custom model in Vertex AI and a table storing the features for the model along with the record_id. I am building pipeline component for the batch prediction and facing a critical issue. When I submit the batch_prediction, I should exclude…
CHOCOLEO
  • 363
  • 2
  • 9
0
votes
1 answer

Model Monitoring for Image Data not working in Vertex AI

My use case is related to multiclass image classification. Deployed CNN Model in production and enabled Model Monitoring for prediction drift detection only which does not require training data. It automatically gets created two buckets- analysis…
RajeshM
  • 109
  • 9
0
votes
1 answer

Is it possible to add preprocess step in the Vertex AI Model Registry?

I am trying to import the custom model(XGBoost) to Model Registry in Vertex AI. I have the data in BigQuery but I need to do some preprocessing before passing it into the model. How can I import the model so that when I deploy or do batch prediction…
CHOCOLEO
  • 363
  • 2
  • 9
0
votes
0 answers

Vertex AI Does not Allow you To Schedule Via Executor

Documentation on Google Cloud mentions being able to schedule jobs/notebooks via the "Executor" Button in Vertex…
user3738936
  • 936
  • 8
  • 22
1
2
3