Questions tagged [mlops]

This tag is for programming questions about MLOps, which is the application of DevOps principles in the design and deployment of Machine Learning (ML) systems.

See also:

Related tags

  • mlflow
  • kubeflow
  • feature-store
228 questions
0
votes
1 answer

How to Deploy a Custom Model trained in Azure ML Studio Designer using Azure Devops

I want to create a complete End to End ML system, where I train several models and deploy the best. Currently, I have an End-to-End System where I used The Azure ML SDK with Azure DevOps. Architecture currently in use: Here all the Training jobs…
0
votes
1 answer

Automatically Register Custom Models in Azure ML Studio Designer and Deploy Within Designer

I am currently trying out different architectures with Azure ML Ecosystem. Currently, I am testing out Azure ML Studio Designer. I want to create a complete End to End ML system, where I train several models and deploy the best. The Pipeline…
0
votes
0 answers

Creating Endpoint on Vertex AI using FastAPI, stuck at "GET /health HTTP/1.1" 404

Run at startup - downloads the model @app.on_event("startup") def startup(): path = os.environ["AIP_STORAGE_URI"] path = os.path.join(path, model_file) logger.info(f"Loading model state from: {path}") if path.startswith("gs://"): …
0
votes
0 answers

Schedule/manage loaded AI models

I am working with multiple character-specific voices deployed on a Triton instance. The resources are not enough to have all loaded simultaneously. Currently I manually trigger a model load/unload each time a request is received by the service. How…
0
votes
1 answer

How list all available Dataset Versions in an Azure ML Dataset and also get the One before the Latest Version of the Dataset

Is there a way to list all the available versions of an Azure ML Dataset? Not via the UI, but by using the SDK. Also, How can we get the one before the latest version of that Azure ML Dataset? The main goal here is to do identify the changes in the…
0
votes
0 answers

How to declare ExampleGen and Transformer component for images in TensorFlow Extended?

I am trying to use TensorFlow Extended for building a pipeline for my image classification model. I am reading and transforming images from local directory with following code: train_datagen = ImageDataGenerator(rescale=1.0/255., …
Protik Nag
  • 511
  • 5
  • 20
0
votes
1 answer

Using Azure CLI v2 ML-extension in DevOps pipeline ("az" command)

I am trying to install "ml" extension for Azure CLI (az extension add -n ml -y --debug) in an Azure DevOps pipeline and getting an error because the extension is incompatible with that az version included into the…
jarmniku
  • 151
  • 1
  • 2
  • 10
0
votes
1 answer

Facing an Error while trying to Import ModelStep

I am trying to import ModelStep using the code from sagemaker.workflow.model_step import ModelStep But it is throwing the error ModuleNotFoundError: No module named 'sagemaker.workflow.model_step' How can I resolve this issue?
0
votes
1 answer

Kubeflow Notebook integration with Gitlab

I am trying to integrate Kubeflow notebook with Gitlab (download the gitlab repo into notebook and run models by setting parameters). Currently we are doing it by importing the .tar.gz version of the gitlab repo as a first cell in the kubeflow…
0
votes
1 answer

relaxing the anomaly detection constraints in MLOps

I am stucked in getting this block of statement.In my serving sets there are some anomalies. I am not getting what this below code is doing in removing the anomalies. payer_code = tfdv.get_feature(schema,…
0
votes
0 answers

How can I apply SHAP on a 3D dataset and LSTM model?

I trained an LSTM model on a 3D dataset and now I’m trying to apply SHAP on the model and the dataset to obtain more advanced insights. I made a lot of tests with all SHAP features but it seems no one support LSTM with 3D datasets. Is there a way to…
SARAB
  • 9
  • 1
0
votes
1 answer

Where do augmentations in ClearML run?

In ClearML Dataviews, it is possible to add augmentations. Where do these augmentations run? Options Original data gets downloaded to local, then runs (on which device? How is multiprocessing handled?) Only augmented data gets downloaded to local…
Gulzar
  • 23,452
  • 27
  • 113
  • 201
0
votes
1 answer

Azureml Training model fail with libgomp.so.1

I hope you can help me out with this issue as I cannot figure out what is wrong or how to solve it. I am diving into MLOps to have a better understanding of the workflow and process. I found an open source project to test my knowledge(I am not sure…
0
votes
1 answer

Passing PipelineParameter DataPath in Azure ML

The problem with below code is that currently it does not run because of error in line 27: raise ValueError("Unexpected input type: %s" % type(input)) ValueError: Unexpected input type: If I…
0
votes
0 answers

How to pass bidirectional messages between two python codes using kafka

In my computer vision project, I want to send images from webots-controller to the AI-model as inputs and then send movements from the AI-model to webots-controller. (for the bidirectional message passing, I used two topics) I wrote this simple code…
Matin Zivdar
  • 593
  • 5
  • 20