Questions tagged [mlops]

This tag is for programming questions about MLOps, which is the application of DevOps principles in the design and deployment of Machine Learning (ML) systems.

See also:

Related tags

  • mlflow
  • kubeflow
  • feature-store
228 questions
0
votes
0 answers

Problem on running project with remote git repository using mlflow

I am using mlflow run with a GitHub uri. when i run this command : mlflow run https://github.com/mlflow/mlflow-example.git i got that error Traceback (most recent call last): File "C:\ProgramData\Anaconda3\lib\runpy.py", line 197, in…
0
votes
0 answers

Unable to load ONNX model for inference

I have a scikit-learn pipeline for heart disease prediction. I am successful in converting the same to ONNX representation. I am unable to load this model for inference because of the following error: Fail: [ONNXRuntimeError] : 1 : FAIL : Load…
0
votes
0 answers

Memory blows up in Docker when loading ML models

Uploading 4 XGboost models takes about 12 GB when I load it locally. When I try to load the same (ML) models, the 26 GB I gave it runs out. Any idea why? or how can I fix this?
0
votes
0 answers

MLOps Hyperparameter tuning when the dataframe is too large to be broadcast

I am trying to do some hyperparameter optimization on Databricks using MLOps. My dataframe containing training data is extremely large (over 1G) and it can't be cut due to the nature of the model. It's also too large to be broadcast. So I tried…
user3490622
  • 939
  • 2
  • 11
  • 30
0
votes
1 answer

Hugging Face model deployment

My question is related to how one deploys the Hugging Face model. I recently downloaded the Falcon 7B Instruct model and ran it in my Colab. However, when I am trying to load the model and want it to generate text, it takes about 40 seconds to give…
0
votes
1 answer

How to install Kubeflow cli

I am playing with Kubeflow's containerized python components. As per the below doc, we can push component to container registry by using "target_image" flag in the definition and running the following command: "kfp component build…
Mustang92
  • 21
  • 6
0
votes
0 answers

Improving YAML File Efficiency and Maintainability for Configuring Data Preprocessing

I am setting up a config.yaml file for use in a .ipynb notebook file which pre-processes some data frames. Currently I have a setup like this in my .yaml file: inputs: path: - 'data/raw/some_path.csv' …
Elis
  • 70
  • 10
0
votes
0 answers

Issues with DeepChecks' Multivariate Drift

I'm experiencing some issues with the multivariate feature drift function in deepchecks. I'm trying to plot a running/rolling multivariate drift time series graph to look for instances of high drift scores. The running/rolling is extremely…
Tan Yu
  • 1
0
votes
0 answers

Why Vertex-AI models wipe entrypoint or cmd of custom container settings with args or envs?

Usually when setting up MLOPS workflow with Docker container locally, it is good to set environment variables for docker build or docker run. Overriding Entrypoint can be useful in some cases. So when importing custom model into custom container…
0
votes
1 answer

Databricks model deployment to AWS Sagemaker -- No module named docker error

I am trying to deploy a dummy model to AWS Sagemaker using Databricks and MLflow. According to this documentation, it builds a new MLflow Sagemaker image, assigns it a name, and push to ECR. However, when I run the following lines of code in a…
0
votes
0 answers

RuntimeError: It appears that you are attempting to reference SparkContext from a broadcast variable, action, or transformation DataBricks error

I created the following model: class EquipmentEmbeddingEndpoint(mlflow.pyfunc.PythonModel): def load_context(self, context): self.identifiers_df = get_identifier_information() def predict(self, context, model_input): …
nikhil
  • 1
  • 1
0
votes
1 answer

Issue with usage two different engines for ingest to one ParquetTarget

I tried to use two different ingests from two different engines e.g. storey and pandas to the same ParquetTarget, but I do not know how. I tested, but without success. It is not a problem to create one ingest (with one engine) to the two different…
XiongChan
  • 90
  • 12
0
votes
1 answer

Connect Microsoft Azure Machine Learning Studio Model to Streamlit

I'm building a simple web from streamlit that connects with a machine learning model from Microsoft Azure Machine Learning Studion (non-classic) and I'm new to both azure and streamlit. I have trained the model that I'm going to use and wondering…
0
votes
0 answers

Connecting Azure DevOps to Azure machine learning studio

I am trying to create a ARM template for my MLOps project and everytime i run a setup pipeline to create it i receive this error : (https://i.stack.imgur.com/3U0u5.png) I double checked my credentials and the variables and searched carefully for…
Eya
  • 3
  • 1
0
votes
1 answer

Error "value of key _fn0 is None" during data ingest

I got this mistake in MLRun, during ingest values to the FeatureSet: > 2023-05-20 13:11:40,669 [info] loaded project my-project7xx from ./ and saved in MLRun DB > 2023-05-20 13:11:53,640 [error] For {'_1': 374, '_2': 886, '_3': 989, '_4': 191, '_5':…
JIST
  • 1,139
  • 2
  • 8
  • 30