Questions tagged [mlflow]

Use this tag for questions about the machine-learning platform MLflow

722 questions
2
votes
1 answer

Running mlflow as a systemd service - gunicorn not found

I am trying to run a mlflow tracking server that is installed inside of a virtualenv as a systemd service on Ubuntu 20.04 but I am getting an error indicating that it is unable to find gunicorn. Here is my journal nov 27 10:37:17 Atrium-Power…
Gerard
  • 2,832
  • 3
  • 27
  • 39
2
votes
2 answers

Logging a PySpark dataframe into a MLFlow Artifact

I am currently writing an MLFlow artifact to the dbfs but I am using pandas using the code below... temp = tempfile.NamedTemporaryFile(prefix="*****", suffix=".csv") temp_name = temp.name try: df.to_csv(temp_name, index=False) …
2
votes
0 answers

InvalidMountException while loading model from mlflow-registry in databricks

I am trying to load my spark model that I have registered using mlflow in databricks ( referring this documentation :…
2
votes
1 answer

How to have multiple MLFlow runs in parallel?

I'm not very familiar with parallelization in Python and I'm getting an error when trying to train a model on multiple training folds in parallel. Here's a simplified version of my code: def train_test_model(fold): # here I train the model…
jared3412341
  • 197
  • 3
  • 12
2
votes
0 answers

Does MLflow support distributed XGBoost model?

I use single-instance xgboost model to train, which works fine with mlflow to log all the model-related parameters by using mlflow.xgboost.autolog(), but when i change to distributed xgboost version changing from python package to JVM package by…
Yan Pan
  • 21
  • 2
2
votes
1 answer

Getting error when I click on models in mlflow

I am using SQLite as back-end for ml-flow and I have registered a model. I got registered successful as output. but whenever I click on models I am getting below error. Not sure why I am getting this. INVALID_PARAMETER_VALUE: Invalid clause(s) in…
Rahul Misal
  • 69
  • 1
  • 7
2
votes
1 answer

Unable to set up sftp artifact storage for MLFlow

I want to set up a tracking MLFlow server with external metrics and artifact storage. I have the following docker containers inside docker network: mlflow-server, postgres, sftp-mlflow and python-client. I was able to set up postgres and connect it…
iKintosh
  • 21
  • 1
  • 2
2
votes
1 answer

Serving models from mlflow registry to sagemaker

I have an mlflow server running locally and being exposed at port 80. I also have a model in the mlflow registry and I want to deploy it using the mlflow sagemaker run-local because after testing this locally, I am going to deploy everything to AWS…
2
votes
1 answer

Customize metric visualization in MLFlow UI when using mlflow.tensorflow.autolog()

I'm trying to integrate MLFlow to my project. Because I'm using tf.keras.fit_generator() for my training so I take advantage of mlflow.tensorflow.autolog()(docs here) to enable automatic logging of metrics and parameters: model = Unet() …
nguyendhn
  • 423
  • 1
  • 6
  • 19
2
votes
0 answers

MLflow - How can I run python code using a REST API

I'am a newbie on MachineLearning. Just a simple question, how can I run python code using REST API? Here is the documentation https://mlflow.org/docs/latest/rest-api.html But there are no examples for REST API. I just created an experiment, but I…
Pink
  • 21
  • 2
2
votes
1 answer

MLflow: find model version with best metric using python code

I am trying to use API workflow (python code) to find a model version that has the best metric (for instance, “accuracy”) among several model versions. I understand we can use web UI to do so, but I would love to write python code to achieve this.…
Aprilcui11
  • 125
  • 1
  • 1
  • 5
2
votes
3 answers

how to log hydra's multi-run in mlflow

I am trying to manage the results of machine learning with mlflow and hydra. So I tried to run it using the multi-run feature of hydra. I used the following code as a test. import mlflow import hydra from hydra import utils from pathlib import…
musako
  • 897
  • 2
  • 10
  • 26
2
votes
1 answer

can mlflow.spark's saved model loaded as Spark/Scala Pipeline?

Our algorithm engineer is developing machine learning model using pyspark & mlflow. He's trying to save the model using mlflow.spark API & the model format is the native spark MLlib format. Could the model be loaded from Spark Scala code? It seems…
Youfa Mao
  • 149
  • 1
  • 9
2
votes
2 answers

Sagemaker API to list Hyperparameters

I'm currently trying to implement MLFlow Tracking into my training pipeline and would like to log the hyperparameters of my hyperparameter Tuning of each training job. Does anyone know, how to pull the list of hyperparameters that can be seen on the…
cesco
  • 53
  • 8
2
votes
1 answer

How to log custom Pytorch model with Mlflow?

I have been using Presumm https://github.com/nlpyang/PreSumm for text summarization. However, in src/train_abstractive.py, the model learner trainer is not a torch.nn.Module. However, the input AbsSummarizer is an extension of the torch.nn.Module…
Chaine
  • 1,368
  • 4
  • 18
  • 37