Use this tag for questions about the machine-learning platform MLflow
Questions tagged [mlflow]
722 questions
2
votes
0 answers
MLFlow SparkTrials maxNumConcurrentTasks([]) does not exist
I'm very new at using mlflow and I'm currently having some issues on its SparkTrials. I'm running the following code in my Jupyter notebook using Anaconda:
import mlflow
from hyperopt import hp, fmin, tpe, rand, SparkTrials, STATUS_OK, STATUS_FAIL,…

Yam
- 165
- 12
2
votes
2 answers
How to get run id from run name in MLflow
To download artifacts from a run, you need run id. I get the run id from the UI as shown below.
Run id from the UI
But when I set the run name parameter, run id is not visible in the UI. How to find the run Id of a particular run in MLflow ?

Anshul Raman
- 29
- 1
- 2
2
votes
0 answers
MLFlow - running "mlflow ui" throwing file not found error on windows 10
I have done the training with sklearn model along with mlflow and it generated the mlruns folder.
When I try to run mlflow ui it throws the following error.
There is bug in Git https://github.com/mlflow/mlflow/issues/1670 but doesn't have any…

Wickkiey
- 4,446
- 2
- 39
- 46
2
votes
1 answer
Create mlflow experiment: Run with UUID is already active
I'm trying to create a new experiment on mlflow but I have this problem:
Exception: Run with UUID l142ae5a7cf04a40902ae9ed7326093c is already active.
This is my code:
import mlflow
import mlflow.sklearn
import sys
mlflow.set_experiment("New…

dhood
- 23
- 3
2
votes
2 answers
Can MLFlow log new metrics in a terminated run?
I would like to use MLFlow (with Python) to log time series with time interval equal to 1 day.
My idea would be to create a new run with a certain ID and to use function log_metric every day (say, with a cron job) with a new value. Once my run is…

dallonsi
- 1,299
- 1
- 8
- 29
2
votes
1 answer
MLFlow runs alembicruntime.migration when I connect to a new SQLite database
For performance reasons I want to use the SQLite backend instead of the default mlruns folder in MLFlow. I set the tracking_uri to sqlite:///outputs/test.sqlite and then create a new experiment using the default API (not tracking API, but it happens…

Simon Hessner
- 1,757
- 1
- 22
- 49
2
votes
0 answers
Why is the Databricks notebook cell training my ML model "Running command..." forever?
I am training PyTorch models on a Azure Databricks cluster (on a notebook), using PyTorch Lightning, and doing the tracking using mlflow.
I would like to store training metrics + artifacts on the Databricks-hosted tracking server.
To enable that,…

Davide Fiocco
- 5,350
- 5
- 35
- 72
2
votes
1 answer
How to integrate mlflow and airflow? Is there any way to connect to mlflow server from airflow
Lets say I have a ML model in mlflow server artifacts. I want to run this model from airflow Dag. Also after running in airflow, metric logs should be visible in mlflow.
How can I achieve this?
There are connections in airflow, I couldn't find any…

veeresh patil
- 1,168
- 1
- 11
- 18
2
votes
1 answer
Serve online learning models with mlflow
It is not clear to me if one could use mlflow to serve a model that is evolving continuously based on its previous predictions.
I need to be able to query a model in order to make a prediction on a sample of data which is the basic use of mlflow…

Merkle Daamgard
- 86
- 8
2
votes
0 answers
Boto3 / MLflow model logging via temporary AWS credentials
We are building an ML tracking service using MLflow as a backend. One issue we've run into is that in order to log models via MLflow's python API, the user needs to have AWS credentials configured on their machine. Since our service is…

Enmerkar
- 53
- 7
2
votes
0 answers
mlflow on Windows10 and desktop.ini
it's the first time for me to leave a question here.
I'm currently using PyTorch on my research and trying to organize results with MLFlow.
I know that many problems when using MLflow on Windows10 but since there are no options for this... I'm…

starter.ai
- 21
- 2
2
votes
0 answers
UI does display data in MLflow
This is in reference to rather comment (not answer), I added here: MLflow: INVALID_PARAMETER_VALUE: Unsupported URI './mlruns' for model registry store
I extracted files from here
train.py MLproject wine-quality.csv
These are in…

lpt
- 931
- 16
- 35
2
votes
1 answer
Sagemaker Train Job can't connect to ec2 instance
I have MLFlow server running on ec2 instance, port 5000.
This ec2 instance has security group with opened TCP connection on port 5000 to another security group designated for SageMaker.
ec2 instance inbound rules:
SageMaker outbound rules:
These 2…

Vadym B.
- 681
- 7
- 21
2
votes
0 answers
trying logging or saving model using tensorflow in mlflow
I'm trying to log and/or save a model in mlflow and I get the error 'can't pickle repeated message fields, convert to list first'. I want to use the universal-sentence-encoder-large/5 model from tensorflow_hub, which can be loaded using this…

Beckenbaur93
- 113
- 9
2
votes
2 answers
Mlflow and KerasTuner integration
I am trying to integrate together KerasTuner and Mlflow. I'd like to record the loss at each epoch of each trial of Keras Tuner.
My approach is:
class MlflowCallback(tf.keras.callbacks.Callback):
# This function will be called after each…

Titus Pullo
- 3,751
- 15
- 45
- 65