Questions tagged [mlflow]

Use this tag for questions about the machine-learning platform MLflow

722 questions
2
votes
0 answers

MLFlow SparkTrials maxNumConcurrentTasks([]) does not exist

I'm very new at using mlflow and I'm currently having some issues on its SparkTrials. I'm running the following code in my Jupyter notebook using Anaconda: import mlflow from hyperopt import hp, fmin, tpe, rand, SparkTrials, STATUS_OK, STATUS_FAIL,…
Yam
  • 165
  • 12
2
votes
2 answers

How to get run id from run name in MLflow

To download artifacts from a run, you need run id. I get the run id from the UI as shown below. Run id from the UI But when I set the run name parameter, run id is not visible in the UI. How to find the run Id of a particular run in MLflow ?
Anshul Raman
  • 29
  • 1
  • 2
2
votes
0 answers

MLFlow - running "mlflow ui" throwing file not found error on windows 10

I have done the training with sklearn model along with mlflow and it generated the mlruns folder. When I try to run mlflow ui it throws the following error. There is bug in Git https://github.com/mlflow/mlflow/issues/1670 but doesn't have any…
Wickkiey
  • 4,446
  • 2
  • 39
  • 46
2
votes
1 answer

Create mlflow experiment: Run with UUID is already active

I'm trying to create a new experiment on mlflow but I have this problem: Exception: Run with UUID l142ae5a7cf04a40902ae9ed7326093c is already active. This is my code: import mlflow import mlflow.sklearn import sys mlflow.set_experiment("New…
dhood
  • 23
  • 3
2
votes
2 answers

Can MLFlow log new metrics in a terminated run?

I would like to use MLFlow (with Python) to log time series with time interval equal to 1 day. My idea would be to create a new run with a certain ID and to use function log_metric every day (say, with a cron job) with a new value. Once my run is…
dallonsi
  • 1,299
  • 1
  • 8
  • 29
2
votes
1 answer

MLFlow runs alembicruntime.migration when I connect to a new SQLite database

For performance reasons I want to use the SQLite backend instead of the default mlruns folder in MLFlow. I set the tracking_uri to sqlite:///outputs/test.sqlite and then create a new experiment using the default API (not tracking API, but it happens…
Simon Hessner
  • 1,757
  • 1
  • 22
  • 49
2
votes
0 answers

Why is the Databricks notebook cell training my ML model "Running command..." forever?

I am training PyTorch models on a Azure Databricks cluster (on a notebook), using PyTorch Lightning, and doing the tracking using mlflow. I would like to store training metrics + artifacts on the Databricks-hosted tracking server. To enable that,…
Davide Fiocco
  • 5,350
  • 5
  • 35
  • 72
2
votes
1 answer

How to integrate mlflow and airflow? Is there any way to connect to mlflow server from airflow

Lets say I have a ML model in mlflow server artifacts. I want to run this model from airflow Dag. Also after running in airflow, metric logs should be visible in mlflow. How can I achieve this? There are connections in airflow, I couldn't find any…
veeresh patil
  • 1,168
  • 1
  • 11
  • 18
2
votes
1 answer

Serve online learning models with mlflow

It is not clear to me if one could use mlflow to serve a model that is evolving continuously based on its previous predictions. I need to be able to query a model in order to make a prediction on a sample of data which is the basic use of mlflow…
2
votes
0 answers

Boto3 / MLflow model logging via temporary AWS credentials

We are building an ML tracking service using MLflow as a backend. One issue we've run into is that in order to log models via MLflow's python API​, the user needs to have AWS credentials configured on their machine. Since our service is…
2
votes
0 answers

mlflow on Windows10 and desktop.ini

it's the first time for me to leave a question here. I'm currently using PyTorch on my research and trying to organize results with MLFlow. I know that many problems when using MLflow on Windows10 but since there are no options for this... I'm…
starter.ai
  • 21
  • 2
2
votes
0 answers

UI does display data in MLflow

This is in reference to rather comment (not answer), I added here: MLflow: INVALID_PARAMETER_VALUE: Unsupported URI './mlruns' for model registry store I extracted files from here train.py MLproject wine-quality.csv These are in…
lpt
  • 931
  • 16
  • 35
2
votes
1 answer

Sagemaker Train Job can't connect to ec2 instance

I have MLFlow server running on ec2 instance, port 5000. This ec2 instance has security group with opened TCP connection on port 5000 to another security group designated for SageMaker. ec2 instance inbound rules: SageMaker outbound rules: These 2…
2
votes
0 answers

trying logging or saving model using tensorflow in mlflow

I'm trying to log and/or save a model in mlflow and I get the error 'can't pickle repeated message fields, convert to list first'. I want to use the universal-sentence-encoder-large/5 model from tensorflow_hub, which can be loaded using this…
Beckenbaur93
  • 113
  • 9
2
votes
2 answers

Mlflow and KerasTuner integration

I am trying to integrate together KerasTuner and Mlflow. I'd like to record the loss at each epoch of each trial of Keras Tuner. My approach is: class MlflowCallback(tf.keras.callbacks.Callback): # This function will be called after each…
Titus Pullo
  • 3,751
  • 15
  • 45
  • 65