Use this tag for questions about the machine-learning platform MLflow
Questions tagged [mlflow]
722 questions
5
votes
1 answer
Is there a way to manage permissions at an experiment level in MLflow?
Is there a way to manage permissions at an experiment level in MLflow? We would like to have a shared server but would like to be able to manage permissions at an experiment level - e.g. admin can view all experiments, user_group1 can manage…

prk
- 319
- 1
- 3
- 10
4
votes
1 answer
Runtime error using MLFlow and Spark on databricks
Here is some model I created:
class SomeModel(mlflow.pyfunc.PythonModel):
def predict(self, context, input):
# do fancy ML stuff
# log results
pandas_df = pd.DataFrame(...insert predictions here...)
spark_df =…

ghostiek
- 45
- 5
4
votes
0 answers
Is there mlflow REST api to hard delete experiments, runs?
Mlfow exp delete api does soft delete and when you create experiment with that name, it gives error RESOURCE_ALREADY_EXISTS.
Is there any way to delete experiment permanently through…

veeresh patil
- 1,168
- 1
- 11
- 18
4
votes
2 answers
How to retrieve the model signature from the MLflow Model Registry
I have registered a scikit learn model on my MLflow Tracking server, and I am loading it with sklearn.load_model(model_uri).
Now, I would like to access the signature of the model so I can get a list of the model's required inputs/features so I can…

Mike
- 444
- 1
- 8
- 19
4
votes
0 answers
How to use mlflow.log_params to append params when used alongside mlflow.autolog()
I am using mlflow.autolog() to log params and metrics for a tensorflow based training and it works well. It captures 26 different parameters automatically.
However if I use mlflow.log_params() to log custom params those 26 are not being logged…

Amit Jha
- 61
- 1
- 3
4
votes
1 answer
how to mlflow autolog with custom parameters
I'm trying to log my ML trials with mlflow.keras.autolog and mlflow.log_param simultaneously (mlflow v 1.22.0). However, the only things that are recorded are autolog's products, but not those of log_param.
experiment =…

prze gee
- 61
- 4
4
votes
3 answers
How can I save more metadata on an MLFlow model
I am trying to save a model to MLFlow, but as I have a custom prediction pipeline to retrieve data, I need to save extra metadata into the model.
I tried using my custom signature class, which It does the job correctly and saves the model with the…

Angelo
- 575
- 3
- 18
4
votes
1 answer
How to connect to MLFlow tracking server that has auth?
I want to connect to remote tracking server (http://123.456.78.90) that requires authentication
When I do this:
import mlflow
mlflow.set_tracking_uri("http://123.456.78.90")
mlflow.set_experiment("my-experiment")
I get an error
MlflowException:…

Ksenia Belozerova
- 43
- 1
- 4
4
votes
2 answers
Setup Mlflow backend (SQLite) and artifact (Azure Blob Storage) stores
I would like to setup Mlflow to have the following components :
Backend store (local) : using a SQLite database locally to store Mlflow entities (run_id, params, metrics...)
Artifact store (remote) : using a blob storage on my Azure Data Lake…

Downforu
- 317
- 5
- 13
4
votes
0 answers
MLflow saving a run to a specific experiment id
I am trying to save runs called from MLflow Projects to specific experiment names/ids.
Currently, my MLflow project looks like this:
name: Echo NLP Project
entry_points:
generate:
parameters:
...
command: "python…

Farrandi
- 41
- 2
4
votes
1 answer
load MLFlow model and plot feature importance with feature names
If I save a xgboost model in mlflow with mlflow.xgboost.log_model(model, "model") and load it with model = mlflow.xgboost.load_model("models:/model_uri") and want to plot the feature importance with xgboost.plot_importance(model) the problem is that…

McDizzy
- 189
- 11
4
votes
1 answer
Problem crating a Ranger model with R to use for MLflow
I am trying to use MLflow in R. According to https://www.mlflow.org/docs/latest/models.html#r-function-crate, the crate flavor needs to be used for the model. My model uses the Random Forest function implemented in the ranger package:
model <-…

Fabian S.
- 41
- 1
4
votes
1 answer
How to delete a run_id from MLflow
I want to permanently delete a run_id from an experiment in MLflow
I am using the following code:
import mlflow
from mlflow.entities import ViewType
_mlflow_tracking_uri = "the mlflow tracking url"
exp_id_delete =…

quant
- 4,062
- 5
- 29
- 70
4
votes
1 answer
Use mlflow to serve a custom python model for scoring
I am using Python code generated from an ML software with mlflow to read a data frame, perform some table operations and output a data frame. I am able to run the code successfully and save the new data frame as an artifact. However, I am unable to…

Subhojyoti Lahiri
- 109
- 3
- 10
4
votes
1 answer
How to log a sklearn pipeline with a Keras step using mlflow.pyfunc.log_model()? TypeError: can't pickle _thread.RLock objects
I would like to log into MlFlow a sklearn pipeline with a Keras step.
The pipeline has 2 steps: a sklearn StandardScale and a Keras TensorFlow model.
I am using mlflow.pyfunc.log_model() as possible solution, but I am having this error:
TypeError:…

user1444216
- 41
- 7