Questions tagged [mlflow]

Use this tag for questions about the machine-learning platform MLflow

722 questions
5
votes
1 answer

Is there a way to manage permissions at an experiment level in MLflow?

Is there a way to manage permissions at an experiment level in MLflow? We would like to have a shared server but would like to be able to manage permissions at an experiment level - e.g. admin can view all experiments, user_group1 can manage…
prk
  • 319
  • 1
  • 3
  • 10
4
votes
1 answer

Runtime error using MLFlow and Spark on databricks

Here is some model I created: class SomeModel(mlflow.pyfunc.PythonModel): def predict(self, context, input): # do fancy ML stuff # log results pandas_df = pd.DataFrame(...insert predictions here...) spark_df =…
ghostiek
  • 45
  • 5
4
votes
0 answers

Is there mlflow REST api to hard delete experiments, runs?

Mlfow exp delete api does soft delete and when you create experiment with that name, it gives error RESOURCE_ALREADY_EXISTS. Is there any way to delete experiment permanently through…
veeresh patil
  • 1,168
  • 1
  • 11
  • 18
4
votes
2 answers

How to retrieve the model signature from the MLflow Model Registry

I have registered a scikit learn model on my MLflow Tracking server, and I am loading it with sklearn.load_model(model_uri). Now, I would like to access the signature of the model so I can get a list of the model's required inputs/features so I can…
Mike
  • 444
  • 1
  • 8
  • 19
4
votes
0 answers

How to use mlflow.log_params to append params when used alongside mlflow.autolog()

I am using mlflow.autolog() to log params and metrics for a tensorflow based training and it works well. It captures 26 different parameters automatically. However if I use mlflow.log_params() to log custom params those 26 are not being logged…
Amit Jha
  • 61
  • 1
  • 3
4
votes
1 answer

how to mlflow autolog with custom parameters

I'm trying to log my ML trials with mlflow.keras.autolog and mlflow.log_param simultaneously (mlflow v 1.22.0). However, the only things that are recorded are autolog's products, but not those of log_param. experiment =…
prze gee
  • 61
  • 4
4
votes
3 answers

How can I save more metadata on an MLFlow model

I am trying to save a model to MLFlow, but as I have a custom prediction pipeline to retrieve data, I need to save extra metadata into the model. I tried using my custom signature class, which It does the job correctly and saves the model with the…
Angelo
  • 575
  • 3
  • 18
4
votes
1 answer

How to connect to MLFlow tracking server that has auth?

I want to connect to remote tracking server (http://123.456.78.90) that requires authentication When I do this: import mlflow mlflow.set_tracking_uri("http://123.456.78.90") mlflow.set_experiment("my-experiment") I get an error MlflowException:…
4
votes
2 answers

Setup Mlflow backend (SQLite) and artifact (Azure Blob Storage) stores

I would like to setup Mlflow to have the following components : Backend store (local) : using a SQLite database locally to store Mlflow entities (run_id, params, metrics...) Artifact store (remote) : using a blob storage on my Azure Data Lake…
Downforu
  • 317
  • 5
  • 13
4
votes
0 answers

MLflow saving a run to a specific experiment id

I am trying to save runs called from MLflow Projects to specific experiment names/ids. Currently, my MLflow project looks like this: name: Echo NLP Project entry_points: generate: parameters: ... command: "python…
Farrandi
  • 41
  • 2
4
votes
1 answer

load MLFlow model and plot feature importance with feature names

If I save a xgboost model in mlflow with mlflow.xgboost.log_model(model, "model") and load it with model = mlflow.xgboost.load_model("models:/model_uri") and want to plot the feature importance with xgboost.plot_importance(model) the problem is that…
McDizzy
  • 189
  • 11
4
votes
1 answer

Problem crating a Ranger model with R to use for MLflow

I am trying to use MLflow in R. According to https://www.mlflow.org/docs/latest/models.html#r-function-crate, the crate flavor needs to be used for the model. My model uses the Random Forest function implemented in the ranger package: model <-…
Fabian S.
  • 41
  • 1
4
votes
1 answer

How to delete a run_id from MLflow

I want to permanently delete a run_id from an experiment in MLflow I am using the following code: import mlflow from mlflow.entities import ViewType _mlflow_tracking_uri = "the mlflow tracking url" exp_id_delete =…
quant
  • 4,062
  • 5
  • 29
  • 70
4
votes
1 answer

Use mlflow to serve a custom python model for scoring

I am using Python code generated from an ML software with mlflow to read a data frame, perform some table operations and output a data frame. I am able to run the code successfully and save the new data frame as an artifact. However, I am unable to…
4
votes
1 answer

How to log a sklearn pipeline with a Keras step using mlflow.pyfunc.log_model()? TypeError: can't pickle _thread.RLock objects

I would like to log into MlFlow a sklearn pipeline with a Keras step. The pipeline has 2 steps: a sklearn StandardScale and a Keras TensorFlow model. I am using mlflow.pyfunc.log_model() as possible solution, but I am having this error: TypeError:…