Stack Overflow
Stack Overflow

Questions tagged [mlflow]

Use this tag for questions about the machine-learning platform MLflow

722 questions
3
votes
0 answers

How to set-up MLFlow artifact sftp store on a remote Linux machine?

My goal is to configure ML Flow to run on a remote Linux server, with logs stored in the PostgreSQL database and artifacts in /home/aw/mlfow/mllogs, where "aw" is my user name with root privileges. When I run my simple python code (see section…
Andrzej Wodecki
  • 107
  • 1
  • 8
3
votes
1 answer

How to explicitly define the AWS credentials for MLFlow when using AWS S3 as artifact store

so I'm using a MLFlow tracking server where I define a S3 bucket to be the artifact stores. Right now, MLFlow by default is getting the credentials to write/read the bucket via my default profile in .aws/credentials but I do have a staging and dev…
Tuan Tran
  • 31
  • 3
3
votes
1 answer

Specify host and port in mlflow.yml and run "kedro mlflow ui", but host and port still default (localhost:5000) not change

I build sample kedro project refer to this page, and specify host as my global ip address in mlflow.yml. but when I hit "kedro mlflow ui" command, it still listen to local. even I only specify port to 5001 (not default) in mlflow.yml, it does not…
RCheng
  • 31
  • 1
  • 2
3
votes
1 answer

MLFLow artifact logging and retrieve on remote server

I am trying to setup a MLFlow tracking server on a remote machine as a systemd service. I have a sftp server running and created a SSH key pair. Everything seems to work fine except the artifact logging. MLFlow seems to not have permissions to list…
shamalaia
  • 2,282
  • 3
  • 23
  • 35
3
votes
2 answers

MLFlow active run does not match environment run id

I am trying to perform an MLFlow run but stuck with the following error after trying a lot of things. run = mlflow.active_run() if run: print("Active run_id: {}".format(run.info.run_id)) mlflow.end_run() mlflow.set_experiment('TNF_EXP')…
Amit Pathak
  • 1,145
  • 11
  • 26
3
votes
0 answers

Mlflow download_artifacts giving Not Found error

I have mlflow and minio running under docker compose. Mlflow successfully logs artifacts to minio and retrieves them. Minio and mlflow have their relevant ports 900 and 5000 exposed by docker. If I run MlflowClient().download_artifacts for…
Adeel Hashmi
  • 767
  • 1
  • 8
  • 20
3
votes
0 answers

Writing a custom predict method using MLFlow and pyspark

I am having trouble writing a custom predict method using MLFlow and pyspark (2.4.0). What I have so far is a custom transformer that changes the data into the format I need. class CustomGroupBy(Transformer): def __init__(self): pass …
Emmy
  • 60
  • 6
3
votes
2 answers

Convert an instance of xgboost.Booster into a model that implements the scikit-learn API

I am trying to use mlflow to save a model and then load it later to make predictions. I'm using a xgboost.XGBRegressor model and its sklearn functions .predict() and .predict_proba() to make predictions but it turns out that mlflow doesn't support…
joseherazo04
  • 35
  • 5
3
votes
2 answers

How to log custom models in mlflow inside artifacts of a run?

I've stored my model in Github with MLProject so that others may run it in various variations. Now I would like to log the models created by runs as artifacts so that users can load them with MLModel. As my model is custom this is not as simple as…
MatthiasHerp
  • 271
  • 3
  • 9
3
votes
2 answers

How to send data to server for Prediction - MLflow

I am able to create ml model server using following command mlflow models serve -m file:///C:/Users/SawarkarFamily/Desktop/mlflow-master/examples/sklearn_elasticnet_wine/mlruns/0/9aeb7ba16d7e4c20870b664e267524ea/artifacts/model -p 8000 2020/07/28…
Rucha
  • 31
  • 2
3
votes
2 answers

ML Model pod keeps restarting in Seldon deployment

I have a Seldon deployment like this: apiVersion: machinelearning.seldon.io/v1alpha2 kind: SeldonDeployment metadata: name: mlflow spec: name: wines predictors: - graph: children: [] implementation: MLFLOW_SERVER …
Israel Varea
  • 2,600
  • 2
  • 17
  • 24
3
votes
7 answers

How to fix Artifacts not showing in MLflow UI

I'd used MLflow and logged parameters using the function below (from pydataberlin). def train(alpha=0.5, l1_ratio=0.5): # train a model with given parameters warnings.filterwarnings("ignore") np.random.seed(40) # Read the…
abdoulsn
  • 842
  • 2
  • 16
  • 32
3
votes
0 answers

can I use mlflow python API to register a spark UDF & then use the UDF in Spark scala code?

I'm trying to use mlflow to do the machine learning work. I register the ML model as UDF using the following python code. The question is how can I use the UDF(test_predict) in my scala code? The reason is that our main code is in Scala. The problem…
Youfa Mao
  • 149
  • 1
  • 9
3
votes
0 answers

Max retries exceeded with url, Failed to establish a new connect [Errno 60] Operation timed out'

I used nginx to build mlflow server with its proxy_pass and integrated simple HTTP auth in nginx. However, when I ran the experiment for a while, the mlflow client met this exception. And I have no idea how to fix it. Here is the error…
Jie-Han Chen
  • 108
  • 1
  • 8
3
votes
4 answers

MLflow: how to read metrics or params from an existing run?

I try to read metrics in this way: data, info = mlflow.get_run(run_id) print(data[1].metrics) # example of output: {'loss': 0.01} But it get only last value. It is possible to read manually all steps of a particular metric?
Nicola Landro
  • 336
  • 3
  • 17
1 2 3
…
48 49