Questions tagged [mlrun]

open source helper/framework based on Python for speedup delivery of ML/AI to the production (support MLOps with featurestore concept), main focus on kubernetes solution. Use this tag for questions about platform MLRun (e.g. MLRun CE, MLRun paid version) or libraries from this solution (e.g. v3io, v3io stream, storey).

MLRun is an open source helper/framework based on Python for speedup delivery from ML/AI experiment phase to production with focus on minimalizing development effort (agnostic approach without focus on a specific AI/ML topic).

It supports MLOps with featurestore concept, including continuous training and continuous monitoring also. It is based on K8s with ability to support scalability of AI/ML in on-prem and cloud (support of main three major cloud providers).

Sample of python code:

import mlrun 
import mlrun.feature_store as fstore
    
# create project 'test' 
project = mlrun.get_or_create_project("test", context="./")

# add feature set (part of feature store)
transaction_set = fstore.FeatureSet("transaction", entities[fstore.Entity("trid")])

# ingest data
fstore.ingest(transaction_set, bank_trn, infer_options=fstore.InferOptions.default())

More information

  • License 'Apache-2.0 license'
  • Official web see
  • Git web see
  • Documentation web see
59 questions
1
vote
1 answer

I often see something like this v3io:// or /v3io/blah/blah, what are the difference

I often see something like this v3io:// or `/v3io/some-directory, what are the differences?
xsqian
  • 199
  • 5
  • 13
1
vote
2 answers

After creating a Jupyter service in Iguazio, I'm getting an error that mlrun is not installed

I created a Jupyter service in the Iguazio UI, opened it, and tried to run one of the pre-loaded demos. I'm getting an error saying that mlrun is not installed
Nick Schenone
  • 209
  • 1
  • 7
0
votes
1 answer

Issue, Iguazio synch Active Directory groups

Issue, it is not possible to define which Active Directory groups will be synchronized in Iguazio. I did not see ability to define these groups in IDP (Active Directory) provider setting, see UI content. I am using Iguazio 3.5.1. Thanks for help…
XiongChan
  • 90
  • 12
0
votes
1 answer

issue with igztop, show mlrun/nuclio function for k8s pods

Issue, How can I show addition mlrun parameters such as name of mlrun/nuclio function for k8s pods from igztop? It is not a problem to show for pod name also mlrun project name and owner name. I used igztop version 0.1.3 with this command igztop -w…
XiongChan
  • 90
  • 12
0
votes
1 answer

Issue with create a user in MLRun/Iguazio via API

I have a problem, how can I create user in MLRun/Iguazio system. I did not see relevant API in MLRun/Iguazio for creating the user. Unfortunately, I do not have relevant sample. Did you solve the same issue?
JIST
  • 1,139
  • 2
  • 8
  • 30
0
votes
1 answer

MLRun deploy, 0/3 nodes are available: 3 Insufficient cpu

I got this issue during deploy of python code in MLRun, see build log: Failed to wait for function resources to be available .../platform/kube/controller/nucliofunction.go:230 ...//nuclio/pkg/platform/kube/client/deployer.go:310 Failed to…
XiongChan
  • 90
  • 12
0
votes
1 answer

k8s/MLRun, issue with scale to zero

I would like to save sources (RAM and CPU) for real-time classification function and I used scale to zero in MLRun/K8s, but it did not work, see information from Grafana (I expected zero replicas after 2 minutes from last call): I used this code…
JIST
  • 1,139
  • 2
  • 8
  • 30
0
votes
1 answer

MLRun, Issue with slow response times

I see higher throughput and long average response delay (waiting for worker in range 20-50 seconds), see outputs from grafana: I know, that part of optimization can be: use more workers (for each pod/replica) increase sources for each…
JIST
  • 1,139
  • 2
  • 8
  • 30
0
votes
1 answer

MLRun, Issue with memory request setup (1B) for nuclio function

I have issue with memory request setup for nuclio function, current memory request has value 1B, see info in Grafana: I used this code: fn.add_model("prt-model", class_name="ClassifierPRT", model_path="tst") fn.apply(mlrun.mount_v3io()) # Set…
XiongChan
  • 90
  • 12
0
votes
1 answer

Issue with feature type overriding after ingest values to FeatureSet

I see that some feature types were changed after ingest value to the feature set, see information in log: > 2023-07-08 17:29:42,018 [warning] Overriding type of entity 'fn0' from 'int' to 'int32'. This may result in errors or unusable data. >…
JIST
  • 1,139
  • 2
  • 8
  • 30
0
votes
1 answer

mlrun, remove files, 'Unauthorized path'

I am administrator (with full privilege's in Iguazio\MLRun solution) and I have to clean environment. I would like to remove old accounts and delete files in v3io file systems (which was created under different user accounts). I used standard rm -rf…
XiongChan
  • 90
  • 12
0
votes
1 answer

MLRun, Issue with view to REST API throughput

How does it possible to identify throughput in MLRun solution (I use MLRun 1.3.0 with Iguazio version 3.5.2)? I am using MLRun real-time function 'nuclio-risk-sentiment' and I would like to see request/response time of MLRun. It is easy to see e.g.…
JzD
  • 22
  • 11
0
votes
1 answer

FeatureVector, 'Not allowed to read resource /projects/xxx/feature-sets/kth'

I got this error in case of read values from feature vector: ... /python/test/fvvector/utils.py in read() 115 features = ["xion/ad02.score", "xxx/kth.*"] 116 vector =…
XiongChan
  • 90
  • 12
0
votes
1 answer

How to handle writing None values to Integer type in NoSqlTarget with MLRun?

Issue with write None value to Integer type in NoSqlTarget? I used this code (everything seems fine), but feature 'ka1' does not contain None value: import mlrun import mlrun.feature_store as fstore ... project = mlrun.get_or_create_project("test",…
JzD
  • 22
  • 11
0
votes
1 answer

Issue with usage two different engines for ingest to one ParquetTarget

I tried to use two different ingests from two different engines e.g. storey and pandas to the same ParquetTarget, but I do not know how. I tested, but without success. It is not a problem to create one ingest (with one engine) to the two different…
XiongChan
  • 90
  • 12