Questions tagged [nuclio]

Nuclio is an open source serverless platform for the deployment process automatization (with support for CPU/GPU, low-power devices, on-prem and cloud). Use this tag for questions specific to problems with Nuclio. Do not use this tag for common issues with other platforms which used the Nuclio such as MLRun, etc.

Nuclio is an open-source serverless platform for the automation of the deployment process (with support for CPU/GPU, low-power devices, on-prem and cloud)

The solution also supports k8s, multi-tenancy, monitoring/logging, auto-scaling, scale to zero, LDAP relation, etc. and integration to Kafka, RabbitMQ, Kinesis, Event Hub, etc.

More information

37 questions
0
votes
1 answer

issue with igztop, show mlrun/nuclio function for k8s pods

Issue, How can I show addition mlrun parameters such as name of mlrun/nuclio function for k8s pods from igztop? It is not a problem to show for pod name also mlrun project name and owner name. I used igztop version 0.1.3 with this command igztop -w…
XiongChan
  • 90
  • 12
0
votes
1 answer

MLRun deploy, 0/3 nodes are available: 3 Insufficient cpu

I got this issue during deploy of python code in MLRun, see build log: Failed to wait for function resources to be available .../platform/kube/controller/nucliofunction.go:230 ...//nuclio/pkg/platform/kube/client/deployer.go:310 Failed to…
XiongChan
  • 90
  • 12
0
votes
1 answer

k8s/MLRun, issue with scale to zero

I would like to save sources (RAM and CPU) for real-time classification function and I used scale to zero in MLRun/K8s, but it did not work, see information from Grafana (I expected zero replicas after 2 minutes from last call): I used this code…
JIST
  • 1,139
  • 2
  • 8
  • 30
0
votes
1 answer

MLRun, Issue with slow response times

I see higher throughput and long average response delay (waiting for worker in range 20-50 seconds), see outputs from grafana: I know, that part of optimization can be: use more workers (for each pod/replica) increase sources for each…
JIST
  • 1,139
  • 2
  • 8
  • 30
0
votes
1 answer

MLRun, Issue with memory request setup (1B) for nuclio function

I have issue with memory request setup for nuclio function, current memory request has value 1B, see info in Grafana: I used this code: fn.add_model("prt-model", class_name="ClassifierPRT", model_path="tst") fn.apply(mlrun.mount_v3io()) # Set…
XiongChan
  • 90
  • 12
0
votes
1 answer

How do I use secrets in Iguazio?

How do I define secrets in Iguazio? Are they cluster-wide or just at the project level? Once the secret is defined, how do I use it in my jobs? What about distributed jobs that have many pods/workers like Spark and Dask, can I use secrets with those…
Brennan
  • 39
  • 1
  • 5
0
votes
1 answer

Where are my monitoring metrics in Iguazio?

Iguazio is supposed to be monitoring models and also resource metrics across the cluster like resource usage per pod / service, etc. When I open up the grafana service I only see a few pre-built dashboards for model monitoring and nuclio functions…
Brennan
  • 39
  • 1
  • 5
0
votes
1 answer

Can I use credentials in Nuclio functions?

I am using Nuclio functions and I need to provide credentials in the function for things like accessing database etc. Is there a way to store these credentials securely (not plain text) ?
Brennan
  • 39
  • 1
  • 5
0
votes
1 answer

Iguazio job is stuck on 'Pending' status

I have a job I am running in Iguazio. It starts and then the status is "Pending" and the icon is blue. It stays like this indefinitely and there is nothing in the logs that describes what is going on. How do I fix this?
Brennan
  • 39
  • 1
  • 5
0
votes
1 answer

How do I log a model with metrics and plots in MLRun?

I'm training a model using MLRun and would like to log the model using experiment tracking. What kinds of things can I log with the model? I'm specifically looking for metrics (i.e. accuracy, F1, etc.) and plots like loss over time
Nick Schenone
  • 209
  • 1
  • 7
0
votes
1 answer

in mlrun, what is the difference between mlrun.auto_mount() vs mlrun.mount_v3io()

In mlrun, what is the difference between mlrun.auto_mount() vs mlrun.mount_v3io()? when should auto_mount() or mount_v3io() be used?
xsqian
  • 199
  • 5
  • 13
0
votes
1 answer

Can I run the Spark jobs in the Iguazio platform with the Spot instances?

I have some big Spark workloads that can be run with a flexible schedule. I would like to take advantage of the low cost of the Spot instances of the cloud providers. Can I run the Spark jobs in the Iguazio platform with the Spot instances?
xsqian
  • 199
  • 5
  • 13
0
votes
1 answer

When would I use Spark Operator vs Spark Standalone in Iguazio?

I see in the services UI that I can create a Spark cluster. I also see that I can use the Spark operator runtime when executing a job. What is the use case for each and why would I choose one vs the other?
Nick Schenone
  • 209
  • 1
  • 7
0
votes
1 answer

Can I use Iguazio to serve a model on a REST API?

Does Iguazio support Flask, FastAPI, or any other framework to serve models? And how do I secure the endpoints?
0
votes
1 answer

Spark job fails on image pull in Iguazio

I am using code examples in the MLRun documentation for running a spark job on Iguazio platform. Docs say I can use a default spark docker image provided by the platform, but when I try to run the job the pod hangs with Error ImagePullBackOff. Here…
Brennan
  • 39
  • 1
  • 5