Stack Overflow
Stack Overflow

Questions tagged [kubeflow]

Kubeflow Training Operator provides Kubernetes custom resources that makes it easy to run distributed or non-distributed TensorFlow/PyTorch/Apache MXNet/XGBoost/MPI jobs on Kubernetes.

GitHub: https://github.com/kubeflow/training-operator

433 questions
2
votes
1 answer

AKS Cluster with virtual node enabled and without virtual node enabled

I wanted to install Kubeflow into the Azure, So I started off creating an Azure Kubernetes Cluster(AKS) with a single node(B4MS virtual machine). During the installation, I didn't enable the virtual node pool option. After creating the AKS cluster,…
Esa Fazal
  • 23
  • 3
2
votes
0 answers

Docker daemon doesn't start in minikf

After installing MiniKF,landing http://10.10.10.10, I use box is "arrikto/minikf" and version is '20200305.1.0',have the problem blow: RAM have enough, disk have enough. What's wrong with it?
wawa
  • 616
  • 5
  • 14
2
votes
1 answer

Kubeflow without Google Cloud Storage

Is it possible to replace the usage of Google Cloud Storage buckets with an alternative on-premises solution so that it is possible to run e.g. Kubeflow Pipelines completely independent from the Google Cloud Platform?
tech34841916559242495
  • 95
  • 7
2
votes
3 answers

Cannot deploy Kubeflow on GCP: tells me to enable APIs that are already enabled

I am trying to install Kubeflow on Google Cloud Platform (GCP) and Kubernetes Engine (GKE), following the GCP deployment guide. I created a GCP project of which I am the owner, I enabled billing, set up OAuth credentials and enabled the following…
BioGeek
  • 21,897
  • 23
  • 83
  • 145
2
votes
2 answers

Is it possible to let a Kubeflow inference pipeline (KFServing) publish messages to Kafka?

I'm beginning to use Kubeflow and I've read about KFServing. There is this integration with Kafka to consume from a topic. What I need is to run an inference pipeline that consumes data from Kafka, does some data preproccessing, run the ML…
openrory
  • 61
  • 6
2
votes
1 answer

How to add configuration (e.g. environment variables) for jupyter notebook server in kubeflow

Currently I'm using kubeflow v0.7 and when I create a new Jupyter notebook server, there is a configuration section, but I can't select or add any configurations there. Is there any place that I can add configurations for a new notebook server? Or…
Dd__Mad
  • 116
  • 8
2
votes
2 answers

How to build an image for KubeFlow pipeline?

I recently found out about kubeflow and kubeflow pipeline but it is not clear for me how to build an image from my python program. Let's assume that I have a simple python function that crops images: class Image_Proc: def crop_image(self, image,…
AVarf
  • 4,481
  • 9
  • 47
  • 74
2
votes
1 answer

KubeFlow, handling large dynamic arrays and ParallelFor with current size limitations

I've been struggling to find a good solution for this manner for the past day and would like to hear your thoughts. I have a pipeline which receives a large & dynamic JSON array (containing only stringified objects), I need to be able to create a…
Yoni Cohen
  • 21
  • 3
2
votes
1 answer

kubeflow ParallelFor using the previous containerop output

I can create a static for loop using with dsl.ParallelFor([1,2,3]) as item: .... How can I use a container_op.output as an input to ParallelFor? Assume the first container outputs an integer n, and then I want to run ParallelFor n…
user3599803
  • 6,435
  • 17
  • 69
  • 130
2
votes
1 answer

Route the output of model A as the input of model B on Seldon Core

I'm testing Seldon Core and am wondering if there is an easy way to route the output of model A as the input of model B on Seldon Core. What would be the best practice?
user3368526
  • 2,168
  • 10
  • 37
  • 52
2
votes
1 answer

Deploy kubeflow on GCP CloudShell using cli: /home/user/.kube/config: no such file or directory

I need to deploy Kubeflowfor ML pipeline and TFX on GCP. Unfortunately I cannot use the following UI for the installation, because I need to setup manually, the Zone, Network and Subnet. There is a nice documentation…
Dr. Fabien Tarrade
  • 1,556
  • 6
  • 23
  • 49
2
votes
1 answer

Kubeflow pipeline error: failed to save outputs: No such container

While trying to setup my own kubeflow pipeline I ran into a problem when one step is finished and the outputs should be saved. After finishing the step kubeflow always throws an error with the message This step is in Error state with this message:…
Pascal
  • 103
  • 2
  • 7
2
votes
0 answers

Kubeflow Pipelines - Passing String to Output

What is the simplest way to send along a string through the outputs in a Kubeflow Pipeline? I would like to have a timestamp created in my first component and then send that timestamp to each successive step in the pipeline. The only way I have…
Daniel Alarcon
  • 31
  • 2
2
votes
1 answer

Integrate Tensorboard in KUBEFLOW pipeline using viewers

I'm using KUBEFLOW pipelines for training KERAS models with TF and I'm starting from a very simple one. Model is training fine and the pipeline works properly, but I'm not able to use the output viewer for TENSORBOARD properly. Reading from the…
luke035
  • 342
  • 2
  • 17
2
votes
1 answer

Kubeflow Multiple images components in pipeline

I want to write a pipeline in Kubeflow pipeline that has 2 components: A and B The output of A is list of image path. I want to run a docker image (B) for each image path From what I see the dsl.ContainerOp of B can wait for output of A, but I don't…
asaf
  • 958
  • 1
  • 16
  • 38
1 2 3
…
28 29