Questions tagged [dask-delayed]

Dask.Delayed refers to the python interface that consists of the delayed function, which wraps a function or object to create Delayed proxies. Use this tag for questions related to the python interface.

Dask.Delayed refers to the python interface that consists of the delayed function, which wraps a function or object to create Delayed proxies. Use this tag for questions related to the python interface.

290 questions
0
votes
0 answers

Dask delayed + Matplotlib.savefig() -> FAIL

My goal is to produce multiple png files from respectively multiple numpy arrays, loaded from medical images in my HD. To make things quicker, I'm using dask delayed. Here's my working code: import os.path from glob import glob import nibabel as…
Daniel
  • 11,332
  • 9
  • 44
  • 72
-1
votes
2 answers

Creating different types of workers that are accessed using a single client

EDIT: My question was horrifically put so I delete it and rephrase entirely here. I'll give a tl;dr: I'm trying to assign each computation to a designated worker that fits the computation type. In long: I'm trying to run a simulation, so I represent…
-1
votes
3 answers

relation between regular Dask and dask.distributed

I don't understand the relation between regular Dask and dask.distributed. With dask.distributed, e.g. using the Futures interface, I have to explicitly create a client, which is backed by a local or remote cluster, and then submit to it using…
A. Donda
  • 8,381
  • 2
  • 20
  • 49
-1
votes
1 answer

which one to use for model tuning: dask-kubernetes versus dask-yarn

I am newbie in dask & considering using it for parallelization for ml model tuning purposes. Should i try dask-yarn or dask-kubernetes for such requirement? Any general ideas on where to use which of these will also be helpful for broader…
-2
votes
1 answer

Dask delayed object computed result not get proper dataframe

I tried to use dask delayed to improve loops iteration speed, iteration done by map function. The problem is after dd.compute(), the result list is over bracket, so can not get proper dataframe. Anyone have solutions? def combine(val): …
1 2 3
19
20