What is the default number of workers in a dask compute?

Question

@delayed
def do_something():
    # Does some work
    pass

futures = [do_something() for x in range(100)]
compute(*futures)

does the default number of workers depend on our cpu cores? or does it run all the 100 in parallel (i assume this is not the case)

but how does it make a default worker count?

You can explicitly set the number of workers using `num_workers` in `compute` — Amir Imani, Jan 31 '19 at 14:55

score 3 · Accepted Answer · answered Jan 31 '19 at 15:08

3

According to the dask website it defaults, as you suggest, to the number of cores.

answered Jan 31 '19 at 15:08

dhjc

3

"number of cores" as far as you can tell from python, which is often actually the number of virtual threads – mdurant Jan 31 '19 at 15:36

1 Answers1