Questions tagged [coiled]
4 questions
1
vote
1 answer
KilledWorker Exception
I am using coiled to spin up a cluster and using dask to do some manipulation on a csv read from an S3 bucket. However, at some point my workers are getting killed. When I inspected the logs, the following task is killing them.
distributed.scheduler…

QuantNoob
- 13
- 3
0
votes
0 answers
Can docker images generated with Coiled be converted to Dockerfiles to rebuild the same image from scratch
I am new to Docker and am trying to cut corners in building Docker images. I heard that Coiled could be used to generate Docker images from Conda environment yamls. I have done this, but now I would like to be able to go from this image to a Docker…

Noah_Seagull
- 337
- 5
- 18
0
votes
1 answer
Coiled: Use local file to train XGBoost classifier
I want to train an XGBoost classifier with coiled and dask.
The problem is that my training data is really big and is stored in an h5py file on my computer. Is there a way to upload the h5py file directly to the workers?
To show my problem I created…

Johanna
- 1
- 2
0
votes
1 answer
How does one use prefect cloud secrets with coiled?
I am trying to run a flow using a secret stored in prefect cloud with coiled.
The flow errors out with a prefect client error:
prefect.utilities.exceptions.ClientError: Malformed response received from Cloud - please ensure that you have an API…

Itay Livni
- 2,143
- 24
- 38