1

I am using Metaflow on AWS in batch mode. I deleted the conda folder from s3. Now when I try to run a batch task, it fails in the bootstrapping environment step.

Apparently metaflow.plugins.conda.batch_bootstrap tries to download conda packages using the cache_urls associated with the environment id from the conda.dependencies file. The issue is described in some more detail here.

How can I fix this problem so that I can run a metaflow batch task again?

kanimbla
  • 858
  • 1
  • 9
  • 23
  • I realized that rebooting solves this issue. Would be much better though if this problem was handled by Metaflow. – kanimbla Feb 07 '20 at 07:52

1 Answers1

2

@kanimbla metaflow maintains a manifest folder .metaflow either in the same directory as your flow or in one of the parent directories. Deleting it resets your flow's dependencies.

Savin
  • 141
  • 6