0

Can one specify any sort of prioritization to tasks submitted to an IPython Cluster?

The only hack I know of to accomplish something like this is to carefully maintain a DAG of task dependencies and then, whenever submitting a new prioritized tasks, you'd need to abort all (non-started) tasks, reconstruct the DAG, and submit all the tasks again.

Yang
  • 16,037
  • 15
  • 100
  • 142
  • Seems like you want to use synchronous execution to control sequencing. Could it be that this task is not really parallel appropriate? DAG=Directed Acyclic Graph? – Roland Jun 17 '15 at 00:34
  • @Roland I'm still interested in parallelization. Yes on DAG. – Yang Jun 17 '15 at 03:50

0 Answers0