Questions tagged [doit]
25 questions
0
votes
1 answer
Waiting for dependencies when running in parallel
When running doit with -n option, the task doesn't seem to wait for the file_dep to be created by other sub-tasks. Here is a simple code that tries to show the issue:
def task_pexample():
yield {
"name":"test1",
"actions":…
tlamadon
- 970
- 9
- 18
0
votes
1 answer
doit - is there a command line option to force rerun a specific task
I'm using doit to automiate some data analysis pipeline. During development/debug time, it is often necessary to rerun a task even its file dependencies haven't changed. I was wondering whether there is a command line option to achieve this. I've…
victorx
- 3,267
- 2
- 25
- 35
0
votes
0 answers
Why does 'doit list' run for hours on a large dataset?
I have a large number of files, 200k+, with a sub-task defined for each file. When I run anything, even 'doit list', it takes 2-3 hours before doit responds.
I'd like to understand what it is doing meanwhile.
I have ran…
Arman O.
- 1
- 3
0
votes
2 answers
Dynamic target names in Python doit
I have a Python doit script with task that generates files. The file names change depending on task arguments.
Is there any way to include these files in the targets list?
Unfortunately task arguments do not get populated in target name…
sourcenouveau
- 29,356
- 35
- 146
- 243
0
votes
1 answer
What is use of DOIT_SEEK_FILE
I have started to learn about doit automation tool and one thing I stumbled upon is DOIT_SEEK_FILE environment variable.
I just want to know what is use of it.
tushar_ecmc
- 186
- 2
- 21
0
votes
1 answer
doit is running every function inside dodo.py. Can I change that?
I am trying to automate a flow and I encountered a problem with "doit", because it is running all the functions inside dodo.py and I do not want it to do that.
I'm working on Python 2.7 using "doit" feature. Below is a part of the code from the…
Xaras
- 1
0
votes
1 answer
Unneeded re-run of doit task pipeline
I am using doit to automate my data analysis pipeline as described in https://blogs.aalto.fi/marijn/2016/02/25/doit-a-python-alternative-to-make/. Unfortunately, doit always wants to re-run the entire pipeline from step1 although the file_deps for…
layoutanalysis
- 3
- 1
0
votes
1 answer
Python-doit dependecy on a dataset in an h5 file
I have a doit task which depends on one of several datasets contained in an h5 file.
Does anyone have any idea how I could (1) check the dependency to determine whether or not to execute the task and (2) save the dependency's signature for…
leed25d
- 643
- 6
- 13
0
votes
2 answers
Python doit - Use arguments in dependent tasks
I have 2 doit tasks, one having a dependency on the other. For example:
def task_deploy():
return {
'actions': ['do some deploy commands'],
'file_dep': ['dist'],
'params': [{'name': 'projectName',
…
Jonathan
- 153
- 8
-1
votes
1 answer
How to generate variable using ansible parameters like args, slurp, register and set_fact inside a doit task?
I am creating a doit task where I need to use ansible parameters like args, slurp, register and set_fact inside the task within actions to make sure the variable inside this task is accessed properly.
Do I have to define these params separately…
Sujan Shah
- 1
- 2