How to run 2 or more scripts from different directory in parallel

Question

As of now I a using time parallel to run scripts in parallel. Example... First, I'll go to the directory where the scripts are located.

cd $DIR

Then, execute scripts

time parallel ::: $script1 $script2 $script3

This works well.

But what if the scripts are in different directory?

Do they need to be run in different directories or just are placed in different directories? — Arusekk, Feb 23 '18 at 08:19
they need to be run in different directories because of some dependent files. — Jane S., Feb 23 '18 at 08:31
@JaneS.: just give the full path of the script to your above example shown. It should work? no — Inian, Feb 23 '18 at 08:34
Have you tried? `time parallel ::: /blabla/blabla/blabla/abc/script1 /blabla/blabla/blabla/def/script2 /blabla/blabla/blabla/ghi/script3` — Allan, Feb 23 '18 at 08:45

score 6 · Accepted Answer · answered Feb 23 '18 at 08:50

6

You can use an ampersand (&) for background execution in bash, and (command) to run command in a subshell:

(cd $DIR1; $script1) &
(cd $DIR2; $script2) &

answered Feb 23 '18 at 08:50

Arusekk

Nice answer, nohup can be combined to avoid the end of the scripts when the initial bash is killed! – Allan Feb 23 '18 at 08:55
Nice. Thank you :) – Jane S. Feb 23 '18 at 09:04

score 3 · Answer 2 · answered Feb 23 '18 at 08:59

If you don't need to cd into each directory, you can simply do:

time parallel --dry-run ::: dirA/dirB/script1 dirC/dirD/script2

Sample Output

dirA/dirB/script1
dirC/dirD/script2

If you do need to cd into each directory, you can do it like this:

time parallel --dry-run 'cd {//} && {/}' ::: dirA/dirB/script1 dirC/dirD/script2

Sample Output

cd dirA/dirB && script1
cd dirC/dirD && script2

2 Answers2