How to get the elapsed time of a bunch of PBS Torque jobs?

Question

I'm using PBS Torque to run multiple jobs. The idea is simple, each job works on a shunk of data. The PBS_Torque job_script to launch a job is called run_appli.sh

Here is the simple code (code 1) to launch 10 jobs

for i in 1 2 3 4 5 6 7 9 10 do; qsub run_appli.sh ; done

Indeed, I can monitor the execution of each of those jobs using qstat (see the command below) and have elapsed time of each job.

watch -n1 -d `qstat`

However, I am interested by the overall elapsed time. That means the time starting from when I launched all the jobs (code 1) and when the last job finished its execution.

Does anyone have an idea on how to do this ?

What does ``watch -n1 -d `qstat` `` do with backquotes around `qstat`? Did you mean `watch -n1 -d qstat`? — Dima Chubarov, Jan 28 '16 at 08:07

score 2 · Answer 1 · answered Jan 27 '16 at 18:34

If you know the job id of the first job, you can look at it's ctime (creation time, or the time it is queued). You can then check the end time for the last job's comp_time. The difference between the two would be the total time elapsed.

qstat -f $first_job_id | grep ctime # Shows the first job's queued time
qstat -f $last_job_id | grep comp_time # Shows the final job's completion time.

If the last job's isn't completed, then the running elapsed time would just be the current time - the first job's queue time.

How to get the elapsed time of a bunch of PBS Torque jobs?

1 Answers1