Questions tagged [qsub]

Qsub is a job submission command for high performance computing jobs.

Qsub is a job submission command for high performance computing jobs. It is used by some resource managers and some schedulers, a few of which are TORQUE, PBSPro, OpenPBS, and SGE. It has many different options and is the way that a job (work request) gets queued for consideration in the cluster.

Questions with the "qsub" tag should clearly indicate which resource manager or scheduler is being used.

385 questions
0
votes
1 answer

qsub jobs with low priority?

I want to submit a couple of jobs to a cluster, but I want them to execute only if there are no other jobs on queue. How can I do this? The cluster uses TORQUE+MAUI management system.
a06e
  • 18,594
  • 33
  • 93
  • 169
0
votes
0 answers

TORQUE- qsub: job gets rejected if there are not enough number of nodes

When I submit a job using qsub job gets rejected if not enough nodes available. Is there any config that says to QUEUE(without running) the job instead of rejecting.
vamsi
  • 2,809
  • 2
  • 15
  • 18
0
votes
0 answers

my job disappears without trace

I am running a weather forecast model and I want to automate the modek runs via crontab. When I submit my job interactive through: qsub -I -l nodes=8:ppn=8 -l walltime=2:00:00 The job runs ok. When I submit through crontab, the job disappears…
Zilore Mumba
  • 1,346
  • 4
  • 23
  • 33
0
votes
1 answer

How do I schedule a job on multiple nodes with qsub Univa 8.1.7?

I want to be able to schedule a job on multiple nodes, with one process per node. I also want that process to use threads that use all of the cores available on that node. I know that "ppn" is used for scheduling PBS jobs, so I tried it with the…
nimble_ninja
  • 323
  • 1
  • 13
0
votes
2 answers

how to run PBS (portable batch system) with multiple user environment?

Recently I finished configuration a PBS for my institute. It can run very well with a user, pbs. However, it can not be run with different user, for example, jhsong. It gives the following message: echo "sleep 1" | qsub socket_connect_unix failed:…
Je-Hoon Song
  • 301
  • 1
  • 4
  • 7
0
votes
2 answers

Passing arrays to qsub script

How do I pass arrays as a variable list via qsub job script in PBS environment? For example: arr1=(1 2 3); arr2(a b c); qsub -v array1=("${arr1[@]}"), array2=("$arr2[@]") job_script.bash where job_script.bash has array variables array1 and…
0
votes
1 answer

No output from submitted job using qsub?

I have the following lines at the beginning of my script: #!/bin/bash #PBS -j oe #PBS -o ~/output/a After submitting this script with qsub, and after the job is completed, there is no file a under ~/output/. What am I missing here?
a06e
  • 18,594
  • 33
  • 93
  • 169
0
votes
1 answer

How can I see the `qsub` command used to submit a job?

I have a job running in a remote cluster. Is there a way to see what qsub command was used (the options and so on) to start the job?
a06e
  • 18,594
  • 33
  • 93
  • 169
0
votes
1 answer

Timing of MPI program changes dramatically after submitting to the queue

I have a MPI program that create a file which have time per iteration of certain amount of calculations. When I run this code without submitting to the queue(this cluster runs SGE), it gives following time in seconds. I grabbed 8 processors using…
Madisz
  • 433
  • 4
  • 4
0
votes
1 answer

Qsub parallel dependencies of a target in a makefile

Consider a makefile all : a c (cmd3) a : b1 b2 b3 b4 (cmd2) b% : (cmd) $* Consider that the dependencies b% can be parallelized and run on grid engine. What would be the simplest way to qsub these dependencies with minimal changes to…
Pushpendre
  • 795
  • 7
  • 19
0
votes
0 answers

execvp no such file or directory when qsubbing

I have two shell scripts, script5.sh, and script4.sh script5.sh looks like this: #!bin/bash FILES=$1/*\txt for f in $FILES do qsub -cwd /path/to/script4.sh $f done For script5.sh I pass in a directory…
user3799576
  • 183
  • 1
  • 2
  • 10
0
votes
2 answers

Dynamically Submit Qsub Jobs on SGE cluster based on cluster load

I am trying to run qsub jobs on a SGE(Sun Grid Engine) cluster that supports a maximum of 688 jobs. I would like to know if there is any way to find out the total number of jobs that are currently running on the cluster so I can submit jobs based on…
anonuser0428
  • 11,789
  • 22
  • 63
  • 86
0
votes
0 answers

Sun Grid Engine suspend and preserve job state through execution host restart

I'm running some tests on a cluster which requires me to restart the execution host but not the master. I was wondering how I could pause the job that is currently running, restart the exec. host, and continue running that job from where it left…
0
votes
1 answer

How to loop over a parameter list and submit jobs?

I have a job that has an input and I want to loop over a list of parameters while submitting the job. Here is the part of my script: #!/bin/bash errors=$HOME/ERRORS/convergence/GvsE/B_2/error.log count=`qstat | wc -l` gi=( "0" "0.25" "0.5" "1" "2"…
0
votes
1 answer

Does anyone have experience with clusters running on ClusterVisionOS?

I'm currently working on a cluster using the ClusterVisionOS 3.1. This will be my first time working with a cluster, so I probably haven't tried the "obvious". I can submit a single job to the cluster with the "qsub" command(this I got working…
lugte098
  • 2,271
  • 5
  • 21
  • 30