Stack Overflow
Stack Overflow

Questions tagged [qsub]

Qsub is a job submission command for high performance computing jobs.

Qsub is a job submission command for high performance computing jobs. It is used by some resource managers and some schedulers, a few of which are TORQUE, PBSPro, OpenPBS, and SGE. It has many different options and is the way that a job (work request) gets queued for consideration in the cluster.

Questions with the "qsub" tag should clearly indicate which resource manager or scheduler is being used.

385 questions
0
votes
0 answers

qsub -X non-interactively generate OpenGL plots

I have an OpenGL program to generate screen plots based on data file. Since there are lots of data files need to be processed. I'm thinking use qsub with option -X (ForwardingX11), -t ( job array ). Every thing works fine at first. Each cpu will…
xiaozhiyun
  • 1
0
votes
1 answer

Limiting the number of qsub jobs to under the job limit

I am trying to do parameter tuning of my learning model on a Bright compute Cluster, which requires a large number of jobs due to the number of parameters being tuned. Each combination of the parameters requires around 162 qsub jobs. And there are…
anonuser0428
  • 11,789
  • 22
  • 63
  • 86
0
votes
2 answers

Torque pbs_python submit job error (15025 queue already exists)

I try to execute this example script (https://oss.trac.surfsara.nl/pbs_python/wiki/TorqueUsage/Scripts/Submit) #!/usr/bin/env python import sys sys.path.append('/usr/local/build_pbs/lib/python2.7/site-packages/pbs/') import pbs server_name =…
joeunderwood
  • 3
  • 2
0
votes
1 answer

duplicate jobs in sun grid engine

When I run qacct with the job ID, after it is finished, I get two results, the one I run and an older job with the same jobid. how can I delete the history of qacct? Any one know how to solve this? Thanks Tsvi
user1436801
  • 1
  • 4
0
votes
1 answer

sun grid engine synchronization point

I am creating a set of tasks in a cluster using the -qsub command. Inside my matlab code I would like to make a synchronization point to check whether all of my workers are finished execution or not. If all have finished execution I want to assign…
user570593
  • 3,420
  • 12
  • 56
  • 91
0
votes
1 answer

SGE qsub define variable using bach?

I am trying to automatically set up several variables for SGE system but get no luck. #!/bin/bash myname="test" totaltask=10 #$ -N $myname #$ -cwd #$ -t 1-$totaltask apparently $myname will not be recognized. any solution? thanks a lot
iiiir.com
  • 325
  • 5
  • 9
0
votes
2 answers

How to save job info (qstat) in SGE when submitting to qsub?

When submitting a job, I am able to provide qsub with the path for the standard output and the standard error. On the other side, while my job 12345 is running, I can access to extra info related to it by using qstat -j 12345. My question is if…
pedrosaurio
  • 4,708
  • 11
  • 39
  • 53
0
votes
1 answer

Why do my results become un-reproducible when run from qsub?

I'm running matlab on a cluster. when i run my .m script from an interactive matlab session on the cluster my results are reproducible. but when i run the same script from a qsub command, as part of an array job away from my watchful eye, I get…
user1792403
  • 187
  • 9
0
votes
0 answers

qsub: not sharing nodes with other users

Is there a way to request full machines? At my department I have the problem that when running a large job, some processes get allocated to shared machines. I am not sure why but it happens that processes on those shared machines are extremely…
tlamadon
  • 970
  • 9
  • 18
0
votes
2 answers

qsub and python, imports .py modules but returns ImportError for .pyf

I am trying to submit a job via qsub myScript.sh -cwd, where the shell script runs a Python-2.7 script, myPython.py. # myScript.sh python2.7 myPython.py Now, myPython.py needs to import a Python package that is stored in my local directory…
biostdave
  • 1
  • 1
0
votes
1 answer

How to create a job script to automatise this?

Right now I am doing the following on a cluster: (i) qsub-X -I -l walltime=60:00:00,nodes=1:ppn=8 (ii) submitting myjob (using ./myjob) which has the following contents #!/bin/bash i=1 nohup ./a.out $i 2 42 & nohup ./a.out $i 43 60 & nohup ./a.out…
Gravity Boy
  • 3
  • 3
0
votes
0 answers

STDIN.o# and STDIN.e# files not found on cluster

I am currently using a cluster that is using TORQUE. Recently when I submit jobs with qsub their status can be checked with qstat but no STDIN.e12345678 or STDIN.o12345678 files can be found (numbers of jobs just examples). Using the qstat -f…
aldorado
  • 4,394
  • 10
  • 35
  • 46
0
votes
1 answer

Is there any way query the node's status before submitting one job?

Before submitting one job, could I query one node's status, if the node is free, then submit it into the node; if not ,then submit the job into another free node. I want the job to run on the total node, not sharing with other jobs. Is there any…
mining
  • 3,557
  • 5
  • 39
  • 66
0
votes
1 answer

Compiling a program in a loop with qsub

I want to compile a program in a bash for loop. When I run the program from the command line it will compile but when I use qsub it doesn't compile. Is there something I am missing? Regards, John Bash File #!/bin/bash #$ -N runTest #$ -m e …
user1543042
  • 3,422
  • 1
  • 17
  • 31
0
votes
3 answers

Getting a list of qsub jobs that failed

Often I will submit 200 or so jobs to qsub at the same time and be overwhelmed with the 'completed successfully' message that I miss the few that fail and their associated 'failed' message What command do I use to retrieve a list of all failed jobs…
user2763361
  • 3,789
  • 11
  • 45
  • 81
1 2 3
…
25 26