Stack Overflow
Stack Overflow

Questions tagged [sungridengine]

Oracle Grid Engine, previously known as Sun Grid Engine (SGE), CODINE (Computing in Distributed Networked Environments) or GRD (Global Resource Director), is an open source batch-queuing system, developed and supported by Sun Microsystems. Sun once also sold a commercial product based on SGE, known as N1 Grid Engine (N1GE).

Grid Engine was previously developed and supported by Sun Microsystems. Sun once also sold a commercial product based on SGE, known as N1 Grid Engine (N1GE). With the purchase of Sun by Oracle it was forked and there are currently three actively maintained forks: Univa Grid Engine, Son of Grid Engine and Scalable Grid Engine/Open Grid Scheduler.

Until recently Oracle offered a version known as Oracle Grid Engine but support has been transferred to Univa along with the copyrights and it is expected that the Oracle version will be folded into Univa Grid Engine. It was previously known as Sun Grid Engine (SGE), CODINE (Computing in Distributed Networked Environments) or GRD (Global Resource Director), and is an open source batch-queuing system,

The Scalable Grid Engine and Son of Grid Engine versions are open source and free to use under the Sun Industry Standards Source License.

The Univa Grid Engine and Oracle Grid Engine forks are proprietary and apart from time limited demo versions only available with a support contract.

Scalable Logic offers an optional support contract for the Scalable Grid Engine version.

SGE is typically used on a computer farm or high-performance computing (HPC) cluster and is responsible for accepting, scheduling, dispatching, and managing the remote and distributed execution of large numbers of standalone, parallel or interactive user jobs. It also manages and schedules the allocation of distributed resources such as processors, memory, disk space, and software licenses.

SGE is the foundation of the Sun Grid utility computing system, made available over the Internet in the United States in 2006, later becoming available in many other countries.

332 questions
5
votes
2 answers

Redirect output to different files for sun grid engine array jobs (SGE)

I am trying to execute a sun grid engine array job and I need a different output file per task: test.1.out test.2.out,etc.. If I write my script like this: #!/bin/bash #$ -S /bin/bash #$ -N name #$ -t 1-4000 #$ -o…
user1297712
  • 73
  • 2
  • 7
4
votes
3 answers

How to properly pass on an environment variable to Sun Grid Engine?

I'm trying to submit a (series of) jobs to SGE (FWIW, it's a sequence of Gromacs molecular dynamics simulations), in which all the jobs are identical except for a suffix, such as input01, input02, etc. I wrote the commands to run in a way that the…
englebip
  • 955
  • 1
  • 11
  • 17
4
votes
3 answers

Submit a job to Oracle Grid Engine in Jenkins continuous integration test system

I know how to run a bash script on Jenkins. However, if I use qsub to submit the bash script to OGE system, how does Jenkins know that my job terminates or not?
Leo5188
  • 1,967
  • 2
  • 17
  • 21
4
votes
1 answer

Sun Grid Engine get history job information

Is there any way seeing history finished job info in Sun Grid Engine, qstat -j jobId can only get job info in qstat list. If such jobId not exists in its current output list, it will output Following jobs do not exist. So can i get finished job…
Crabime
  • 644
  • 11
  • 27
4
votes
0 answers

Parallel SGE queue does not execute python code

I am currently using a cluster which uses the SGE. There, I am submitting a .sh script which calls a python script (which is multithreaded by using multiprocessing.pool), to a parallel queue by calling qsub run.sh. The python script itself is…
zimmerrol
  • 4,872
  • 3
  • 22
  • 41
4
votes
1 answer

qsub: get last job id submitted

I use Sun Grid Engine, how I can get the id of the last job submitted with qsub? currently I use this bash alias alias lastjob="qstat -u $(whoami) |tail -n1| sed '/LOGIN/d'|cut -d' ' -f1"
JuanPablo
  • 23,792
  • 39
  • 118
  • 164
4
votes
1 answer

Why don't the ipython env variables match the bash env in the associated terminal emulator?

Lately I have been doing some interactive work in Python. My setup is an IPython notebook running on a server that uses a grid engine to manage jobs. Today I was trying to get an IPython cluster going following an example posted here that uses…
Joseph Stover
  • 397
  • 4
  • 13
4
votes
1 answer

SGE Cluster qsub email notifications not working

I'm working on an SGE cluster and having some problems with the qsub email notification system. All of my jobs work perfectly, but I seem unable to modify the default behaviour to only notify at an aborted job. The -M flag works correctly, and I…
Chris C
  • 1,625
  • 1
  • 19
  • 22
4
votes
3 answers

Ensuring one Job Per Node on StarCluster / SunGridEngine (SGE)

When qsubing jobs on a StarCluster / SGE cluster, is there an easy way to ensure that each node receives at most one job at a time? I am having issues where multiple jobs end up on the same node leading to out of memory (OOM) issues. I tried using…
Alex Rothberg
  • 10,243
  • 13
  • 60
  • 120
4
votes
0 answers

Limit cores for single multi-threaded job using Grid Engine

Is there a way to limit the number of cores allocated to a single job? Similar to how I can limit memory by specifying "-l h_vmem=3g" as a default parameter to qsub, via the sge_request config file. More specifically, the scenario I want to avoid…
Vince
  • 3,325
  • 2
  • 23
  • 41
4
votes
1 answer

how to change the default shell for the sun grid engine

The sun grid engine defaults to csh, and you have to put this: #$ -S /bin/sh into scripts to avoid it. What global configuration setting would change this default?
bmargulies
  • 97,814
  • 39
  • 186
  • 310
4
votes
1 answer

SGE h_vmem vs java -Xmx -Xms

We have a couple of SGE clusters running various versions of RHEL at my work and we're testing a new one with a newer Redhat, all . On the old cluster ("Centos release 5.4"), I'm able to submit a job like the following one and it runs fine: echo…
Aphoid
  • 351
  • 3
  • 8
4
votes
2 answers

Scheduling GPU resources using the Sun Grid Engine (SGE)

We have a cluster of machines, each with 4 GPUs. Each job should be able to ask for 1-4 GPUs. Here's the catch: I would like the SGE to tell each job which GPU(s) it should take. Unlike the CPU, a GPU works best if only one process accesses it at…
Daniel Blezek
  • 4,539
  • 1
  • 19
  • 20
3
votes
1 answer

Running Python MPI programs in Sun Grid Engine

I have been coding pretty simple MPI programs in C. I am not very good at C, but pretty confident in Python. I came to know that Python has MPI bindings. I am using Sun Grid Engine as DRMS (Distributed Resource Management System). Before jumping…
World
  • 2,007
  • 7
  • 27
  • 37
3
votes
2 answers

Forcing SGE to use multiple servers

TL;DR: Is there any way to get SGE to round-robin between servers when scheduling jobs, instead of allocating all jobs to the same server whenever it can? Details: I have a large compute process that consists of many smaller jobs. I'm using SGE to…
Oren Ben-Kiki
  • 1,226
  • 11
  • 17
1 2
3
…
22 23