Stack Overflow
Stack Overflow

Questions tagged [sungridengine]

Oracle Grid Engine, previously known as Sun Grid Engine (SGE), CODINE (Computing in Distributed Networked Environments) or GRD (Global Resource Director), is an open source batch-queuing system, developed and supported by Sun Microsystems. Sun once also sold a commercial product based on SGE, known as N1 Grid Engine (N1GE).

Grid Engine was previously developed and supported by Sun Microsystems. Sun once also sold a commercial product based on SGE, known as N1 Grid Engine (N1GE). With the purchase of Sun by Oracle it was forked and there are currently three actively maintained forks: Univa Grid Engine, Son of Grid Engine and Scalable Grid Engine/Open Grid Scheduler.

Until recently Oracle offered a version known as Oracle Grid Engine but support has been transferred to Univa along with the copyrights and it is expected that the Oracle version will be folded into Univa Grid Engine. It was previously known as Sun Grid Engine (SGE), CODINE (Computing in Distributed Networked Environments) or GRD (Global Resource Director), and is an open source batch-queuing system,

The Scalable Grid Engine and Son of Grid Engine versions are open source and free to use under the Sun Industry Standards Source License.

The Univa Grid Engine and Oracle Grid Engine forks are proprietary and apart from time limited demo versions only available with a support contract.

Scalable Logic offers an optional support contract for the Scalable Grid Engine version.

SGE is typically used on a computer farm or high-performance computing (HPC) cluster and is responsible for accepting, scheduling, dispatching, and managing the remote and distributed execution of large numbers of standalone, parallel or interactive user jobs. It also manages and schedules the allocation of distributed resources such as processors, memory, disk space, and software licenses.

SGE is the foundation of the Sun Grid utility computing system, made available over the Internet in the United States in 2006, later becoming available in many other countries.

332 questions
3
votes
4 answers

Spreading a job over different nodes of a cluster in sun grid engine (SGE)

I'm tryin get sun gridending (sge) to run the separate processes of an MPI job over all of the nodes of my cluster. What is happening is that each node has 12 processors, so SGE is assigning 12 of my 60 processes to 5 separate nodes. I'd like it to…
Paul G
  • 31
  • 1
  • 2
3
votes
2 answers

SGE array jobs and R

I currently have a R script written to perform a population genetic simulation, then write a table with my results to a text file. I would like to somehow run multiple instances of this script in parallel using an array job (my University's cluster…
user3381331
  • 79
  • 6
3
votes
1 answer

SGE: How to see the output in real time

I am submitting a job(script) to Sun Grid Engine. The job is a python program. It can take many hours to run, but it will periodically write to stdout and stderr to inform me its status (like how many iterations is finished, etc). The problem is…
Yuhao
  • 1,570
  • 1
  • 21
  • 32
3
votes
2 answers

Prioritizing Jobs on Sun Grid Engine Queue

I have a bunch of jobs lined up for processing on a Sun Grid Engine queue, but I have just submitted a new job that I would like to prioritize. (The new job is 163981 in the left-most column.) Is there a command I can run to ask the server to…
duhaime
  • 25,611
  • 17
  • 169
  • 224
3
votes
1 answer

Use variables as argument parameters inside qsub script

I want to pick up a number of models from a folder and use them in an sge script for an array job. So I do the following in the SGE script: MODELS=/home/sahil/Codes/bistable/models numModels=(`ls $MODELS|wc -l`) echo $numModels #$ -S /bin/bash #$…
Sahil M
  • 1,790
  • 1
  • 16
  • 31
3
votes
1 answer

Changing number of available slots in running SGE Instance

I would like to change the number of slots on a running SGE instance. The instance was started by StarCluster. I tried following this page and running: ubuntu@master: $ qconf -mattr exechost complex_values slots=1 master ubuntu@master modified…
Alex Rothberg
  • 10,243
  • 13
  • 60
  • 120
3
votes
2 answers

Job not running: 'No such file or directory' but the script exists

I'm a bioinformatician, new in the community and quite new about working with bash-commands. I recently encountered a very trivial error message but for me the issue is a bit complex to fix. Briefly, when I launch a script with the qsub command…
Francesco Gandolfi
  • 63
  • 2
  • 5
3
votes
1 answer

SGE/UGE/etc..standardized way to submit OpenMP jobs to multiple cores?

I'm looking for a way to submit an OpenMP job to a Grid Engine scheduler, while specifying the number of cores it should run on. Something equivalent to LSF's -n option, or PBS's -l nodes=[count] option. When I search on this, I'm see a bunch of…
teleute00
  • 561
  • 6
  • 25
3
votes
6 answers

Syntax for submitting a qsub job without an actual job file?

I would like to submit qsub jobs on the fly without creating discrete job files. So, let's say I have a python script called "get_time.py" that simply reports the time. Instead of making a submission script like this: cat>job.sub<
jake9115
  • 3,964
  • 12
  • 49
  • 78
3
votes
1 answer

running C++ code under Matlab using sge cluster?

i have a matlab code that run a c++ functions, it works well on my computer or any other desktop I've tried to run it on. (in order to run it on other desktop i copied the matlab/c++ functions and the mex files) lately I've tried to run the code…
Dudas
  • 72
  • 7
3
votes
0 answers

sun gridengine error "shepherd of job 119232.1 exited with exit status = 26"

We use gridengine(extactly open grid scheduler 2011.11.p1) as batch-queuing system. Just now I added an execd host named host094, but when jobs were submitted there, errors issued, status of job is Eqw, logs in…
zhangailin
  • 926
  • 2
  • 10
  • 20
2
votes
1 answer

How to I start a group of jobs on an SGE grid that will all start at the same time?

I am using a tool which spawns parallel jobs onto an SGE grid. When the grid is close to capacity some of the grid jobs start but others do not. This leads to wildly different results from the tool depending on the actual number of jobs that…
WestHamster
  • 1,297
  • 2
  • 11
  • 16
2
votes
1 answer

Precisely Why Does uname -m Report the Wrong Architecture When Run By Sun Grid Engine (SGE)?

I have 64-bit Debian Squeeze systems that run an older 32-bit version of SGE execd. When I run uname -m at the command line, I get what I'd expect: x86_64. But when I run uname -m inside an SGE script on the same host, the output is i686. This…
chrishiestand
  • 2,800
  • 1
  • 25
  • 25
2
votes
2 answers

matlab distributed computing with sge(qsub)

Recently I got access to run my codes on a cluster. My code is totally paralleizable but I don't know how to best use its parallel nature. I've to compute elements of a big matrix and each of them are independent of the others. I want to submit the…
Mohammad Moghimi
  • 4,636
  • 14
  • 50
  • 76
2
votes
1 answer

Force shell to use python from conda variable in SunGrid engine

I'm trying to execute a python file in SunGrid engine, and I'm executing it from my anaconda3 environment variable. my code is simple: from __future__ import print_function import urllib3 import numpy as np if __name__ == '__main__': …
Minions
  • 5,104
  • 5
  • 50
  • 91
1 2 3
…
22 23