Stack Overflow
Stack Overflow

Questions tagged [sungridengine]

Oracle Grid Engine, previously known as Sun Grid Engine (SGE), CODINE (Computing in Distributed Networked Environments) or GRD (Global Resource Director), is an open source batch-queuing system, developed and supported by Sun Microsystems. Sun once also sold a commercial product based on SGE, known as N1 Grid Engine (N1GE).

Grid Engine was previously developed and supported by Sun Microsystems. Sun once also sold a commercial product based on SGE, known as N1 Grid Engine (N1GE). With the purchase of Sun by Oracle it was forked and there are currently three actively maintained forks: Univa Grid Engine, Son of Grid Engine and Scalable Grid Engine/Open Grid Scheduler.

Until recently Oracle offered a version known as Oracle Grid Engine but support has been transferred to Univa along with the copyrights and it is expected that the Oracle version will be folded into Univa Grid Engine. It was previously known as Sun Grid Engine (SGE), CODINE (Computing in Distributed Networked Environments) or GRD (Global Resource Director), and is an open source batch-queuing system,

The Scalable Grid Engine and Son of Grid Engine versions are open source and free to use under the Sun Industry Standards Source License.

The Univa Grid Engine and Oracle Grid Engine forks are proprietary and apart from time limited demo versions only available with a support contract.

Scalable Logic offers an optional support contract for the Scalable Grid Engine version.

SGE is typically used on a computer farm or high-performance computing (HPC) cluster and is responsible for accepting, scheduling, dispatching, and managing the remote and distributed execution of large numbers of standalone, parallel or interactive user jobs. It also manages and schedules the allocation of distributed resources such as processors, memory, disk space, and software licenses.

SGE is the foundation of the Sun Grid utility computing system, made available over the Internet in the United States in 2006, later becoming available in many other countries.

332 questions
6
votes
2 answers

How can I control the Perl version used when submitting grid jobs?

I'm working with SGE (Sun Grid Engine) to submit jobs to a grid. I also use perlbrew to manage my installed Perl versions. I wrote some short sh scripts that I use to run a perl script which requires a specific Perl version (5.12.2), which look…
David B
  • 29,258
  • 50
  • 133
  • 186
6
votes
1 answer

Redirect output to different directories for sun grid engine array jobs

I'm running a lot of jobs with Sun Grid Engine. Since these are a jobs (~100000), I would like to use array jobs, which seems to be easier on the queue. Another problem is that each jobs produces an stdout and stderr file, which I need to track…
R S
  • 11,359
  • 10
  • 43
  • 50
6
votes
1 answer

Using Docker for HPC with Sun Grid Engine

I am wondering if it is possible to create a virtual cluster with Docker so that I can run scripts that have been designed for HPC clusters using SGE cluster management. These are pretty large/complicated workflows, so its not just something I can…
Steven Hart
  • 321
  • 1
  • 2
  • 10
6
votes
2 answers

SGE: Whats the difference between -hold_jid_ad and -hold_jid

When qsub-ing a job I want one job to wait to execute until the first one has succeeded. I've been looking at the options -hold_jid_ad and -hold_jid to do this, but can't see a difference in them.
rainkinz
  • 10,082
  • 5
  • 45
  • 73
6
votes
1 answer

SunGridEngine, Condor, Torque as Resource Managers for PVM

Anyone have any idea which Resource manager is good for PVM? Or should I not have used PVM and instead relied on MPI (or any version of it, such as MPICH-2 [are there any other ones that are better?]). Main reason for using PVM was because the…
Tyug
  • 443
  • 2
  • 7
  • 21
6
votes
3 answers

How can I use a pipe or redirect in a qsub command?

There are some commands I'd like to run on a grid using qsub (SGE 8.1.3, CentOS 5.9) that need to use a pipe (|) or a redirect (>). For example, let's say I have to parallelize the command echo 'hello world' > hello.txt (Obviously a simplified…
David Robinson
  • 77,383
  • 16
  • 167
  • 187
6
votes
0 answers

Is there a Starcluster equivalent for Google Compute Engine (GCE) yet?

Does anyone know if there is a Starcluster equivalent for GCE? I have been quite happy using Starcluster with EC2 for embarrisingly parallel jobs. Now I want to try out GCE. I would be happy to contribute to whatever projects might be in the…
Jose Cortez
  • 320
  • 3
  • 10
5
votes
8 answers

SGE script: print to file during execution (not just at the end)?

I have an SGE script to execute some python code, submitted to the queue using qsub. In the python script, I have a few print statements (updating me on the progress of the program). When I run the python script from the command line, the print…
miz
  • 185
  • 2
  • 10
5
votes
1 answer

problem with snakemake submitting jobs with multiple wildcard on SGE

I used snakemake on LSF cluster before and everything worked just fine. However, recently I migrated to SGE cluster and I am getting a very strange error when I try to run a job with more than one wildcard. When I try to submit a job based on this…
Kamil S Jaron
  • 494
  • 10
  • 23
5
votes
0 answers

Using Snakemake with sun grid engine array jobs

I was wondering if anybody knew how to correctly use snakemake in a sun grid engine computing context - I'm using a shared HPC cluster and am running many jobs concurrently, but it's a large strain on the scheduler to queue up thousands of nearly…
noam
  • 105
  • 4
5
votes
2 answers

SGE - QSUB fails to submit jobs in -sync mode

I have a perl script that prepares files for input to a binary program and submits the execution of the binary program to the SGE queueing system version 6.2u2. The jobs are submitted with the -sync yoption to permit the parent perl script the…
EMiller
  • 2,792
  • 4
  • 34
  • 55
5
votes
7 answers

Condor, Sun Grid Engine, or something else?

I'm trying to work out whether we should try out Condor or Sun Grid Engine at work (or possibly something else). We often have lots of unused WinXp workstations. The hope is that we could use wake-on-LAN, run all our jobs, and then shut down…
Pengin
  • 4,692
  • 6
  • 36
  • 62
5
votes
1 answer

Using IPython Parallel on the Sun Grid Engine

I'm trying to use IPython Parallel for a very common scenario, where I want to run simulations on a cluster running Sun Grid Engine, and I can't find a reliable way to do this. Here's what I am trying to do: I want to run numerical simulations…
KartMan
  • 369
  • 3
  • 19
5
votes
2 answers

How to QLOGIN to a node that shared a specific job-id

I have an existing qlogin job like this: job-ID prior name user state submit/start at queue ------------------------------------------------------------------------- 3530770 0.50500 QLOGIN jlsmith r 10/15/2012 14:02:07…
neversaint
  • 60,904
  • 137
  • 310
  • 477
5
votes
3 answers

Tools for setting up and running a grid job on Google Compute Engine?

I have the need to set up and run "embarrassingly" parallel jobs on Google Compute Engine. I am looking for tools to facilitate this. On EC2, I was using MIT's Starcluster to set up the cluster, and then just submitting the job to SGE. Are there…
Jose Cortez
  • 320
  • 3
  • 10
1
2
3
…
22 23