Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [gridengine]

Grid Engine is a distributed resource management (DRM) system that manages the distribution of users' workloads to available compute resources.

Links:

76 questions
0
votes
1 answer

Reserving slots in an SGE parallel environment

I'm trying to set up a Parallel Environment in SGE, with allocation rule $pe_slots, but I'm having trouble with the scheduler. Single-core jobs hog the slots; there are never enough slots open at one moment for multi-core jobs get scheduled. Can SGE…
ajwood
  • 101
  • 2
0
votes
1 answer

qsub is working but qrsh fails and only when resources are specified explicitly with -l. Why?

I am getting the following error while submitting a simple interactive job to open a shell: qrsh -V -cwd -verbose -q nsnel6.q -l h_vmem=12.000G tcsh local configuration arslox51 not defined - using global configuration Your job 8450878 ("tcsh") has…
GP92
  • 681
  • 2
  • 9
  • 27
0
votes
1 answer

How to set up SGE for following scheduling: "try first to run in queue A, if no A-slots available, try to run in queue B"?

Assume you have two queues, queue A with some new hardware, and queue B with old hardware. Further, both queues have the same number of nodes and slots for SGE jobs, e.g. 10 slots per queue. Now I submit 10 jobs. If both queues are empty and the…
Pavel
  • 1,038
  • 1
  • 11
  • 30
0
votes
1 answer

Sun Grid Engine Dynamic resource allocation

My cluster is running Sun's Grid Engine version "GE 6.2u5 $Date: 2009/12/01 12:24:06 $". I'd like to submit a single job to the queue which is defined by a bash script containing a number of commands. Most of the commands in this script can only…
Grey Christoforo
  • 1
  • 1
0
votes
2 answers

High Low priority queues SGE

I would like to have two queues in a CPU/GPU cluster, one with high priority and one with low priority. Thus, jobs that are submitted in the high priority queue will be bumped to the top of the list with the waiting jobs. How is that possible in…
chemeng
  • 81
  • 6
0
votes
1 answer

Sun Grid Engine : jobs are not well balanced

I use Open Grid Scheduler (a fork/copy of Sun Grid Engine). I have tried this configuration from master: # qconf -mattr exechost complex_values slots=8 slave2 # qconf -mq all.q | grep slots slots 100,[slave1=1],[slave2=8] slave1 is…
GlinesMome
  • 199
  • 2
  • 11
0
votes
1 answer

How do I impose a slot limit for sge on my user without manager rights?

On our cluster I could use up all the slots with the current configuration of sge. I don't want to overuse my privileges by accident / check at every submit. Is there a way to impose a hard limit on the number of slots my jobs can use? I don't have…
con-f-use
  • 103
  • 5
0
votes
1 answer

SGE Auto configured consumable resource?

I am using a tool called starcluster http://star.mit.edu/cluster to boot up an SGE configured cluster in the amazon cloud. The problem is that it doesn't seem to be configured with any pre-set consumable resources, excepts for SLOTS, which I don't…
John St. John
  • 123
  • 5
0
votes
1 answer

Sun Grid Engine VNC temporary sessions

Since I've been in a world of hurt with FreeNX attempting to get shadowing to work, I stumbled across a brief description describing starting vnc sessions through an SGE job (our firewall rules would require ssh tunneling, so I'm not too concerned…
platinummonkey
  • 153
  • 10
0
votes
1 answer

Can I add info to SGE's internal accounting AFTER job submittal?

I'm writing a front-end script to enable users to simply submit and query jobs to a gridengine cluster. Specifically, we want to be able to display via this script info about all of the queues including the name of the logfile for the currently…
Rick Reynolds
  • 341
  • 3
  • 10
0
votes
2 answers

Parallel Environment (PE) on Sun Grid Engine (6.2u5) won't run jobs: "only offers 0 slots"

I have Sun Grid Engine set up (version 6.2u5) on a Ubuntu 10.10 server with 8 cores. In order to be able to reserve multiple slots, I have a parallel environment (PE) set up like this: pe_name serial slots 999 user_lists …
Peter Van Heusden
  • 46
  • 1
  • 5
0
votes
3 answers

Parallel prologue and epilogue in Grid Engine

We have a cluster being used to run MPI jobs for a customer. Previously this cluster used Torque as the scheduler, but we are transitioning to Grid Engine 6.2u5 (for some other features). Unfortunately, we are having trouble duplicating some of…
ajdecon
  • 1,301
  • 4
  • 14
  • 21
0
votes
0 answers

Allocate Total RAM For OGE

This may end up being related to my other question about hard limits and slots, but is there a way to set the total amount of usable RAM in Open Grid Engine (OGE), regardless of the number of slots? For example, on one machine, some users want to…
David Robie
  • 101
0
votes
0 answers

Allocate Variable Slots For OGE Based on User Needs

On one machine, some users want to submit sets of jobs which will at most use X GB each, while other users want sets of up to Y GB each. Can Open Grid Engine (OGE) create variable amounts of slots based on job load? For example, if Y >> X, and the…
David Robie
  • 101
0
votes
0 answers

Hard and Soft Limits in OGE

According to the documentation for Open Grid Engine (OGE), you can configure hard and soft limits for the allocated slots. Further reading shows that tasks can run above the soft limit for a set consecutive amount of time, after which it is treated…
David Robie
  • 101
1 2 3 4
5
6