Stack Overflow
Stack Overflow

Questions tagged [lsf]

LSF, aka Load Sharing Facility is software that executes batch jobs on networked Unix and Windows systems on many different architectures. It is commonly used in HPC Clusters in many universities and research centers around the world.

The Load Sharing Facility or LSF is a set of tools for distributing jobs across a set of networked systems. If was developed initially by the Platform Computing company, which was acquired by IBM in 2012. It is now called IBM Spectrum LSF

Resources:

229 questions
1
vote
1 answer

Getting the start time of an LSF job

One can use bjobs to get the start time of an LSF job as such: bjobs -noheader -o start_time $JOB However, this returns low-fidelity (e.g., seconds are not necessarily included) human readable output. Higher (but not necessarily "full", I believe)…
Xophmeister
  • 8,884
  • 4
  • 44
  • 87
1
vote
2 answers

How can I use bsub to consider two sets of inputs for my code

I use the following shell script to send jobs to the server: #!/bin/bash #BSUB -J randJobName_ul0vm[1-3]%22 #BSUB -oo /log/randJobName_ul0vm.o.%J.%I #BSUB -q "server.q" #BSUB -n 2 #BSUB -R…
Albert
  • 389
  • 3
  • 17
1
vote
1 answer

Does DASK LSFCluster support GPU?

Can I specify number of GPUs by using DASK LSFCluster? I know we can specify number of cores, which means CPU only. We would like to request GPUs from the LSF scheduler. Is it possible?
NSJ
  • 145
  • 1
  • 5
1
vote
1 answer

question on using bwait to wait for multiple bsub jobs to finish

I am new to using LSF (been using PBS/Torque all along). I need to write code/logic to make sure all bsub jobs finish before other commands/jobs can be fired. Here is what I have done: I have a master shell script which calls multiple other shell…
user10101904
  • 427
  • 2
  • 12
1
vote
1 answer

How do I control LSF to send an e-mail at the start/completion/abort of my job?

I see PBS has -m b|e|a options, but I did not see any equivalent in LSF -u options. How do I control LSF to send an e-mail at the start/completion/abort of my job ? If I just use '-u', does it send an e-mail only at the completion of the job ?
nasica88
  • 1,185
  • 10
  • 10
1
vote
0 answers

shell script behaves differently when called using paramiko vs interactive shell

I am trying to run the following command via paramiko exec_command. The stdout is different when I run this command via paramiko vs just pasting it into the shell in an ssh terminal session (I printed the command from the python script and then…
Stonecraft
  • 860
  • 1
  • 12
  • 30
1
vote
1 answer

How to use LSB_JOBINDEX in bsub array job arguments in Platform LSF?

I would like to pass LSB_JOBINDEX to as an argument to my script instead of using an environment variable. This makes my script more LSF agnostic and avoids creating a helper script that uses the environment variable. However, I was not able to use…
Ciro Santilli OurBigBook.com
  • 347,512
  • 102
  • 1,199
  • 985
1
vote
0 answers

How to automate LSF batch job submission through a loop over one argument to run a R script?

I have thousands of files and folders with the same structure in a main directory path. I am trying to improve the processing time of a R script by automating several LSF batch jobs using arguments. I have some experience with R but no experience…
iolmeles
  • 11
  • 1
1
vote
1 answer

LSF moving files into created output dir

When executing a job on LSF you can specify the working directory and create a output directory, i.e bsub -cwd /home/workDir -outdir /home/$J program inputfile where it will look for inputfile in the specified working directory. The -outdir will…
RBanks
  • 11
  • 1
1
vote
1 answer

Forcing LSF to execute jobs on different hosts

I have a setup consisting from 3 workers and a management node, which I use for submitting tasks. I would like to execute concurrently a setup script at all workers: bsub -q queue -n 3 -m 'h0 h1 h2' -J "%J_%I" mpirun setup.sh As far as I…
CaptainTrunky
  • 1,562
  • 2
  • 15
  • 23
1
vote
1 answer

Training neural network in IBM Load Sharing Facility (LSF)

I was granted an access to some high-performance computing system to conduct some experiments with machine learning. This system has an IBM's LSF 10.1 installed. I was instructed to run bsub command to submit a new ML task to a queue. I use…
wl2776
  • 4,099
  • 4
  • 35
  • 77
1
vote
1 answer

Building Bazel on IBM lsf.conf

I am trying to build Bazel on IBM (Redhat 6.9) that uses LSF for the job submission system. In the middle of the build, I get an error: lsb_init: initenv_:fopen(/etc/lsf.conf) The LSF_ENVDIR is correctly set to where the lsf config files are…
Strongman
  • 51
  • 1
  • 1
  • 3
1
vote
1 answer

job scheduling in windows pc

When I submitting to job I am using the following format My questions are follows 1) Can I use my personal pc to execetute simulations. Like using VirtualBox and using one of the linux distribution ? 2) Is it possible to execute .out in the windows…
Alexander
  • 4,527
  • 5
  • 51
  • 98
1
vote
1 answer

Troubleshooting export with heredoc

INTRODUCTION: I have been using this construct to set the current group after opening a terminal at a compute server: newgrp project1_group << ANYCODE cd ~/WORK/project1_rundir bsub xterm & ANYCODE After executing this script, new terminal is…
Boris L.
  • 936
  • 2
  • 12
  • 28
1
vote
0 answers

Not able to get farm machine using 'bsub' command

I am not able to get farm machine which below command. Command:- "/temp/kfi/farm/bin/bsub -q rnd -R "(OSNAME==Linux) && (OSREL==EE70) && (SFIPLATFORM >= c0100)" -P VIP:11.3:RD:sim -W 4000:00 /usr/bin/xterm" I am trying to get the machine for Load…
kunal
  • 125
  • 1
  • 13
1 2 3
…
15 16