Spring Batch - Executing multiple instances of a job at same time

Question

I have a clarification.

Is it possible for us to run multiple instances of a job at the same time.

Currently, we have single instance of a job at any given time.

If it is possible, please let me know how to do it.

score 11 · Accepted Answer · answered Jul 13 '16 at 11:05

Yes you can. Spring Batch distinguishes jobs based on the JobParameters. So if you always pass different JobParameters to the same job, you will have multiple instances of the same job running. A simple way is just to add a UUID parameter to each request to start a job. Example:

final JobParametersBuilder jobParametersBuilder = new JobParametersBuilder();
jobParametersBuilder.addString("instance_id", UUID.randomUUID().toString(), true);
jobLauncher.run(job,jobParametersBuilder.toJobParameters());

The boolean 'true' at the end signal to Spring Batch to use that parameter as part of the 'identity' of the instance of the job, so you will always get new instances with each 'run' of the job.

Thanks for your answer, Antonio Dias. we have added time stamp as part of Job Parameters instead of random id. — Anand Kumar, Jul 13 '16 at 11:37

score 1 · Answer 2 · answered Jun 19 '12 at 17:07

1

Yes you can very much run tasks in parallel as also documented here

But there are certain things to be considered

Does your application logic needs parallel execution? Because if if you are going to run steps in parallel, you would have to take care and build application logic so that the work done by parallel steps is not overlapping (Unless that is the intention of your application)

answered Jun 19 '12 at 17:07

Vishal Biyani

4,297
28
55

This is an old question, but I want to clarify that the OP is asking if "multiple instances of [the same] job" can be run in parallel. The link you provided refers to running steps within a single execution in parallel which is a different concept. – IcedDante May 10 '16 at 18:54

score 0 · Answer 3 · answered Jun 15 '12 at 10:37

0

Yes, it's completely possible to have multiple instances (or executions) of a job run concurrently.

answered Jun 15 '12 at 10:37

Joshua Moore

24,706
6
50
73

How can multiple instances read the same mongo collection but different records? Thanks – Diego Ramos May 30 '22 at 22:51

Spring Batch - Executing multiple instances of a job at same time

3 Answers3

Linked