Stack Overflow
Stack Overflow

Questions tagged [spring-batch]

Spring Batch is a lightweight, comprehensive framework aimed at enabling the development of batch applications vital for the daily operations of enterprise systems. Batch applications in this context refers to automated offline systems targeted towards bulk data processing.

Spring Batch is a lightweight, comprehensive framework aimed at enabling the development of batch applications vital for the daily operations of enterprise systems. Batch applications in this context refers to automated offline systems targeted towards bulk data processing. Spring Batch automates this basic batch iteration, providing the capability to process similar transactions as a set, typically in an offline environment without any user interaction.

Spring Batch works by reading data with a configurable chunk size from a data source, processing it and finally writing it to a resource.
The data source (i.e. process input) and the data sync (i.e. process output) can be flat files (text file, XML file, CSV file...), SQL Databases (MySQL...) or NoSQL databases (MongoDB...).

Related Tags

Online Resources

8349 questions
35
votes
7 answers

javax.management.InstanceNotFoundException: org.springframework.boot:type=Admin,name=SpringApplication

I developed a Spring boot application and the functionality of the application is working fine. However, at the time of startup, I see the below exception multiple times. When I ran the same application a couple of weeks back I did not see any such…
Andy
  • 5,433
  • 6
  • 31
  • 38
35
votes
2 answers

Spring-batch @BeforeStep does not work with @StepScope

I'm using Spring Batch version 2.2.4.RELEASE I tried to write a simple example with stateful ItemReader, ItemProcessor and ItemWriter beans. public class StatefulItemReader implements ItemReader { private List list; …
Géraud
  • 1,923
  • 3
  • 20
  • 20
34
votes
1 answer

Difference between Step, Tasklet and Chunk in Spring Batch

What is the difference between Step, Tasklet and Chunk in spring batch.? Also, How to execute step in parallel via Spring Batch. ?
Priyanka Mokashi
  • 407
  • 1
  • 6
  • 14
33
votes
6 answers

I am getting error Table 'test.batch_job_instance' doesn't exist

I am new to Spring Batch. I have configured my job with inmemoryrepository. But still, it seems it is using DB to persist job Metadata. My spring batch Configuration is : @Configuration public class BatchConfiguration { @Autowired …
prakash kumar
  • 520
  • 1
  • 5
  • 16
32
votes
5 answers

Spring Batch: One reader, multiple processors and writers

In Spring batch I need to pass the items read by an ItemReader to two different processors and writer. What I'm trying to achieve is that... +---> ItemProcessor#1 ---> ItemWriter#1 | ItemReader --->…
danidemi
  • 4,404
  • 4
  • 34
  • 40
31
votes
8 answers

Spring Batch: org.springframework.batch.item.ReaderNotOpenException: Reader must be open before it can be read

I read SO related questions but the solutions don't work for me. I get the org.springframework.batch.item.ReaderNotOpenException: Reader must be open before it can be read exception. Below is my configuration: @Bean @StepScope public…
Luke
  • 1,236
  • 2
  • 11
  • 16
30
votes
10 answers

Spring Batch ORA-08177: can't serialize access for this transaction when running single job, SERIALIZED isolation level

I am getting this exception with SERIALIZED isolation level on JobRepository in Spring Batch: org.springframework.dao.CannotSerializeTransactionException: PreparedStatementCallback; SQL [INSERT into DATAFEED_APP.BATCH_JOB_INSTANCE(JOB_INSTANCE_ID,…
padis
  • 2,314
  • 4
  • 24
  • 30
29
votes
4 answers

How to get JobParameter and JobExecutionContext in the ItemWriter?

I want to retrieve JobParameter and JobExecutionContext object in my ItemWriter class. How to proceed? I tried implementing StepExecutionListener through which I am just calling the parent class methods. But it is not succeeding. Thanks in…
Smita
  • 309
  • 1
  • 3
  • 4
28
votes
1 answer

Why does destroy method 'close' fail for JPAPagingItemReader configured with Java config?

We are trying to convert our Spring-Batch jobs from XML configuration to Java configuration. We are using Spring 4.0.1.RELEASE and Spring Batch 2.2.1.RELEASE. After converting one job, the following warning started to appear in the log…
FGreg
  • 14,110
  • 10
  • 68
  • 110
27
votes
5 answers

Triggering spark jobs with REST

I have been of late trying out apache spark. My question is more specific to trigger spark jobs. Here I had posted question on understanding spark jobs. After getting dirty on jobs I moved on to my requirement. I have a REST end point where I expose…
chaosguru
  • 1,933
  • 4
  • 30
  • 44
27
votes
6 answers

Could not open JPA EntityManager for transaction; nested exception is java.lang.IllegalStateException

I am quite new to Spring and Spring-Batch in particular. Still I somehow managed to install the Spring Batch-Admin. I added custom jobs and Hibernate/JPA for persistence. Everything is working as expected, up to the point where the first chunk…
achingfingers
  • 1,827
  • 5
  • 24
  • 48
27
votes
2 answers

Spring batch Cron expression: to run every 3 hours

I want my spring batch job to run every 3 hours I used expression * * */3 * * ? this starts the job at the hour that is divisible by 3 e.g. say the server was started at 2 PM the job starts executing only at 3 PM - so far so good but the job keeps…
user1705935
  • 371
  • 1
  • 3
  • 5
26
votes
3 answers

How do I set JobParameters in spring batch with spring-boot

I followed the guide at http://spring.io/guides/gs/batch-processing/ but it describes a job with no configurable parameters. I'm using Maven to build my project. I'm porting an existing job that I have defined in XML and would like to pass-in the…
Philippe
  • 6,703
  • 3
  • 30
  • 50
25
votes
2 answers

Storing in JobExecutionContext from tasklet and accessing in another tasklet

I have a requirement in which a tasklet, stores all the files in the directories in an arraylist. The size of the list is stored in the job execution context. Later this count is accessed from another tasklet in another step. How do it do this. I…
Dead Programmer
  • 12,427
  • 23
  • 80
  • 112
24
votes
1 answer

ETL in Java Spring Batch vs Apache Spark Benchmarking

I have been working with Apache Spark + Scala for over 5 years now (Academic and Professional experiences). I always found Spark/Scala to be one of the robust combos for building any kind of Batch or Streaming ETL/ ELT applications. But lately, my…
underwood
  • 845
  • 2
  • 11
  • 22
1
2
3
…
99 100