Stack Overflow
Stack Overflow

Questions tagged [spring-batch]

Spring Batch is a lightweight, comprehensive framework aimed at enabling the development of batch applications vital for the daily operations of enterprise systems. Batch applications in this context refers to automated offline systems targeted towards bulk data processing.

Spring Batch is a lightweight, comprehensive framework aimed at enabling the development of batch applications vital for the daily operations of enterprise systems. Batch applications in this context refers to automated offline systems targeted towards bulk data processing. Spring Batch automates this basic batch iteration, providing the capability to process similar transactions as a set, typically in an offline environment without any user interaction.

Spring Batch works by reading data with a configurable chunk size from a data source, processing it and finally writing it to a resource.
The data source (i.e. process input) and the data sync (i.e. process output) can be flat files (text file, XML file, CSV file...), SQL Databases (MySQL...) or NoSQL databases (MongoDB...).

Related Tags

Online Resources

8349 questions
2
votes
0 answers

How can I define a Java system property in a Spring XD stream?

For some ad hoc testing of a custom Spring XD processor, I would like to specify a Java system property during the definition of the stream to be passed to the processor. Is this possible?
Arne
  • 2,624
  • 3
  • 24
  • 45
2
votes
2 answers

Spring Batch: Horizontal scaling of Job Repository

I read a lot about how to enable parallel processing and chunking of an individual job, using Master/Slave paradigm. Consider an already implemented Spring Batch solution that was intended to run on a standalone server. With minimal refactoring I…
maple_shaft
  • 10,435
  • 6
  • 46
  • 74
2
votes
0 answers

How to create a spring-batch job that orchestrates external work across multiple systems?

I have a scenario that I think is just outside the scope of spring-batch, but would like to explain my case and see if anyone has any ideas. I have a batch workflow like this: Load flat file into database Send message to another system to start…
steve_ash
  • 1,184
  • 1
  • 10
  • 16
2
votes
1 answer

Validate huge xml file aganist xsd without loading entire file into memory

I had gone through the posts on validating huge xml files but all of those talks about 250MB(Max) file size. File size is approximately 10GB. I currently have a tasklet to validate the xml which is using XmlValidator to validate the xml file…
Jay
  • 429
  • 2
  • 8
  • 23
2
votes
1 answer

'http://www.springframework.org/schema/batch/spring-batch-2.2.xsd', because the root element of the document is not

While starting my application am getting the following Error. WARNING: Ignored XML validation warning org.xml.sax.SAXParseException; lineNumber: 13; columnNumber: 77; schema_reference.4: Failed to read schema document…
manohar reddy
  • 39
  • 1
  • 8
2
votes
0 answers

Is there a predefined library supporting all use cases for AWS SWF deciders

In Amazon SWF the decider has to be implemented by the developer and has to write the code to support all use cases. I need to implement a workflow architecture which can support execution of tasks in sequential, branching, parallel. Is there a…
Swaroop Kumar
  • 113
  • 1
  • 5
2
votes
2 answers

Best way to access StepExecution/JobExecution in ItemReader/Processor/Writer

I've been using SpringBatch for a few months now.. I used to store execution-related variables(like page count, item count, current position of a batch and so on) into Beans. Then those beans are mounted onto ItemReader, ItemProcessor, ItemWriter by…
wokmi
  • 71
  • 1
  • 2
  • 4
2
votes
1 answer

Reading excel file columns based on header in Spring Batch

We have requirement to read the huge excel file in java. I am prefering Spring Batch for same ,as we have spring already in project. However, we have one bottleneck that this excel file can have different columns, user can change the order of…
Panther
  • 3,312
  • 9
  • 27
  • 50
2
votes
1 answer

How to use @Value in a constructor?

I want to inject a string into a bean using constructor injection. Basically I have the following class: @Component @StepScope public class MyClass { public MyClass (@Value("#{jobParameters['directory']}") final String directory) { //…
stevecross
  • 5,588
  • 7
  • 47
  • 85
2
votes
1 answer

Which is best for bulk XML data processing? Spring Batch or ETL kettle pentaho?

I want to process bulk amount of XML data and saves it into database. Which is the best option. Spring batch kettle pentaho? I have some checkpoints. Tool is good when schema is known Supports Parallel execution, multiple sessions and error…
Anuraj
  • 2,551
  • 21
  • 26
2
votes
2 answers

MultiresourceItemReader using Annotation

2015-11-24 15:56:32,512 [main] ERROR org.springframework.batch.core.step.AbstractStep:229[execute] - Encountered an error executing step multiThreadedStep in job extractJob java.lang.IllegalStateException: No resources to read. Set strict=false if…
Madhav Mishra
  • 21
  • 2
2
votes
1 answer

Entities not persisting. Are RepositoryItemWriter & SimpleJpaWriter thread-safe?

I have encountered an odd issue with a RepositoryItemWriter, where it does not appear to be persisting entities correctly through my configured Spring Data JPA repository to the data source. Step configuration @Bean public Step…
delewis
  • 131
  • 1
  • 8
2
votes
1 answer

Shutting down spring batch jobs gracefully in tomcat

We run several spring batch jobs within tomcat in the same web application that serves up our UI. Lately we have been adding many more jobs and we are noticing that when we patch our app, several jobs may get stuck in a STARTING or STARTED status.…
Josh Chappelle
  • 1,558
  • 2
  • 15
  • 37
2
votes
1 answer

profiles in spring batch

I am trying to understand how to use @profiles in spring-batch. I created a java file with two classes in it: @Configuration @Profile("nonlocal") class NonLocalConfiguration { } and @Configuration @Profile("local") class LocalConfiguration { } in…
user3379502
  • 223
  • 4
  • 22
2
votes
3 answers

Parsing several csv files using Spring Batch

I need to parse several csv files from a given folder. As each csv has different columns, there are separate tables in DB for each csv. I need to know Does spring batch provide any mechanism which scans through the given folder and then I can pass…
dazzle
  • 1,346
  • 2
  • 17
  • 29
1 2 3
…
99
100