Multi threading in Spring Batch FlatFileItemReader and FlatFileItemWriter

Asked Oct 31 '16 at 17:16

Active Nov 03 '16 at 11:58

Viewed 1,102 times

My requirement is to read and write a text file with more than 50k lines so I want to implement it in spring batch,

I want it to multi threaded and each thread should handle 1k lines and write it to output file using FlatFileItemWriter
and also I want to read input and output file names from job parameters to configuration

So please help me on this

edited Nov 03 '16 at 11:58

Billal Begueradj

asked Oct 31 '16 at 17:16

abhishek varma

2

Can you share the code you've written so far? – naktinis Oct 31 '16 at 17:23
1

You can try Partitioner to handle your case. – Nghia Do Oct 31 '16 at 21:18
FlatFileItemWriter is not thread safe (as written is javadoc) – Luca Basso Ricci Nov 01 '16 at 10:54
For the first part you'll need to split the file up into multiple files, then finally read them using the MultiResourcePartitioner see http://stackoverflow.com/a/25022841 – Nov 03 '16 at 12:50

0 Answers0