Questions tagged [spring-batch-stream]
30 questions
0
votes
1 answer
In Spring Batch, linked with a ItemReader call I want to call a static util method to populate a string
I have a Spring Batch reader with following configurations.
This reader is reading from the database and and at a time its reading a page size records.
@Autowired
private SomeCreditRepot someCreditRepo;
public…
John Doe
- 2,752
- 5
- 40
- 58
0
votes
1 answer
How to resolve Input resource must exist (reader is in 'strict' mode) Spring Batch
I'm reading a file from AWS S3 using resourceLoader.getResource in my Spring Batch application but I'm getting the below exception:
Caused by: java.lang.IllegalStateException: Input resource must exist (reader is in 'strict' mode): class path…
Mike Marsh
- 387
- 3
- 15
0
votes
1 answer
How to read and perform batch processing using spring batch annotation config
I have 2 different file with different data. The file contains 10K record per day.
Ex:
Productname price date
T shirt,500,051221
Pant,1000,051221
Productname price date
T shirt,800,061221
Pant,1800,061221
I want to create final output file by…
Codinghubby
- 57
- 8
0
votes
1 answer
How to read the Files generating at remote location, process and move to another location by using spring batch?
Could anyone suggest the approach which I need to follow to achieve the below requirement?
Background:
There is a remote location for example "//severname/somefolder/somefile". Some files would be generating continuously for every second or minute…
Mahesh
- 133
- 1
- 3
- 16
0
votes
1 answer
Spring Batch: dynamic or rotate writer
I'm trying to make the next implementation.
Due to size reasons, I have to split my output file in, for example, 10k row chunks.
So, I need to dump 10k in file "out1.csv", the next 10k in file "out2.csv", and so on.
With one output file, the schema…
yaki_nuka
- 724
- 4
- 26
- 44
0
votes
1 answer
Spring Batch multiple process for heavy load with multiple thread under every process
I have a scenario where I need to have roughly 50-60 different process running concurrently and executing a task.
Every process must fetch the data from DB using a sql query by passing a value and fetching data to be run against in the subsequent…
djyo02
- 27
- 1
- 11
0
votes
0 answers
spring batch PatternMatchingCompositeTokenizer when there are more than 1 patterns
I have a file to read like below. A record is split into multiple lines.
Each record can have any number of lines; the only way to recognize a new record is when a line starts with "ABC" and there is another line with identifier ABC_SUB. Each line…
Teja
- 69
- 7
0
votes
1 answer
SCDF stream (time) NOT picking composed-task-runner in local
in SCDF (2.6.3) tried to create stream to launch composite task, but not picking, what am I missing?
Composed task created name as comp-task: AA && BB
I can run manually run this composed task, it executed both AA and BB and exit normally.
When I…
Santhosh HS
- 1
- 2
0
votes
0 answers
How to use SimpleBinaryBufferedReaderFactory in SpringBatch for reading data in bytes
I want to read data using SimpleBinaryBufferedReaderFactory, can anyone has any code snippet or link where i can understand the working.
I am skeptical on how to tell reader to when is the end of chunk. Like in case of text file there was endLine…
Vishal Singh
- 35
- 8
0
votes
0 answers
Not Reading bytes properly during FTP transfer in Spring Batch
I am doing a project where I have to efficiently transfer data(any file) from one endpoint(HTTP, FTP, SFTP) to other. I want to use springBatch concurrency and parallelism feature of Job. In my case, one file will be one job. So, I am Trying to read…
Vishal Singh
- 35
- 8
0
votes
1 answer
Can I use SpringBatch to transfer file(video/txt) present of http and read it and write it on my pc?
Right now i am trying to write an http file(sample:"https://www.w3.org/TR/PNG/iso_8859-1.txt") to my local pc using springBatch. But unable to read the file.
My Reader file is as follows:
public FlatFileItemReader reader(){
…
Vishal Singh
- 35
- 8
0
votes
1 answer
Spring batch: Why transaction is rolling back even if I catching the exception
I am using Spring Batch and my step configuration is as below:
@Bean
public Step testStep(
JdbcCursorItemReader testStageDataReader,
TestStepProcessor testStepProcessor,
CompositeItemWriter testWriter,
…
JDev
- 1,662
- 4
- 25
- 55
0
votes
1 answer
Spring Batch run fine for 1st run, but for 2nd and so on runs... it keeps failing why?
I am developing a Spring Boot + Spring-Batch example. The very first time I am able to successfully run the code, but for second run it gives me below error.
How can I resolve this?
Error:
java.lang.IllegalStateException: Failed to execute…
PAA
- 1
- 46
- 174
- 282
0
votes
1 answer
Spring Batch Stream restart issue?
I am developing Spring Boot + Batch Stream example. This is very basic example and giving erorr right after the 48th record? Any pointers? I've posted whole code.
Error:
java.lang.RuntimeException: The Ansdwer to the Ultimate Question of Life, the…
PAA
- 1
- 46
- 174
- 282
-2
votes
1 answer
Spring Batch Solution
1
In our application, we have around 100000 customers and need to process some data on monthly basis. Data processing logic for each customer involves, around 7 rest calls to different service. We need to do this in spring batch to achieve…
SHRIDHAR K
- 40
- 1
- 4