Questions tagged [spring-batch-tasklet]
135 questions
0
votes
0 answers
Is there a way find what are all the tables & records are updated in last 30mins in Oracle?
I am debugging a spring batch application that uses Oracle. I am seeing lot of tables getting modified by the spring batch Job. And also , it is very difficult to go through the code base to understand what are all the tables got modified.
Is there…
One Developer
- 99
- 5
- 43
- 103
0
votes
0 answers
Is it possible to pass large objects from one step to another in spring batch
The requirement is to pass large objects from one step to another in a conditional flow where we should be able to modify the objects data as well. According to the docs we can promote it to the job execution listener but from what I've read the…
sashank Rm
- 21
- 2
0
votes
0 answers
Spring Batch using JDBCCursorItemReader: Not pulling all records in specified Chunk Size
I have a situation where I am using Spring Batch framework with JdbcCursorItemReader approach.
The problem is my query takes longer duration which is close to 1.2 to 1.5 mins to process records (work is in progress to optimize).
Chunk size is set to…
Vikram Patil
- 1
- 2
0
votes
1 answer
Can I make Spring step to commit to db in first step before waiting next step?
Good day,
I have a Spring batch that using different step, the Job is something like follow:
@Bean
public Job myJob() throws Exception {
return jobBuilderFactory.get("MyJob").repository(batchConfiguration.jobRepository())
…
Panadol Chong
- 1,793
- 13
- 54
- 119
0
votes
0 answers
Spring Batch Transaction/connection and commit boundary Management at Chunk Level
Due to limitations of integrating with existing application we need to use a separate database connection per chunk and manage the commit boundary one commit at the end of chunk.
We designed to use remote partitioning and process multiple partitions…
Krishna Kishore
- 9
- 2
0
votes
2 answers
subquery in spring batch item reader
Let's say I have a person table. A person can have one to three products and it looks like this.
id person_id product price
1 person1 product3 1
2 person1 product2 2
3 person1 product1 10
4 person2 product1 11
5 …
troublemaker33
- 1
- 1
0
votes
1 answer
Spring batch - conditional step flow for Chunk model
I have two step where, step 2 should be skipped if the step 1 processor doesn't returned any item after filtration.
I see ItemListenerSupport can be extended and after process can be utilized.
@Override
public void afterProcess(NumberInfo item,…
user533544
- 43
- 1
- 10
0
votes
1 answer
Spring Batch Running duplicate steps(more than once) in a tasklet
Let's say I have following flow,
Start->Step1->Step2->Step3->Step2->End
I have created tasklets for each step and configured a Job as above.
When the job got triggered, the execution is fine till Step3 and it goes into a loop infinitely.
So is there…
0
votes
1 answer
Is there a way MySQLMaxValueIncrementer connects to multiple datasources in spring batch
I have 2 datasources in my project datasource1 connects to datahost1 and datasource2 connects to datahost 2. I have 2 jobs firing for datasource1 and datasource 2 , now the MySQLMaxValueIncrementer should connect to datasource1 to get next…
Bhaskar
- 1
0
votes
1 answer
Spring Batch multiple process for heavy load with multiple thread under every process
I have a scenario where I need to have roughly 50-60 different process running concurrently and executing a task.
Every process must fetch the data from DB using a sql query by passing a value and fetching data to be run against in the subsequent…
djyo02
- 27
- 1
- 11
0
votes
1 answer
In Spring Batch, how do we compare 2 flat files with different record layouts and throw error message when there is a inconsistency between them
Consider the below scenario, where I have 2 different CSV files with one common referential field. I want to read both the files and report an error if the file2 does not have the request-id similar to that of file1.
File1 is the primary file and…
Gaurav Nanilkar
- 1
- 1
0
votes
1 answer
How to run spring batch job in scheduled mode in 1 given UAT server, but run manual job in all 3 given UAT servers?
This is related to Spring Batch Scheduling Problem.
I have 3 UAT servers (UAT1, UAT2 & UAT3). The task is to run the scheduled batch job in UAT3 server only but while I run a batch job by manually hitting the endpoint url, it should run in all 3…
Ayan Chakraborty
- 1
- 1
0
votes
0 answers
What is the wrong in my integration flow and tasklet
This is my flows LS-GET(SFTP outbound gateway: download files from a remote SFTP server.)
and MessagingGateway.
@MessagingGateway
public interface IntegratedRemoteFileProcessMessagingGateway {
@Gateway(requestChannel =…
KiSong Kim
- 68
- 5
0
votes
1 answer
process different files using name with practitioner - Spring batch
**I am working on the Spring Batch that will read all CSV files from the folder and need to do different process based on file bame. The below code is working fine with one file(name) type. but the issue is I need to decide the step execution based…
Venkatesh Tech
- 1
- 1
0
votes
1 answer
How to add tasklet to run after each partition step completion in Spring Batch
I am new to Spring batch and implementing a spring batch job where it has to pull huge data set from DB and write to file. Below is the sample job config which is working as expected for me.
@Bean
public Job customDBReaderFileWriterJob() throws…
TechDan
- 37
- 5