how to get readSkipCount from Step Execution in itemProcessor/itemWriter?

Question

am currently reading csv files with spring batch into objects where i have to save total lines as well as rejected/skipped lines of that current file ,and using StepExecutionListener didn't work since i need to get it before the step ends and not after the step . is there a way i can get them to be saved in itemProcessor or itemWriter without having to add another step?

Answer 1

i need to get it before the step ends and not after the step

You can't get the total number of lines without going until the end of the step (ie reading the entire file).

using StepExecutionListener didn't work

Using a step execution listener is the way to go. You did not share your code to see why this didn't work for you, but here is a quick example:

import java.util.Arrays;

import org.springframework.batch.core.ExitStatus;
import org.springframework.batch.core.Job;
import org.springframework.batch.core.JobParameters;
import org.springframework.batch.core.StepExecution;
import org.springframework.batch.core.StepExecutionListener;
import org.springframework.batch.core.configuration.annotation.EnableBatchProcessing;
import org.springframework.batch.core.configuration.annotation.JobBuilderFactory;
import org.springframework.batch.core.configuration.annotation.StepBuilderFactory;
import org.springframework.batch.core.launch.JobLauncher;
import org.springframework.batch.item.ItemProcessor;
import org.springframework.batch.item.support.ListItemReader;
import org.springframework.context.ApplicationContext;
import org.springframework.context.annotation.AnnotationConfigApplicationContext;
import org.springframework.context.annotation.Bean;
import org.springframework.context.annotation.Configuration;

@Configuration
@EnableBatchProcessing
public class MyJobConfiguration {

    @Bean
    public Job job(JobBuilderFactory jobs, StepBuilderFactory steps) {
        return jobs.get("myJob")
                .start(steps.get("myStep")
                        .<Integer, Integer>chunk(2)
                        .reader(new ListItemReader<>(Arrays.asList(1, 2, 3, 4)))
                        .processor((ItemProcessor<Integer, Integer>) item -> {
                            if (item % 2 != 0) {
                                throw new Exception("No odd numbers here!");
                            }
                            return item;
                        })
                        .writer(items -> items.forEach(System.out::println))
                        .faultTolerant()
                        .skip(Exception.class)
                        .skipLimit(5)
                        .listener(new StepExecutionListener() {
                            @Override
                            public void beforeStep(StepExecution stepExecution) {
                                System.out.println("Starting step " + stepExecution.getStepName());
                            }

                            @Override
                            public ExitStatus afterStep(StepExecution stepExecution) {
                                System.out.println("Step "+ stepExecution.getStepName() + " is complete");
                                System.out.println("read.count = " + stepExecution.getReadCount());
                                System.out.println("write.count = " + stepExecution.getWriteCount());
                                System.out.println("skip.count = " + stepExecution.getSkipCount());
                                return stepExecution.getExitStatus();
                            }
                        })
                        .build())
                .build();
    }

    public static void main(String[] args) throws Exception {
        ApplicationContext context = new AnnotationConfigApplicationContext(MyJobConfiguration.class);
        JobLauncher jobLauncher = context.getBean(JobLauncher.class);
        Job job = context.getBean(Job.class);
        jobLauncher.run(job, new JobParameters());
    }

}

This prints:

Starting step myStep
2
4
Step myStep is complete
read.count = 4
write.count = 2
skip.count = 2