0

I am getting below Error while running my pipeline. Pipeline takes files from HDFS, Merges them and again stores the files on HDFS.

Error:

WARN Ignoring file 'Filename and Location' in spool directory as is lesser than offset file. Category : SpoolDirRunnable.

Kindly let me know the possible fix.

James Z
  • 12,209
  • 10
  • 24
  • 44
Rangan Roy
  • 71
  • 1
  • 1
  • 5

1 Answers1

0

This file probably was already processed by this pipeline. You can try to run the pipeline with "reset origin" option.

enter image description here

Andrey E
  • 856
  • 8
  • 18