-1

I was downloading twitter data using flume into hdfs. Though i have data more than 2 GB, my chunk file splits are less than 64MB. i.e. 1st file with 300KB,2nd File - 566 KB. Why is that happening?

Sakthi
  • 113
  • 1
  • 5

1 Answers1

0

That is because of your flume configuration.

read this, you will have to set hdfs.rollInterval or hdfs.rollSize

vishnu viswanath
  • 3,794
  • 2
  • 36
  • 47