0

I have data located in structure s3n://bucket/{date}/{file}.gz with > 100 folders. How to setup streaming job and use all of them as input? Specifying s3n://bucket/ didn't help since nodes are folders.

varela
  • 1,281
  • 1
  • 10
  • 16

1 Answers1

0

Specify s3n://bucket/*/ as input and it should work fine.

Suman
  • 9,221
  • 5
  • 49
  • 62