I'm trying to use this connector to pull messages from Kafka and write them to HDFS. Works fine as long as the file doesn't already exist, but if it does then it throws a FileAlreadyExistsException. Is there a way to append to an already-existing file using this connector? I'm using an HdfsFlow.dataWithPassThrough flow, and it takes an HdfsWritingSettings, but that only allows you to set an overwrite boolean; there's no append option.
Asked
Active
Viewed 161 times
1
csjacobs24
- 775
- 6
- 13
-
1Please create a ticket - or even better a PR :) - for this feature in the alpakka issue tracker. – dvim Sep 22 '18 at 17:59
-
Thanks for the suggestion! https://github.com/akka/alpakka/issues/1236 – csjacobs24 Sep 25 '18 at 15:39