0

Is it possible to read hive table (or HDFS data in parquet format) in Streamsets Data collector? I don't want to use Transformer for this.

James Z
  • 12,209
  • 10
  • 24
  • 44

1 Answers1

0

Reading the raw files in parquet is counter to the way that data collector works so that would be a better use case for transformer.

But I have successfully used the jdbc origin either from Impala or hive to achieve this, there are some additional hurdles to jump with the jdbc source.

shaine
  • 549
  • 5
  • 12