1

I have requirement where need to install Apache HAWQ on top of Quantcast File System (QFS). As I understood Apache HAWQ is installed on top of HDFS. Suggestion / guidance please.

Mahesh
  • 243
  • 1
  • 5
  • 13

2 Answers2

0

Do you want to install Apache HAWQ on QFS ? AFAIK, apache hawq does not support QFS.

stanly
  • 190
  • 1
  • 11
0

It looks like QFS also does not support the HDFS API. HAWQ is currently dependent on libhdfs3, hence only filesystems compatible with that API stand a reasonable chance. There is an active JIRA for supporting "pluggable backends" in HAWQ, but it is likely a ways out.

You might be able to hack the master and segment installation a bit and expose data on QFS via an external table or a PL/Python function. If you decide to pursue this, please open a new JIRA and we can provide more tangible suggestions / example code.

Glorfindel
  • 21,988
  • 13
  • 81
  • 109
Kyle Dunn
  • 380
  • 1
  • 9