Stack Overflow
Stack Overflow

Questions tagged [hawq]

This tag is for questions about Pivotal HAWQ, a SQL on Hadoop implementation

Pivotal HAWQ supports low-latency analytic SQL queries, coupled with massively parallel machine learning capabilities, to shorten data-driven innovation cycles for the enterprise. HAWQ enables discovery-based analysis of large data sets and rapid, iterative development of data analytics applications that apply deep machine learning. It reads data from and writes data to HDFS natively. Using HAWQ functionality, you can interact with petabyte range data sets. HAWQ provides users with a complete, standards-compliant SQL interface to Hadoop.

Homepage

Official Documentation

126 questions
1
vote
1 answer

Hadoop - Hawq - Add new segment

I installed hawq on Hadoop using ambari. in the installation step , I chose the Hawq master host with 2 segments , and all was working fine. then later, I added a new hawq segment using ambari , installation process went smoothly with no…
Ali Taher
  • 11
  • 3
1
vote
2 answers

Is HAWQ not support SQL in the cycle(while or for,use plpgsql)？

Today,I defined a function,using the insert statements in a loop. But HAWQ returned an error: ERROR: could not serialize unrecognized node type: 43983632 (outfast.c:4742) CONTEXT: SQL statement "insert into t(id,value) values(1,0.1)" PL/pgSQL…
Songjs
  • 13
  • 2
1
vote
1 answer

PostgreSQL error when extracting table data via JDBC from Spark

I had the Spark to HAWQ JDBC connection working, but now two days later there's an issue with extracting data from a table. Nothing's changed on the Spark configuration... Simple step #1 - printing the schema from a simple table in HAWQ I can create…
WaveRider
  • 475
  • 4
  • 10
1
vote
1 answer

How to connect to Pivotal HD (from Spark)?

I'm wondering about the ways to connect a Spark app to Pivotal HD, a Hadoop implementation. What is the best way to connect to it using Spark? val jdbcDataFrame = sqlContext.read.format("jdbc").options( Map("url" -> "jdbc:postgresql:dbserver",…
BAR
  • 15,909
  • 27
  • 97
  • 185
1
vote
1 answer

Data as a service using pivotal HAWQ

We have a requirement,where we need to provide data of HAWQ as a restful API to many consumers such as mobile app, web app etc in JSON format with web service security ;basically Data as a service to different applications from data lake. Can you…
nilesh1212
  • 1,561
  • 2
  • 26
  • 60
1
vote
1 answer

What is the best way to integrate SAS with Hadoop without losing the parallel processing capacity of Hadoop

I am trying to understand the integration between SAS and Hadoop. From what I understand, SAS processes like proc sql can only work against a SAS data set, I cannot issue proc sql against a text file on a hadoop node. Is it correct? If yes, then…
Victor
  • 16,609
  • 71
  • 229
  • 409
1
vote
2 answers

HAWQ returns different output for same sql when optimizer parameter is changed (ON/OFF)

Came across a strange behavior while working on GreenPlum HAWQ 1.1.3. Wanted to execute a simple exists query but was getting the wrong result. gpadmin=# select version(); version …
ank0811
  • 11
  • 3
1
vote
2 answers

How to push data from HAWQ into GREENPLUM?

I have this erratic client who wants to push data from HAWQ to GREENPLUM after some pre processing. Is there any way to do this? If not, Is it possible to create an external table in greenplum that reads it from the HDFS in which HAWQ is running?…
Jones
  • 379
  • 3
  • 9
  • 23
0
votes
1 answer

Compile error when I install HAWQ on Centos7:

I want to install HAWQ on my Centos7.5 When I run: ./configure and make -j8 I got this one: g++ --shared -o cwrapper.o cwrapper.cpp -Lformat -lorc_format /usr/bin/ld: /tmp/ccjv719I.o: relocation R_X86_64_PC32 against symbol `_Z9func_testv' can not…
Accept
  • 1
0
votes
0 answers

what are the Hadoop requirements for hawq 2.4

Using HAWQ 2.2 with HDP 2.5.3 on Centos 7.3. Planing to upgrade to new HAWQ version 2.4. What are the requirements for HAWQ 2.4?
Timo Burmeister
  • 1
  • 1
0
votes
1 answer

why HAWQ Initialization error sync hawq-site.xml failed

the apache-hawq-src-2.3.0.0 ,build form source. install is sucessfuly.but when I init hawq, like this "bin/hawq init master", 20180830:13:44:15:084023 hawq_init:office-hadoop02:web-[INFO]:-Check: hawq_master_address_host is set…
larry
  • 1
  • 1
0
votes
1 answer

HAWQ installation error

I am not able to install Hawq even after following the steps on HAWQ website , for reference : https://github.com/apache/incubator-hawq I am getting this error when i run : ./configure --without-readline checking how to run the C++ preprocessor...…
Anmol Rastogi
  • 1
  • 1
0
votes
1 answer

verify whether an id passes through all stages

id current stage previous stages 1 06 05 1 06 03 2 04 03 2 04 02 suppose there are 5 stages of an id.(02,03 etc) An id should goes through each of the stages. Here in…
umakant
  • 49
  • 10
0
votes
1 answer

Is it possible to collocate similar data on the same segment in Greenplum?

Suppose I have 12 segments in my system, then suppose I create a table where I distribute by a column based on month of the year. Now suppose I have a second table and I do likewise with that table, simply using a create statement with DISTRIBUTED…
MattB
  • 2,203
  • 5
  • 26
  • 48
0
votes
0 answers

HAWQ - Error while querying external HDFS table (PXF)

I have a problem with PXF and external table in HAWQ. I have seven data nodes in cluster (and seven HAWQ segments) and I installed PXF on each of them. I created table based on "Test PXF" on this site. Create table statement: CREATE EXTERNAL TABLE…
Mrgr8m4
  • 477
  • 3
  • 9
  • 29
1 2
3
…
8 9