0

for the following query, both Hive and Spark-SQL work fine,

but the result returned by Presto (hive connector ) has wrong encoding/decoding.

Wonders how should I set the hive connector, or presto doesn't support reading zstd?

  • hive table:

    CREATE TABLE mydb.testtb (
      mid varchar COMMENT 'mid',
      day varchar
    )
    WITH (
        external_location = 'hdfs://userx/mydb/testtb/
        format = 'TEXTFILE',
        partitioned_by = ARRAY['day']
    )
    
  • files pointing to the HDFS are written using zstd compression like

    .../testtb/day=20221113/part-00020-63c1xxxxx000.zst

  • SQL

    select * from mydb.testtb where day=20221113 limit 5

result of presto enter image description here

AppleCEO
  • 63
  • 7

0 Answers0