for the following query, both Hive and Spark-SQL work fine,
but the result returned by Presto (hive connector ) has wrong encoding/decoding.
Wonders how should I set the hive connector, or presto doesn't support reading zstd?
hive table:
CREATE TABLE mydb.testtb ( mid varchar COMMENT 'mid', day varchar ) WITH ( external_location = 'hdfs://userx/mydb/testtb/ format = 'TEXTFILE', partitioned_by = ARRAY['day'] )
files pointing to the HDFS are written using
zstd
compression like.../testtb/day=20221113/part-00020-63c1xxxxx000.zst
SQL
select * from mydb.testtb where day=20221113 limit 5