0

I translate hive sql on AWS to pyspark sql on azure synapse.

There is some hive virtual columns in SQL, I want convert to pyspark sql on azure synapse.

How can I replace those columns?

reference of hive virtual columns : https://cwiki.apache.org/confluence/display/Hive/LanguageManual+VirtualColumns

-- hive sql on AWS
insert into table log_table
select
    INPUT__FILE__NAME as file_nm
    , BLOCK__OFFSET__INSIDE__FILE as file_location
    , col1
from my_table
wiz
  • 43
  • 7

0 Answers0