I translate hive sql on AWS to pyspark sql on azure synapse.
There is some hive virtual columns in SQL, I want convert to pyspark sql on azure synapse.
How can I replace those columns?
reference of hive virtual columns : https://cwiki.apache.org/confluence/display/Hive/LanguageManual+VirtualColumns
-- hive sql on AWS
insert into table log_table
select
INPUT__FILE__NAME as file_nm
, BLOCK__OFFSET__INSIDE__FILE as file_location
, col1
from my_table