I am stuck... At this moment I feel the need to ask the community to help out finding a solution to my problem which is as follows
I received a daily load of json files of a particular version containing raw data. My idea is to convert the json files to parquet using delta format. Followed by an external table on top of the delta lake to use it as a staging layer for my dedicated SQL Pool (DWH).
I noticed that this is not possible because I am using a dedicated SQL pool...
Is there somehow a way to use the power of delta lake with the simplicity of an external table in the context of a dedicated SQL Pool? I can not imagine that I am the only one having this dilemma.
Hopefully you could provide me with some ideas of alternatives?
Thank you very much in advance!
