As I am new to talend, I am trying to connect my local delta lake with talend to do some data profiling on it.
Asked
Active
Viewed 96 times
0
-
and what problem are you having? – Nick.Mc Jul 16 '22 at 08:13
-
As I am new to it I don't know how to begin with it, means I have create a local delta lake with spark so what's next? – khÜs h Jul 16 '22 at 09:24
-
1So you have a delta lake built on some storage platform - what is that platform? So have you looked in the Talend documentation about how to connect to that storage platform? – NickW Jul 16 '22 at 10:39
-
I simply made a spark data-frame, and stored it locally on my PC using format as delta, so they are being saved as parquet files. @NickW – khÜs h Jul 16 '22 at 10:51
-
So you connect Talend to your parquet file(s) - what is the question/issue? – NickW Jul 16 '22 at 11:12
-
1I typed `talend parquet input` into gppgle and got this https://help.talend.com/r/en-US/8.0/parquet/tfileinputparquet. Why don't you try this and come back with a specific problem. – Nick.Mc Jul 17 '22 at 11:46
-
Thanks Nick, surely with check it out! – khÜs h Jul 18 '22 at 05:01