I have been loading the data from cosmos DB to DWH Synapse using Synapse pipelines. I am able to load the data but it takes more time. For e.g. we are loading the data incrementally , so if there are no updates then it would be 0 rows read from cosmos. But then too it takes around 20 mins to load. When I go to monitor and go in execution in detail. I see 5s or 2 s in sink or in transformations. even if I calculate all the times it took , it is only 1 min max. Can anybody guide me how can I check where exactly I can check the timing and where it is the issue when it come to timing of execution. If it is issue reading from cosmos , then can I improve that ?
Because even though I increase DWUs or cores to max, even for 0 records it takes 20 mins only.
