-3

Using SAP BODS to load data to Snowflake it is taking a lot of time.

BODS job is simple source (HANA table) query then Target as Snowflake table.

Just to load 6 records with 10 columns it is taking more than half an hour.

I analyzed where most of the time is going in checking metadata data. I tried updating the ODBC driver to 2.24.0 still loading time is high.

Observe select/insert takes very less but searching metadata is very time consuming:

Observe select/insert takes very less but searching metadata is very time consuming

Sandra Rossi
  • 11,934
  • 5
  • 22
  • 48
Mahantesh Hiremath
  • 15
  • 4
  • Please fix your use of ALL CAPS, people think you are SHOUTING at them. – Solar Mike May 29 '22 at 07:41
  • Those Snowflake statements are taking a few seconds/milliseconds. Whatever is taking half an hour is not in Snowflake (or at least not in the statements you are showing) – NickW May 29 '22 at 11:11
  • ​ Finally able to reduce time by very minimum by setting CLIENT_METADATA_REQUEST_USE_CONNECTION_CTX='TRUE' But still, all the target table columns are checked in db.schema, which is unnecessary now trying to find the answer. – Mahantesh Hiremath Jun 09 '22 at 15:47

2 Answers2

0

You can also enable ODBC logging to check if there is any specific Driver call that is taking the extra amount of time.

Anshul Thakur
  • 484
  • 2
  • 5
0

​Finally able to reduce time by very minimum by setting

CLIENT_METADATA_REQUEST_USE_CONNECTION_CTX='TRUE'

But still, all the target table columns are checked in db.schema, which is unnecessary now trying to find the answer.

Mahantesh Hiremath
  • 15
  • 4