spark jdbc edit insert statement

Asked Mar 15 '18 at 13:16

Active Mar 15 '18 at 15:57

Viewed 534 times

Is it possible to inject parameter into spark JDBC insert statement?

I'm using

spark.sql("select * from my_table ").write.mode(SaveMode.Append).jdbc

for saving bulk dataframe to my DB.

In JdbcUtils the insertStatement is created.

Is it possible ( without creating my own JDBC connections and statements) to add a parameter like "abort on error" into the statement?

edited Mar 15 '18 at 15:57

Lokesh Yadav

asked Mar 15 '18 at 13:16

Arnon Rodman

Can you please elaborate more on the parameter that you wish to add. What is its purpose? – Lokesh Yadav Mar 15 '18 at 13:24
for example "ABORT ON ERROR DIRECT" command : "insert into table ... ABORT ON ERROR" ; – Arnon Rodman Mar 19 '18 at 07:04

0 Answers0