1

How to pass hive conf parameter with Sqoop import job.

SET hive.tez.container.size=4096 

I am using this hive conf from hive cli every time.

leftjoin
  • 36,950
  • 8
  • 57
  • 116
A.james
  • 27
  • 4

2 Answers2

1

Use -D hive.tez.container.size=4096 option in sqoop command line (you can add many -D options):

sqoop import -Dhive.tez.container.size=4096 -Dsomething_else -Dmapreduce.map.java.opts=-Xmx4096m ... other parameters
leftjoin
  • 36,950
  • 8
  • 57
  • 116
1
<command>[SQOOP-COMMAND]</command>
<arg>[SQOOP-ARGUMENT]</arg>
<file>lib/hive-site.xml</file>
Amardeep Flora
  • 1,255
  • 6
  • 13
  • 29
  • The community encourages adding explanations alongisde code, rather than purely code-based answers (see [here](https://meta.stackoverflow.com/questions/300837/what-comment-should-i-add-to-code-only-answers)). – costaparas Feb 08 '21 at 05:24