To be used for questions related Hive configuration properties.
Official documentation: Hive configuration properties
Questions tagged [hive-configuration]
44 questions
2
votes
1 answer
why do need to set propties for Dynamic partition in hive
I would like to know one thing in hive dynamic partition. While doing dynamic partitions we have to set following properties
SET hive.exec.dynamic.partition = true;
SET hive.exec.dynamic.partition.mode = nonstrict;
Without those properties we…
nanda kumar
- 21
- 3
2
votes
1 answer
Is there any params for setting 'Application Priority'?
I am looking for a way to set application priority for task in hive. When task is committed, I want to set a high priority (like 100) to it. this param can be seen on page:
I am looking for a param like 'set mapreduce.map.memory.mb=4096;',so I can…
Z.Lun
- 247
- 1
- 2
- 20
2
votes
1 answer
Hive: Merging Configuration Settings not working
On Hive 2.2.0, I am filling an orc table from another source table of size 1.34 GB, using the query
INSERT INTO TABLE TableOrc SELECT * FROM Table; ---- (1)
The query creates TableORC table with 6 orc files, which are much smaller than the block…
Lawan subba
- 610
- 3
- 7
- 19
2
votes
1 answer
Can hiveconf variables be loaded from a file? (Separate from the HiveQL file)
I often have a large block of HiveQL that I want to run multiple times with different settings for some variables.
A simple example would be:
set mindate='2015-01-01 00:00:00'
set maxdate='2015-04-01 00:00:00'
select * from my_table where the_date…
Corey
- 1,845
- 1
- 12
- 23
1
vote
1 answer
Hive count(1) leads to oom
I have a new cluster built by cdh 6.3, hive is ready now and 3 nodes have 30GB memory.
I create a target hive table stored as parquet. I put some parquet files downloaded from another cluster to the HDFS directory of this hive table, and when I…
user2894829
- 775
- 1
- 6
- 26
1
vote
0 answers
hadoop.tmp.dir dont work in right location
In my core-site.xml, I changed the hadoop.tmp.dir location in another big HHD (/data/hadoop_tmp), this HHD is not linux /tmp location, then formatted my namenode, started my dfs and yarn, I believe it worked.
But the default location appears in the…
Caption
- 9
- 1
1
vote
2 answers
How to pass Hive conf with sqoop job
How to pass hive conf parameter with Sqoop import job.
SET hive.tez.container.size=4096
I am using this hive conf from hive cli every time.
A.james
- 27
- 4
1
vote
1 answer
how to remove ADD jar statement in the start of beeline
How can I remove statement that happened when beeline terminal start?
I have AD jar statement by default when I start beeline and I don't have this jar which case error message :
ADD JAR…
Omer Anisfeld
- 1,236
- 12
- 28
1
vote
1 answer
Does msck repair trigger table statistics generation
i would like to know whether running msck repair on table will generate table statistics for CBO when:
hive.cbo.enable=true
hive.stats.autogather=true
or do i have to use analyze
