Is there any params for setting 'Application Priority'?

Question

I am looking for a way to set application priority for task in hive. When task is committed, I want to set a high priority (like 100) to it. this param can be seen on page: I am looking for a param like 'set mapreduce.map.memory.mb=4096;',so I can set priority for this task.

leftjoin · Answer 1 · 2019-04-15T11:07:15.897

2

In hive session, also it is possible to set the same property in map-reduce program configuration:

SET mapreduce.job.priority=VERY_HIGH;

For the job_id:

 hadoop job -set-priority <job-id> <priority>

There are five possible priority levels:

VERY_HIGH
HIGH
NORMAL
LOW
VERY_LOW

Queue priority configuration: https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/CapacityScheduler.html#Setup_for_application_priority.

edited Apr 15 '19 at 11:07

answered Apr 15 '19 at 10:54

leftjoin

36,950
8
57
116

Is it possible to change the priority after the job was submitted by doing `hadoop job -set-priority `? – Memphis Meng Jul 20 '22 at 15:46
1

@MemphisMeng Yes, it works for already running jobs – leftjoin Jul 20 '22 at 15:57

Is there any params for setting 'Application Priority'?

1 Answers1