4

I am doing some change to Yarn source code. I have changed hadoop.root.logger=DEBUG,console to DEBUG in ${HADOOP_HOME}/etc/hadoop/log4j.properties. I can get DEBUG information for Application Master, but I can't find any DEBUG information outputted in ${HADOOP_HOME}/logs/yarn-yar-resourcemanager-hostname.log. Is there any other place I should change to trigger DEBUG level for resourcemanager?

Jacek Laskowski
  • 72,696
  • 27
  • 242
  • 420
hakunami
  • 2,351
  • 4
  • 31
  • 50

5 Answers5

2

Quoting Setting debug log level for individual daemons:

Add -Dhadoop.root.logger=DEBUG to something like HADOOP_resourcemanager_opts in yarn-env.sh

Jacek Laskowski
  • 72,696
  • 27
  • 242
  • 420
Raju Shikha
  • 56
  • 3
2

etc/hadoop/hadoop-env.sh

search below line

export HADOOP_DAEMON_ROOT_LOGGER=INFO,RFA

for daemon, change INFO,RFA to DEBUG,RFA for interactive process, there is another default setting above, change it

Community
  • 1
  • 1
Eric A Ni
  • 23
  • 6
0

What worked for me is to add in yarn-env.sh

YARN_OPTS="$YARN_OPTS -Dhadoop.root.logger=${YARN_ROOT_LOGGER:-DEBUG,console}"
YARN_OPTS="$YARN_OPTS -Dyarn.root.logger=${YARN_ROOT_LOGGER:-DEBUG,console}"
jmarhuen
  • 91
  • 1
  • 2
0

For YARN daemons started using $HADOOP_HOME/sbin/yarn-daemon.sh, you should update the YARN_ROOT_LOGGER log level in that script.

erwaman
  • 3,307
  • 3
  • 28
  • 29
0

Try with. It should enabled yarn level debug logging.

export YARN_ROOT_LOGGER=DEBUG,RFA
shailesh gupta
  • 427
  • 1
  • 5
  • 14