1

I check job history and view job logs in Hadoop UI. After cluster restart job history is clear.

Is there any setting to prevent log deletion? Due to my observations, hadoop UI just displays logs that are stored on cluster machines, so I suspect that there's a way to leave logs on cluster restart. Hadoop version is 2.4.0.

AdamSkywalker
  • 11,408
  • 3
  • 38
  • 76
  • does this suggestion to keep the logs for a longer time help you? http://stackoverflow.com/questions/19645557/hadoop-removes-mapreduce-history-when-it-is-restarted Another related post is: http://stackoverflow.com/questions/32713587/how-to-keep-yarns-log-files – vefthym Nov 15 '16 at 10:23
  • @vefthym first question seems similar, but I don't understand the answer. If counter starts from 1 after cluster restart, there seems no way to access old logs from web UI. – AdamSkywalker Nov 15 '16 at 10:48

0 Answers0