0

I am trying to upgrade Hadoop from 1.1.2 to 2.9.0

I had executed the command start-dfs.sh -upgrade on hadoop 2.9.0 cluster.

It shows that upgrade is in process and not yet finalized. I have been waiting for long but still showing the same status.

How to track the status of upgrade process?

sparkitny
  • 1,503
  • 4
  • 18
  • 23
  • Look at /var/log? Or a logs folder in `HADOOP_HOME`? Personally, I would have stood up a separate cluster entirely with new versions, then copied over datanodes using distcp and whatever else like Hive and Hbase tables – OneCricketeer Mar 21 '18 at 13:13
  • Finalizing upgrade is separate process that should be invoked manually after you confirm that data migration went well. https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/HdfsUserGuide.html#Upgrade_and_Rollback – Luk Mar 21 '18 at 13:54
  • @cricket_007 I have checked in /var/logs as well as logs file but couldnt find appropriate information. Is there any command to check the status of upgrade? – Jon Andrews Mar 22 '18 at 04:56
  • Not that I know of. I've always used Ambari or Cloudera Manager to do an upgrade – OneCricketeer Mar 22 '18 at 12:54
  • @cricket_007 How should I safegaurd the metadata. Should I take a backup of metadata before the upgrade process – Jon Andrews Apr 04 '18 at 09:56
  • Namenode metadata? Snapshot the fsimage? – OneCricketeer Apr 04 '18 at 12:59
  • Namenode metadata – Jon Andrews Apr 05 '18 at 06:51

0 Answers0