Cannot create directory /home/hadoop/hadoopinfra/hdfs/namenode/current

Question

I get the error

Cannot create directory /home/hadoop/hadoopinfra/hdfs/namenode/current

While trying to install hadoop on my local Mac.

What could be the reason for this? Just for reference, I'm putting my xml files down below:

mapred-site.xml:

<configuration>

   <property> 
      <name>mapreduce.framework.name</name>
      <value>yarn</value>
   </property>
</configuration>

hdfs-site.xml:

<configuration>
    <property>
      <name>dfs.replication</name>
      <value>1</value>
    </property>

   <property>
      <name>dfs.name.dir</name>
      <value>file:///home/hadoop/hadoopinfra/hdfs/namenode </value>
   </property>

   <property>
      <name>dfs.data.dir</name> 
      <value>file:///home/hadoop/hadoopinfra/hdfs/datanode </value> 
   </property>
</configuration>

core-site.xml:

<configuration>
  <property>
    <name>hadoop.tmp.dir</name>
    <value>/usr/local/Cellar/hadoop/hdfs/tmp</value>
    <description>A base for other temporary directories.</description>
  </property>
  <property>
    <name>fs.default.name</name>
    <value>hdfs://localhost:9000</value>
  </property>
</configuration>

I think my problem lies in my hdfs-site.xml file, but I'm not sure how to pinpoint/change it.

I'm using this tutorial, and "hadoop" in the file path is replaced by my username.

check directory permissions – BruceWayne Feb 09 '16 at 04:12 — BruceWayne, Feb 09 '16 at 04:12

score 8 · Answer 1 · answered Apr 18 '18 at 04:41

Possible error: misconfiguration of the hdfs-site.xml file

This happened to me when I was following a setup tutorial. The contents of the hdfs-site.xml for me was

<configuration>
    <property>
            <name>dfs.namenode.name.dir</name>
            <value>/home/hadoop/data/nameNode</value>
    </property>

    <property>
            <name>dfs.datanode.data.dir</name>
            <value>/home/hadoop/data/dataNode</value>
    </property>

    <property>
            <name>dfs.replication</name>
            <value>1</value>
    </property>
</configuration>

Only then I realized that the text hadoop in the above file corresponds to the user name, where in my case, it had to replaced with hduser. When both occurrences of hadoop was replaced with hduser, the hdfs namenode -format command worked fine.

score 6 · Answer 2 · answered Jul 08 '17 at 20:37

6

I had this problem too and it was a permission problem. I just did:

sudo chmod 777 /home/hadoop/hadoopinfra/hdfs/namenode/

and works!

answered Jul 08 '17 at 20:37

Luiz Calaça

61
1
7

as a note, this is setting wide open permissions to the directory though. Not a good practice in a production environment, but it does solve the problem. Many thanks. – ProperVowel Mar 11 '18 at 17:22
1

Surely, it is not a good practice in a production environment. – Luiz Calaça Mar 12 '18 at 18:07
You could do this instead sudo chown username:username -R /path/to/hadoopNodes/namenode/ – sherminator35 Mar 22 '21 at 19:31

score 0 · Answer 3 · edited May 23 '17 at 12:31

0

In the step where you need to verify the hadoop installation, instead of 'hdfs namenode -format' use '/usr/local/hadoop/bin/hdfs namenode -format'

Found this answer from: hadoop java.io.IOException: while running namenode -format

edited May 23 '17 at 12:31

Community

1
1

answered Feb 29 '16 at 15:15

rodgersk410

1
1

score 0 · Answer 4 · answered Nov 28 '17 at 04:23

If you are not using any other distro than native hadoop, then add the current user to hadoop group and retry formatting the namenode.

sudo usermod -a -G hadoop <current-username>

In case of using thirdparty hadoop distros such Cloudera, Hortonworks or MapR, switch to root user and again switch to hdfs user then try formatting the namenode will succeed.

$ sudo -i 
$ su - hdfs
$ hdfs namenode -format

score 0 · Answer 5 · answered Sep 26 '20 at 11:17

0

Try the Hadoop command with sudo

answered Sep 26 '20 at 11:17

Riddhi Jain

41
1

Cannot create directory /home/hadoop/hadoopinfra/hdfs/namenode/current

5 Answers5

Linked