How can we exclude some data nodes only from one namespace in hdfs federation?

Question

I was checking the hadoop federation. Here the data nodes are common, only namespace will be different. How can we exclude some datanodes only from one namespace.

score 0 · Answer 1 · answered Nov 13 '18 at 14:56

0

In decommissioning the nodes that need to be decommissioned are added to the exclude file at all of the Namenodes. Each Namenode decommissions its Block Pool. When all the Namenodes finish decommissioning a Datanode, the Datanode is considered decommissioned.

For more details, you can have a look at: https://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-hdfs/Federation.html#Decommissioning

answered Nov 13 '18 at 14:56

Vin

515
3
17

Dear Vin, as i mentioned i want to remove a datanode from only one of the namenode not from both. – Rahul Nov 13 '18 at 20:09
@Rahul As per my understanding, you can't do that because either that data node will be connected to the cluster or not. And if it is there in the cluster it should get updated in each namespace otherwise it violates the data integrity – Vin Nov 13 '18 at 20:36

score 0 · Answer 2 · edited Mar 19 '20 at 07:51

0

You can just decommissioning a DataNode from one of the Namespace.

edited Mar 19 '20 at 07:51

סטנלי גרונן

2,917
23
46
68

answered Mar 19 '20 at 07:20

yongtao liao

1

How can we exclude some data nodes only from one namespace in hdfs federation?

2 Answers2