How to identify and fix Missing blocks reported by Ambari for the NameNode?

Question

Ambari is generating an alert NameNode Blocks Health: Total Blocks:[38252543], Missing Blocks:[2]. No further information.

I've run hdfs fsck / which is reporting the entire filesystem as healthy. I've run hdfs dfsadmin -report which reports that there are two missing blocks, but does not give details.

How do I find these missing blocks and thence fix them?

score 0 · Answer 1 · answered Jan 15 '18 at 19:59

0

I've observed a similar kind of reporting my setup today (CentOS 7.3, HDP 2.5.3, Ambari 2.4.2).

The files with missing blocks I were able to find via:

hdfs fsck / | grep -i 'miss' 
hdfs fsck / | grep 'miss' | cut -d ":" -f 1
hdfs fsck / | grep 'Under replicated' | cut -d ":" -f 1

and fixing them with:

hdfs dfs -setrep 3 <fileName>

answered Jan 15 '18 at 19:59

U880D

1,017
2
12
18

1

thank you. It's been a while but I believe I ended up running the same command to fix it. – Michael Martinez Jan 16 '18 at 20:43

score 0 · Answer 2 · edited Sep 12 '18 at 10:08

0

you can find no.of corrupted and missing blocks with below command

hdfs fsck -list-corruptfileblocks

edited Sep 12 '18 at 10:08

Thomas

4,225
5
23
28

answered Sep 12 '18 at 05:25

Anjireddy AR

1

How to identify and fix Missing blocks reported by Ambari for the NameNode?

2 Answers2