hdfs jmxget与hdfs fsck

rn0zuynd  于 2021-05-29  发布在  Hadoop
关注(0)|答案(1)|浏览(607)

我有两个namenodes和几个datanode,但是今天我看到了一些损坏的块。
尴尬的是:

hdfs jmxget -server namenode02 -port 8006 | grep  CorruptBlocks

CorruptBlocks=27

当我和你核实后 hdfs fsck / ,我有:

Total size:    734930879995888 B (Total open files size: 537967073 B)
 Total dirs:    1501316
 Total files:   113743394
 Total symlinks:                0 (Files currently being written: 137)
 Total blocks (validated):      109063040 (avg. block size 6738587 B) (Total open file blocks (not validated): 133)
 Minimally replicated blocks:   109063040 (100.00001 %)
 Over-replicated blocks:        0 (0.0 %)
 Under-replicated blocks:       0 (0.0 %)
 Mis-replicated blocks:         0 (0.0 %)
 Default replication factor:    3
 Average block replication:     3.001944
 Corrupt blocks:                0
 Missing replicas:              0 (0.0 %)
 Number of data-nodes:          103
 Number of racks:               1
FSCK ended at Mon Feb 12 10:09:10 CET 2018 in 1608344 milliseconds

所以对于fsck来说没有什么不好的地方。这张支票是怎么开的?
提前谢谢!

3gtaxfhh

3gtaxfhh1#

对于hdfs jmx命令,我们有来自hadoop的块的整体状态,看起来很少有块可能被损坏(不知道原因)。对于fsck命令,我们有文件的状态,由于设置了副本号,这些文件是安全的。总之这是正常的行为,这里没有异常。

相关问题