我使用(brew install hadoop)安装了hadoop。四个月来它一直正常运转。我意识到mapred-site.xml被配置为jobtracker。我改为Yarn和重新启动,然后我发现数据节点丢失。我重新安装了hadoop,发现了一些损坏的文件。我用fsck删除了那个文件。但名称节点仍将保持安全模式。我尝试了5次重新安装hadoop,也卸载了brew,再次安装了all fresh。我还是搞不清楚。任何帮助都将不胜感激。我这周有作业要完成。
日本
28723 SecondaryNameNode
33876 Jps
16309 NameNode
28504 NameNode
28856 ResourceManager
61292 JoveScala
32701 DataNode
28958 NodeManager
core-site.xml文件
<property>
<name>hadoop.tmp.dir</name>
<value>/usr/local/Cellar/hadoop/hdfs/tmp</value>
</property>
<property>
<name>fs.defaultFS</name>
<value>hdfs://localhost:9000</value>
</property>
hdfs-site.xml文件
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
mapred-site.xml文件
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
yarn-site.xml文件
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
bin/hdfs dfsadmin-报告
Safe mode is ON
Configured Capacity: 120124866560 (111.88 GB)
Present Capacity: 40319258624 (37.55 GB)
DFS Remaining: 40319250432 (37.55 GB)
DFS Used: 8192 (8 KB)
DFS Used%: 0.00%
Under replicated blocks: 0
Blocks with corrupt replicas: 0
Missing blocks: 0
Missing blocks (with replication factor 1): 26
-------------------------------------------------
Live datanodes (1):
Name: 127.0.0.1:50010 (localhost)
Hostname: 192.168.0.15
Decommission Status : Normal
Configured Capacity: 120124866560 (111.88 GB)
DFS Used: 8192 (8 KB)
Non DFS Used: 79805607936 (74.32 GB)
DFS Remaining: 40319250432 (37.55 GB)
DFS Used%: 0.00%
DFS Remaining%: 33.56%
Configured Cache Capacity: 0 (0 B)
Cache Used: 0 (0 B)
Cache Remaining: 0 (0 B)
Cache Used%: 100.00%
Cache Remaining%: 0.00%
Xceivers: 1
Last contact: Fri Jan 13 11:41:49 PST 2017
hdfs fsck/| egrep-v'^.+$'| grep-v eplica公司
Connecting to namenode via http://localhost:50070/fsckugi=krishnaprasad&path=%2F
FSCK started by krishnaprasad (auth:SIMPLE) from /127.0.0.1 for path / at Fri Jan 13 12:07:11 PST 2017
Status: HEALTHY
Total size: 0 B
Total dirs: 1
Total files: 0
Total symlinks: 0
Total blocks (validated): 0
Corrupt blocks: 0
Number of data-nodes: 1
Number of racks: 1
FSCK ended at Fri Jan 13 12:07:11 PST 2017 in 3 milliseconds
The filesystem under path '/' is HEALTHY
暂无答案!
目前还没有任何答案,快来回答吧!