hadoop数据节点正在关闭,消息为“无法加载libhadoop”

41zrol4v  于 2021-06-01  发布在  Hadoop
关注(0)|答案(0)|浏览(553)

我正在尝试在新的从属服务器上启动datanode,以便将它们添加到一个活动的hadoop集群中。但无法使用命令hadoop-daemon.sh start datanode启动datanode
我已经手动创建了文件/var/lib/hadoop hdfs/dn\u socket,并更改了它的权限。我还查了图书馆,那里都有。
已检查与datanode关闭相关的其他问题,但无法解决问题。我得到的错误日志也不同,如下所示。
感谢您的帮助。

2018-11-22 13:31:03,485 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Starting DataNode with maxLockedMemory = 0
2018-11-22 13:31:03,512 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Opened streaming server at /0.0.0.0:50010
2018-11-22 13:31:03,515 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Balancing bandwidth is 10485760 bytes/s
2018-11-22 13:31:03,515 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Number threads for balancing is 50
2018-11-22 13:31:03,516 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: Exception in secureMain
java.lang.RuntimeException: Although a UNIX domain socket path is configured as /var/lib/hadoop-hdfs/dn_socket, we cannot start a loca
lDataXceiverServer because libhadoop cannot be loaded.
        at org.apache.hadoop.hdfs.server.datanode.DataNode.getDomainPeerServer(DataNode.java:1166)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.initDataXceiver(DataNode.java:1137)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:1369)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:495)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:2695)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:2598)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:2645)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:2789)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:2813)
2018-11-22 13:31:03,519 INFO org.apache.hadoop.util.ExitUtil: Exiting with status 1: java.lang.RuntimeException: Although a UNIX domai
n socket path is configured as /var/lib/hadoop-hdfs/dn_socket, we cannot start a localDataXceiverServer because libhadoop cannot be lo
aded.
2018-11-22 13:31:03,521 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down DataNode at HDP-slave-7/987.654.32.10

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题