hbase.sh时发生ubuntu-hbase-fully-distributed hbase错误

50few1ms  于 2021-05-30  发布在  Hadoop
关注(0)|答案(2)|浏览(336)

我正在尝试以完全分布式模式配置hbase(使用ubuntu 12.04,apache hadoop 2.2(以伪模式运行,hbase版本0.98)下面是我的bashrc设置:

export HBASE_HOME=/usr/local/hbase
export PATH=$PATH:$HBASE_HOME/bin
export PATH=$PATH:$HBASE_HOME/sbin
export HADOOP_HOME=$HADOOP_HOME:$HBASE_HOME/conf

下面是我的/etc/host

192.168.72.12 namenode
192.168.72.12 master
192.168.72.12 regionserver1

hbase-site.xml是

<name>hbase.rootdir</name>
<value>hdfs://namenode:8020/hbase</value>
</property>
<property>
<name>hbase.defaults.for.version.skip</name>
<value>true</value>
</property>
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
</property>
<property>
<name>hbase.master</name>
<value>192.168.72.128:60000</value>
</property>

java\u home在hbase-env.sh中设置,hbase\u manages\u zk=true
hbase/conf中的文件regionservers包含

regionserver1

当hadoop cluster正在运行时,当我编写start-hbase.sh命令时,出现以下错误。。

localhost: starting zookeeper, logging to /usr/local/hbase/bin/../logs/hbase-hduser-zookeeper-ubuntu.out
starting master, logging to /usr/local/hbase/logs/hbase-hduser-master-ubuntu.out
localhost: starting regionserver, logging to /usr/local/hbase/bin/../logs/hbase-hduser-regionserver-ubuntu.out
regionserver1: ssh: Could not resolve hostname regionserver1: Name or service not known

# : ssh: Could not resolve hostname #: Name or service not known

我的ssh服务也在运行。请帮我找到解决办法。提前谢谢。
已编辑:(已添加regionserver日志文件的快照)

2014-12-13 18:49:12,080 INFO  [regionserver60020-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2014-12-13 18:49:12,081 WARN  [regionserver60020-SendThread(localhost:2181)] zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
    at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
2014-12-13 18:49:13,183 INFO  [regionserver60020-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2014-12-13 18:49:13,184 WARN  [regionserver60020-SendThread(localhost:2181)] zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
    at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
2014-12-13 18:49:14,114 INFO  [regionserver60020] ipc.RpcServer: Stopping server on 60020
2014-12-13 18:49:14,132 FATAL [regionserver60020] regionserver.HRegionServer: ABORTING region server ubuntu,60020,1418476720081: Initialization of RS failed.  Hence aborting RS.
java.io.IOException: Received the shutdown message while waiting.
    at org.apache.hadoop.hbase.regionserver.HRegionServer.blockAndCheckIfStopped(HRegionServer.java:776)
    at org.apache.hadoop.hbase.regionserver.HRegionServer.initializeZooKeeper(HRegionServer.java:725)
    at org.apache.hadoop.hbase.regionserver.HRegionServer.preRegistrationInitialization(HRegionServer.java:697)
    at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:830)
    at java.lang.Thread.run(Thread.java:744)
2014-12-13 18:49:14,133 FATAL [regionserver60020] regionserver.HRegionServer: RegionServer abort: loaded coprocessors are: []
2014-12-13 18:49:14,133 INFO  [regionserver60020] regionserver.HRegionServer: STOPPED: Initialization of RS failed.  Hence aborting RS.
2014-12-13 18:49:14,152 INFO  [regionserver60020] ipc.RpcServer: Stopping server on 60020
2014-12-13 18:49:14,154 INFO  [regionserver60020] regionserver.HRegionServer: Stopping infoServer
2014-12-13 18:49:14,188 INFO  [regionserver60020] mortbay.log: Stopped SelectChannelConnector@0.0.0.0:60030
2014-12-13 18:49:14,203 ERROR [main] regionserver.HRegionServerCommandLine: Region server exiting
java.lang.RuntimeException: HRegionServer Aborted
    at org.apache.hadoop.hbase.regionserver.HRegionServerCommandLine.start(HRegionServerCommandLine.java:66)
    at org.apache.hadoop.hbase.regionserver.HRegionServerCommandLine.run(HRegionServerCommandLine.java:85)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
    at org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126)
    at org.apache.hadoop.hbase.regionserver.HRegionServer.main(HRegionServer.java:2383)
2014-12-13 18:49:14,215 INFO  [Thread-9] regionserver.ShutdownHook: Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@61bdbb58
2014-12-13 18:49:14,220 INFO  [Thread-9] regionserver.HRegionServer: STOPPED: Shutdown hook
2014-12-13 18:49:14,224 INFO  [Thread-9] regionserver.ShutdownHook: Starting fs shutdown hook thread.
2014-12-13 18:49:14,229 INFO  [Thread-9] regionserver.ShutdownHook: Shutdown hook finished.
rn0zuynd

rn0zuynd1#

尝试使用cloudera CDH5 以及 Express Manager 分配。它是免费的,节省了很多时间。它完全支持ubuntu/debian系统。
我发现分布式集群的zookeeper/hdfs/hbase配置非常棘手。例如,您必须通过按正确的顺序重新启动服务来重新启动集群。例如,开始顺序如下: ZooKeeper > HDFS / YARN > HBase .
下面是我的成功案例:我不仅尝试使用hbase,还尝试使用impala、spark、ozzie、hive和hue来准备hadoop环境。此外,在我的情况下,hbase必须与 Phoenix 不是chd5一部分的模块。我已经成功使用单节点集群,手动生成。但我在集群配置中迷失了方向。。。我一直使用xml、主机名等。
在我决定花一些时间学习cloudera的发行版之后,我安装了cm5软件包,这些是 Cloudera Manager (即cm5)。接下来,我启动了web界面,并通过web界面安装了所有必需的deb包(是的,它安装了全套的包,如果您不需要它们,这会带来很大的开销)。就是这样!这是快速和自信。
接下来是配置。所有这些都是通过网络界面以及。您只需选择集群中涉及的主机,然后选择您需要的服务,例如hbase等等。在分配角色之后,cloudera管理器将启动集群。完成了。仅此而已。
这个软件还收集了许多最佳实践,如监视、配置版本控制、提示和技巧、软件更新等。更重要的是,它允许您非常快速地获得工作集群,之后您可以继续研究如何优化安装过程。
祝你好运!

zysjyyx4

zysjyyx42#

除了在/etc/hosts中添加主机名条目外,还需要在/etc/hostname中添加条目。
将条目添加到/etc/hostname,然后尝试ping regionserver1

相关问题