jps提供空输出,没有一个hadoop守护进程以start-all.sh启动,hadoop psudo分布式模式,运行在64位windows操作系统上的32位vm

mefy6pfw  于 2021-05-29  发布在  Hadoop
关注(0)|答案(2)|浏览(254)

我正在尝试在64位操作系统之上运行的32位虚拟机上设置hadoop2.7.1,javaopenjdk7。我已经配置了这里提到的所有文件http://pingax.com/install-hadoop2-6-0-on-ubuntu/
即使运行start-dfs.sh或start-all.sh,也不会启动任何守护进程。
以下是start,jps命令的输出

hduser@ubuntu:~$ start-dfs.sh
16/04/22 00:33:14 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Starting namenodes on [localhost]
localhost: starting namenode, logging to /usr/local/hadoop/logs/hadoop-hduser-namenode-ubuntu.out
localhost: starting datanode, logging to /usr/local/hadoop/logs/hadoop-hduser-datanode-ubuntu.out
Starting secondary namenodes [0.0.0.0]
0.0.0.0: starting secondarynamenode, logging to /usr/local/hadoop/logs/hadoop-hduser-secondarynamenode-ubuntu.out
16/04/22 00:33:33 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
hduser@ubuntu:~$  jps
12147 Jps
hduser@ubuntu:~$

我似乎不明白原因。就警告而言,正如其他一些答案所指出的那样,它可以被忽略或抑制。
我进一步看到上面提到的调试文件的内容

hduser@ubuntu:~$ cat /usr/local/hadoop/logs/hadoop-hduser-namenode-ubuntu.out
OpenJDK Client VM warning: You have loaded library /usr/local/hadoop/lib/native/libhadoop.so.1.0.0 which might have disabled stack guard. The VM will try to fix the stack guard now.
It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.
         (kbytes, -m) unlimited
open files                      (-n) 1024
pipe size            (512 bytes, -p) 8
POSIX message queues     (bytes, -q) 819200
real-time priority              (-r) 0
stack size              (kbytes, -s) 8192
cpu time               (seconds, -t) unlimited
max user processes              (-u) 14869
virtual memory          (kbytes, -v) unlimited
file locks                      (-x) unlimited
hduser@ubuntu:~$

甚至在数据节点的日志文件中也给出了相同的错误。任何帮助都将不胜感激。。。
编辑:

https://chawlasumit.wordpress.com/2014/06/17/hadoop-java-hotspottm-execstack-warning/

正如我建议的那样,我做了一些更改,但这只会抑制日志中的错误,

hduser@ubuntu:~$ cat /usr/local/hadoop/logs/hadoop-hduser-namenode-ubuntu.out
ulimit -a for user hduser
core file size          (blocks, -c) 0
data seg size           (kbytes, -d) unlimited
scheduling priority             (-e) 0
file size               (blocks, -f) unlimited
pending signals                 (-i) 14869
max locked memory       (kbytes, -l) 64
max memory size         (kbytes, -m) unlimited
open files                      (-n) 1024
pipe size            (512 bytes, -p) 8
POSIX message queues     (bytes, -q) 819200
real-time priority              (-r) 0
stack size              (kbytes, -s) 8192
cpu time               (seconds, -t) unlimited
max user processes              (-u) 14869
virtual memory          (kbytes, -v) unlimited
file locks                      (-x) unlimited
bq9c1y66

bq9c1y661#

检查配置文件。确保.xml文件(尤其是核心站点.xml)的内容与此处相同。很少有网站有过时的教程,他们在core-site.xml文件中提到“fs.default.name”而不是“fs.defaultfs”。

mf98qq94

mf98qq942#

发生此问题的原因是1。您正在使用虚拟机2。64位主机3上的32位虚拟机。hadoop中的默认本机库是为32位构建的。
这里有一个看似合理的解决方案,虽然对我来说hadoop2.2.064位安装不起作用,但无法启动
但是当我使用这些步骤配置hadoop时(http://pingax.com/install-hadoop2-6-0-on-ubuntu/)不使用虚拟机直接在ubuntu机器上运行,工作正常:)
所以,如果你面对这个问题,那就试着在ubuntu物理机上运行。

相关问题