info org.apache.hadoop.service.abstractservice:service org.apache.hadoop.mapreduce.v2.hs.server.hsad minserver在初始化状态下失败;

4xrmg8kj  于 2021-05-29  发布在  Hadoop
关注(0)|答案(1)|浏览(355)
for i  don't know why the   Exception from container-launch: ExitCodeException exitCode=1;

[root@hadoop-senior hadoop-2.5.0]#bin/warn-jar jsrs/mr-worcount.jar/user/centos/mapreduce/wordcount/input/user/centos/mapreduce/wordcount/output4
17/01/11 04:24:14警告util.nativecodeloader:无法为您的平台加载本机hadoop库。。。在适用的情况下使用内置java类17/01/11 04:24:14 info client.rmproxy:连接到resourcemanager at/192.168.85.129:8032 17/01/11 04:24:15 warn mapreduce.jobsubmitter:未执行hadoop命令行选项解析。实现工具接口并使用toolrunner执行应用程序以解决此问题。17/01/11 04:24:15 warn mapreduce.jobsubmitter:未设置作业jar文件。可能找不到用户类。请参阅job或job#setjar(字符串)。11年1月17日04:24:15 info input.fileinputformat:要处理的总输入路径:1 11年1月17日04:24:15 info mapreduce.jobsubmitter:数量splits:1 17/01/11 04:24:16 info mapreduce.jobsubmitter:提交作业的令牌:job\u 1484121450974\u 0004 17/01/11 04:24:16 info mapred.yarnrunner:作业jar不存在。不向资源列表添加任何jar。11年1月17日04:24:16 info impl.yarclientimpl:提交的申请\u 1484121450974 \u 0004 11年1月17日04:24:16 info mapreduce.job:跟踪作业的url:http://hadoop-senior:8088/proxy/application\u 1484121450974\u 0004/17/01/11 04:24:16 info mapreduce.job:运行作业:job\u 1484121450974\u 0004 17/01/11 04:24:23 info mapreduce.job:作业作业\u 1484121450974 \u 0004在uber模式下运行:false 17/01/11 04:24:23 info mapreduce.job:map 0%reduce 0%17/01/11 04:24:26 info mapreduce.job:task id:attempt \u 1484121450974 \u 0004 \u m \u 0000000,状态:容器启动失败异常:exitcodeexception exitcode=1:exitcodeexception exitcode=1:at org.apache.hadoop.util.shell.runcommand(shell)。java:538)在org.apache.hadoop.util.shell.run(shell。java:455)在org.apache.hadoop.util.shell$shellcommandexecutor.execute(shell。java:702)在org.apache.hadoop.yarn.server.nodemanager.defaultcontainerexecutor.launchcontainer(defaultcontainerexecutor)。java:195)在org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.containerlaunch.call(containerlaunch。java:300)在org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.containerlaunch.call(containerlaunch。java:81)在java.util.concurrent.futuretask.run(futuretask。java:266)位于java.util.concurrent.threadpoolexecutor.runworker(threadpoolexecutor。java:1142)在java.util.concurrent.threadpoolexecutor$worker.run(threadpoolexecutor。java:617)在java.lang.thread.run(线程。java:745)

Container exited with a non-zero exit code 1

17/01/11 04:24:29 INFO mapreduce.Job: Task Id : attempt_1484121450974_0004_m_000000_1, Status : FAILED
Exception from container-launch: ExitCodeException exitCode=1: 
ExitCodeException exitCode=1: 
        at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
        at org.apache.hadoop.util.Shell.run(Shell.java:455)
        at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:702)
        at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:300)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:81)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)

Container exited with a non-zero exit code 1

17/01/11 04:24:33 INFO mapreduce.Job: Task Id : attempt_1484121450974_0004_m_000000_2, Status : FAILED
Exception from container-launch: ExitCodeException exitCode=1: 
ExitCodeException exitCode=1: 
        at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
        at org.apache.hadoop.util.Shell.run(Shell.java:455)
        at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:702)
        at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:300)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:81)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)

Container exited with a non-zero exit code 1

17/01/11 04:24:38 INFO mapreduce.Job:  map 100% reduce 100%
17/01/11 04:24:39 INFO mapreduce.Job: Job job_1484121450974_0004 failed with state FAILED due to: Task failed task_1484121450974_0004_m_000000
Job failed as tasks failed. failedMaps:1 failedReduces:0

17/01/11 04:24:39 INFO mapreduce.Job: Counters: 12
        Job Counters enter code here
                Failed map tasks=4
                Launched map tasks=4
                Other local map tasks=3
                Data-local map tasks=1
                Total time spent by all maps in occupied slots (ms)=4775
                Total time spent by all reduces in occupied slots (ms)=0
                Total time spent by all map tasks (ms)=4775
                Total vcore-seconds taken by all map tasks=4775
                Total megabyte-seconds taken by all map tasks=4889600
        Map-Reduce Framework
                CPU time spent (ms)=0
                Physical memory (bytes) snapshot=0
                Virtual memory (bytes) snapshot=0
0s7z1bwu

0s7z1bwu1#

this is logs
2017-01-09 22:53:40,282 INFO org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer: registered UNIX signal handlers for [TERM, H
UP, INT]
2017-01-09 22:53:42,975 WARN org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform.
.. using builtin-java classes where applicable
2017-01-09 22:53:43,299 INFO org.apache.hadoop.mapreduce.v2.hs.JobHistory: JobHistory Init
2017-01-09 22:53:43,790 INFO org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager: Waiting for FileSystem at hadoop-senior:80
20to be available
2017-01-09 22:54:13,805 INFO org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager: Waiting for FileSystem at hadoop-senior:80
20to be available
2017-01-09 22:54:43,819 INFO org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager: Waiting for FileSystem at hadoop-senior:80
20to be available
2017-01-09 22:55:13,828 INFO org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager: Waiting for FileSystem at hadoop-senior:80
20to be available
2017-01-09 22:55:43,835 INFO org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager: Waiting for FileSystem at hadoop-senior:80
20to be available
2017-01-09 22:56:13,846 INFO org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager: Waiting for FileSystem at hadoop-senior:80
20to be available
2017-01-09 22:56:43,858 INFO org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager: Waiting for FileSystem at hadoop-senior:80
20to be available
2017-01-09 22:57:13,865 INFO org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager: Waiting for FileSystem at hadoop-senior:80
20to be available
2017-01-09 22:57:44,312 INFO org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager: Initializing Existing Jobs...
2017-01-09 22:57:44,391 INFO org.apache.hadoop.mapreduce.v2.hs.CachedHistoryStorage: CachedHistoryStorage Init
2017-01-09 22:57:44,429 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockin
gQueue
2017-01-09 22:57:44,446 INFO org.apache.hadoop.service.AbstractService: Service org.apache.hadoop.mapreduce.v2.hs.server.HSAd
minServer failed in state INITED; cause: java.net.BindException: Problem binding to [0.0.0.0:10033] java.net.BindException: A
ddress already in use; For more details see:  http://wiki.apache.org/hadoop/BindException
java.net.BindException: Problem binding to [0.0.0.0:10033] java.net.BindException: Address already in use; For more details s
ee:  http://wiki.apache.org/hadoop/BindException
        at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:719)
        at org.apache.hadoop.ipc.Server.bind(Server.java:419)
        at org.apache.hadoop.ipc.Server$Listener.<init>(Server.java:561)
        at org.apache.hadoop.ipc.Server.<init>(Server.java:2166)
        at org.apache.hadoop.ipc.RPC$Server.<init>(RPC.java:897)
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server.<init>(ProtobufRpcEngine.java:505)
        at org.apache.hadoop.ipc.ProtobufRpcEngine.getServer(ProtobufRpcEngine.java:480)
        at org.apache.hadoop.ipc.RPC$Builder.build(RPC.java:742)
        at org.apache.hadoop.mapreduce.v2.hs.server.HSAdminServer.serviceInit(HSAdminServer.java:100)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
        at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
        at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.serviceInit(JobHistoryServer.java:142)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
        at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.launchJobHistoryServer(JobHistoryServer.java:219)
        at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.main(JobHistoryServer.java:229)
2017-01-09 22:57:44,449 INFO org.apache.hadoop.service.AbstractService: Service org.apache.hadoop.mapreduce.v2.hs.JobHistoryS
erver failed in state INITED; cause: org.apache.hadoop.service.ServiceStateException: java.net.BindException: Problem binding
 to [0.0.0.0:10033] java.net.BindException: Address already in use; For more details see:  http://wiki.apache.org/hadoop/Bind
Exception
org.apache.hadoop.service.ServiceStateException: java.net.BindException: Problem binding to [0.0.0.0:10033] java.net.BindExce
ption: Address already in use; For more details see:  http://wiki.apache.org/hadoop/BindException
        at org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:59)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:172)
        at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
        at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.serviceInit(JobHistoryServer.java:142)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
        at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.launchJobHistoryServer(JobHistoryServer.java:219)
        at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.main(JobHistoryServer.java:229)
Caused by: java.net.BindException: Problem binding to [0.0.0.0:10033] java.net.BindException: Address already in use; For mor
e details see:  http://wiki.apache.org/hadoop/BindException
        at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:719)
        at org.apache.hadoop.ipc.Server.bind(Server.java:419)
        at org.apache.hadoop.ipc.Server$Listener.<init>(Server.java:561)
        at org.apache.hadoop.ipc.Server.<init>(Server.java:2166)
        at org.apache.hadoop.ipc.RPC$Server.<init>(RPC.java:897)
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server.<init>(ProtobufRpcEngine.java:505)
        at org.apache.hadoop.ipc.ProtobufRpcEngine.getServer(ProtobufRpcEngine.java:480)
        at org.apache.hadoop.ipc.RPC$Builder.build(RPC.java:742)
        at org.apache.hadoop.mapreduce.v2.hs.server.HSAdminServer.serviceInit(HSAdminServer.java:100)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
        ... 5 more
2017-01-09 22:57:44,450 INFO org.apache.hadoop.mapreduce.v2.hs.JobHistory: Stopping JobHistory
2017-01-09 22:57:44,451 FATAL org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer: Error starting JobHistoryServer
org.apache.hadoop.service.ServiceStateException: java.net.BindException: Problem binding to [0.0.0.0:10033] java.net.BindExce
ption: Address already in use; For more details see:  http://wiki.apache.org/hadoop/BindException
        at org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:59)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:172)
        at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
        at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.serviceInit(JobHistoryServer.java:142)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
        at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.launchJobHistoryServer(JobHistoryServer.java:219)
        at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.main(JobHistoryServer.java:229)
Caused by: java.net.BindException: Problem binding to [0.0.0.0:10033] java.net.BindException: Address already in use; For mor
e details see:  http://wiki.apache.org/hadoop/BindException
        at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:719)
        at org.apache.hadoop.ipc.Server.bind(Server.java:419)
        at org.apache.hadoop.ipc.Server$Listener.<init>(Server.java:561)
        at org.apache.hadoop.ipc.Server.<init>(Server.java:2166)
        at org.apache.hadoop.ipc.RPC$Server.<init>(RPC.java:897)
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server.<init>(ProtobufRpcEngine.java:505)
        at org.apache.hadoop.ipc.ProtobufRpcEngine.getServer(ProtobufRpcEngine.java:480)
        at org.apache.hadoop.ipc.RPC$Builder.build(RPC.java:742)
        at org.apache.hadoop.mapreduce.v2.hs.server.HSAdminServer.serviceInit(HSAdminServer.java:100)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
        ... 5 more
2017-01-09 22:57:44,456 INFO org.apache.hadoop.util.ExitUtil: Exiting with status -1
2017-01-09 22:57:44,459 INFO org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer: SHUTDOWN_MSG: 
/************************************************************
SHUTDOWN_MSG: Shutting down JobHistoryServer at hadoop-senior/192.168.85.129

相关问题