我在运行一个简单的yarn应用程序时遇到了以下异常:如何获得更多信息来调试问题?
Oct 14, 2014 12:29:19 PM dz.lab.yarn.simple.handler.RMCallbackHandler onContainersCompleted
INFO: container 'container_1410790353365_0036_02_000002' status is ContainerStatus: [ContainerId: container_1410790353365_0036_02_000002, State: COMPLETE, Diagnostics: Exception from container-launch: ExitCodeException exitCode=1:
ExitCodeException exitCode=1:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
at org.apache.hadoop.util.Shell.run(Shell.java:455)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:702)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:300)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:81)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
这是什么
1条答案
按热度按时间m0rkklqb1#
您可以从容器的日志中获取更多信息。
您可以通过以下方式查看容器的日志:
从rm的ui(http://\u rm\u hostname\:8088)。更多详情请参见:http://hadooptutorial.info/tracing-logs-through-yarn-web-ui/
通过控制台命令:“Yarn日志-applicationid”
手动查找以下位置下的日志:
a) 如果禁用聚合(日志将位于运行容器的本地目录中):$hadoop\u home$/logs/userlogs/application\u 1490965385045\u 0002/
b) 如果启用了聚合(日志将位于hdfs中):/tmp/logs/username>/logs/application\u 1490965385045\u 0002/\u node\u name>