tez在hdp2.1上崩溃了

llew8vvj 于 2021-06-03 发布在 Hadoop

关注(0)|答案(3)|浏览(316)

当我试图在终端运行一个tez作业时，我的Hive崩溃了。我已经在一个有5个节点的集群上安装了hdp2.1。操作系统：redhat enterprise
谁能帮我？：）
应用程序跟踪器日志：

HDP: 2.1
User: hdfs
Name: HIVE-9fd632e5-d76a-4e0a-8845-0c1f0af52f5c
Application Type: TEZ
Application Tags:
State: FAILED
FinalStatus: FAILED
Started: 1-Jul-2014 12:03:22
Elapsed: 4sec
Tracking URL: History
Diagnostics:
Application application_1404208879507_0002 failed 2 times due to AM Container for    appattempt_1404208879507_0002_000002 exited with exitCode: 1 due to: Exception from container-    launch:     org.apache.hadoop.util.Shell$ExitCodeException:
org.apache.hadoop.util.Shell$ExitCodeException:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:505)
at org.apache.hadoop.util.Shell.run(Shell.java:418)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650)
at         org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecu    tor.java:195)
at     org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch    .java:300)
at     org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch    .java:81)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Container exited with a non-zero exit code 1
.Failing this attempt.. Failing the application.

在候机楼：

Total jobs = 1
Launching Job 1 out of 1
Tez session was closed. Reopening...
Session re-established.
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.tez.TezTask

hadoop Hive hortonworks-data-platform apache

来源：https://stackoverflow.com/questions/24511016/tez-crashes-on-hdp-2-1

3条答案

按热度按时间

r1zk6ea11#

原因可能是运行作业的用户的id不能小于1000。转到tasktracker的日志文件，查看是否有如下消息：

INFO org.apache.hadoop.mapred.TaskController: Reading task controller configuration /etc/hadoop/taskcontroller.cfg
INFO. org.apache.hadoop.mapred.TaskController: requested user
hdfs has id 201, which is below the minimum allowed 1000

如果是这种情况，则可以执行以下操作：

usermod -u 10000 hdfs

赞(0）回复(0）举报 2021-06-04

sg24os4d2#

行“application\u 1404208879507\u 0002 failed 2 times due am container for”表明tez应用程序主程序可能无法启动。这可能是由于各种原因造成的。
最简单的查找原因的地方是通过调用“bin/yarn logs-applicationid application\u 1404208879507\u 0002”获得的应用程序日志。导致这种情况的最常见问题通常是一些设置/配置错误，在启动java进程时导致classnotfound错误。

赞(0）回复(0）举报 2021-06-04

7gyucuyw3#

我觉得泰兹很不稳定。只选择从无子句当前工作的位置。。我在hue上以hdfs的身份登录并启动了一个普通的selectfrom。。。查询。谢谢你的快速回答！

赞(0）回复(0）举报 2021-06-03