查询数据并将数据插入配置单元时返回代码2错误

gjmwrych  于 2021-05-27  发布在  Hadoop
关注(0)|答案(0)|浏览(242)

我创建了一个aws示例,并用ssh连接到emr主集群中。集群有hdfs和hive。但是,我收到了错误代码2 Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask 当我尝试使用聚合函数将数据插入表或查询数据时。我可以用select*查询数据。还有其他人遇到过这个问题吗?
查询生成错误:
INSERT OVERWRITE TABLE SELECT * FROM SELECT COUNT(*) FROM <table1> 表1是一个外部表,表2是一个内部表,但是当我查询时,我可以看到表1的内容 SELECT * FROM <table1> 这是我的日志

2020-11-19T19:01:56,851 INFO  [76f39064-4ae2-4fdd-b3e2-59ba6de9d4f9 main([])]: exec.Task (SessionState.java:printInfo(1115)) - Starting Job = job_1605810640418_0003, Tracking URL = http://ip-172-31-36-64.us-east-2.compute.internal:20888/proxy/application_1605810640418_0003/
2020-11-19T19:01:56,851 INFO  [76f39064-4ae2-4fdd-b3e2-59ba6de9d4f9 main([])]: exec.Task (SessionState.java:printInfo(1115)) - Kill Command = /usr/lib/hadoop/bin/hadoop job  -kill job_1605810640418_0003
2020-11-19T19:02:00,915 INFO  [76f39064-4ae2-4fdd-b3e2-59ba6de9d4f9 main([])]: exec.Task (SessionState.java:printInfo(1115)) - Hadoop job information for Stage-1: number of mappers: 0; number of reducers: 0
2020-11-19T19:02:00,974 WARN  [76f39064-4ae2-4fdd-b3e2-59ba6de9d4f9 main([])]: mapreduce.Counters (AbstractCounters.java:getGroup(234)) - Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
2020-11-19T19:02:00,976 INFO  [76f39064-4ae2-4fdd-b3e2-59ba6de9d4f9 main([])]: exec.Task (SessionState.java:printInfo(1115)) - 2020-11-19 19:02:00,967 Stage-1 map = 0%,  reduce = 0%
2020-11-19T19:02:00,978 WARN  [76f39064-4ae2-4fdd-b3e2-59ba6de9d4f9 main([])]: mapreduce.Counters (AbstractCounters.java:getGroup(234)) - Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
2020-11-19T19:02:00,989 ERROR [76f39064-4ae2-4fdd-b3e2-59ba6de9d4f9 main([])]: exec.Task (SessionState.java:printError(1130)) - Ended Job = job_1605810640418_0003 with errors
2020-11-19T19:02:00,990 ERROR [Thread-33([])]: exec.Task (SessionState.java:printError(1130)) - Error during job, obtaining debugging information...
2020-11-19T19:02:00,990 INFO  [Thread-33([])]: Configuration.deprecation (Configuration.java:logDeprecation(1297)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2020-11-19T19:02:01,005 INFO  [76f39064-4ae2-4fdd-b3e2-59ba6de9d4f9 main([])]: impl.YarnClientImpl (YarnClientImpl.java:killApplication(455)) - Killed application application_1605810640418_0003
2020-11-19T19:02:01,020 ERROR [76f39064-4ae2-4fdd-b3e2-59ba6de9d4f9 main([])]: ql.Driver (SessionState.java:printError(1130)) - FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
2020-11-19T19:02:01,021 INFO  [76f39064-4ae2-4fdd-b3e2-59ba6de9d4f9 main([])]: ql.Driver (SessionState.java:printInfo(1115)) - MapReduce Jobs Launched: 
2020-11-19T19:02:01,026 WARN  [76f39064-4ae2-4fdd-b3e2-59ba6de9d4f9 main([])]: mapreduce.Counters (AbstractCounters.java:getGroup(234)) - Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead
2020-11-19T19:02:01,027 INFO  [76f39064-4ae2-4fdd-b3e2-59ba6de9d4f9 main([])]: ql.Driver (SessionState.java:printInfo(1115)) - Stage-Stage-1:  HDFS Read: 0 HDFS Write: 0 FAIL
2020-11-19T19:02:01,027 INFO  [76f39064-4ae2-4fdd-b3e2-59ba6de9d4f9 main([])]: ql.Driver (SessionState.java:printInfo(1115)) - Total MapReduce CPU Time Spent: 0 msec
2020-11-19T19:02:01,027 INFO  [76f39064-4ae2-4fdd-b3e2-59ba6de9d4f9 main([])]: ql.Driver (Driver.java:execute(2050)) - Completed executing command(queryId=gil_20201119190152_3fd27a96-8686-4b90-93ac-24c681ac94fc); Time taken: 6.476 seconds
2020-11-19T19:02:01,036 INFO  [76f39064-4ae2-4fdd-b3e2-59ba6de9d4f9 main([])]: conf.HiveConf (HiveConf.java:getLogIdVar(3968)) - Using the default value passed in for log id: 76f39064-4ae2-4fdd-b3e2-59ba6de9d4f9
2020-11-19T19:02:01,036 INFO  [76f39064-4ae2-4fdd-b3e2-59ba6de9d4f9 main([])]: session.SessionState (SessionState.java:resetThreadName(436)) - Resetting thread name to  main

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题