hadoopYarn作业在提交后受阻,状态仍然未定义

l2osamch  于 2021-05-29  发布在  Hadoop
关注(0)|答案(1)|浏览(291)

我试图在virtualbox vm(rhel6.5,8gbram,100gbhdd)中的伪分布式集群上运行一个示例mr作业,但是在提交作业之后,它只在那里阻塞了。
信息:mapreduce.job:正在运行作业:job\u 1437483993\u 001
应用程序跟踪url(http://localhost:8088/cluster/applicationid)显示如下结果:
用户:root
名称:grep search
应用程序类型:mapreduce
状态:已接受
最终状态:未定义
我尝试过:
修改了yarn-site.xml和mapred-site.xml,以便在教程之后实现内存的最小和最大分配(http://hortonworks.com/blog/how-to-plan-and-configure-yarn-in-hdp-2-0/)
确保磁盘空间足够空闲以容纳新作业。 jps 显示所有服务都正常运行。
但运气不好。请引导我通过。
编辑:日志如下: [root@master ~]# hadoop jar /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar grep /user/pradeep output23 'dfs[a-z.]+' SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder". SLF4J: Defaulting to no-operation (NOP) logger implementation SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details. 16/04/27 10:21:09 INFO client.RMProxy: Connecting to ResourceManager at /127.0.0.1:8032 16/04/27 10:21:09 WARN mapreduce.JobResourceUploader: No job jar file set. User classes may not be found. See Job or Job#setJar(String). 16/04/27 10:21:09 INFO input.FileInputFormat: Total input paths to process : 4 16/04/27 10:21:10 INFO mapreduce.JobSubmitter: number of splits:4 16/04/27 10:21:11 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1461732411884_0001 16/04/27 10:21:11 INFO mapred.YARNRunner: Job jar is not present. Not adding any jar to the list of resources. 16/04/27 10:21:11 INFO impl.YarnClientImpl: Submitted application application_1461732411884_0001 16/04/27 10:21:11 INFO mapreduce.Job: The url to track the job: http://localhost:8088/proxy/application_1461732411884_0001/ 16/04/27 10:21:11 INFO mapreduce.Job: Running job: job_1461732411884_0001

evrscar2

evrscar21#

还有其他一些问题,而不是基础设施。请把你要做的事情粘贴到map reduce代码中。

相关问题