在windows10上执行mapreduce(map reduce)程序时出错

goucqfw6  于 2021-05-29  发布在  Hadoop
关注(0)|答案(0)|浏览(205)

大家早上好请帮我把下面的问题过来
存储到hadoop(hdfs)的数据
c:\users\intex>hadoop fs-cat/input\u dir/input\u file.txt

23   23   27  43   24   25   26   26   26   26   25   26  25
26   27   28  28   28   30   31   31   31   30   30   30  29
31   32   32  32   33   34   35   36   36   34   34   34  34
39   38   39  39   39   41   42   43   40   39   38   38  40
38   39   39  39   39   41   41   41   28   40   39   39  45
23   23   27  43   24   25   26   26   26   26   25   26  25
26   27   28  28   28   30   31   31   31   30   30   30  29
31   32   32  32   33   34   35   36   36   34   34   34  34
39   38   39  39   39   41   42   43   40   39   38   38  40

我们试图通过命令对上述数据运行mapreduce程序

hadoop jar E:/MapReduceClient.jar wordcount /input_dir /output_dir

系统开始提示一个错误,我在google上搜索并实现了一些它们不起作用的建议
输出如下:

18/06/03 06:39:49 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
18/06/03 06:39:52 INFO input.FileInputFormat: Total input paths to process : 1
18/06/03 06:39:53 INFO mapreduce.JobSubmitter: number of splits:1
18/06/03 06:39:53 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1527987986422_0002
18/06/03 06:39:54 INFO impl.YarnClientImpl: Submitted application application_1527987986422_0002
18/06/03 06:39:54 INFO mapreduce.Job: The url to track the job: http://ARS:8088/proxy/application_1527987986422_0002/
18/06/03 06:39:54 INFO mapreduce.Job: Running job: job_1527987986422_0002
18/06/03 06:39:58 INFO mapreduce.Job: Job job_1527987986422_0002 running in uber mode : false
18/06/03 06:39:58 INFO mapreduce.Job:  map 0% reduce 0%
18/06/03 06:39:58 INFO mapreduce.Job: Job job_1527987986422_0002 failed with state FAILED due to: Application application_1527987986422_0002 failed 2 times due to AM Container for appattempt_1527987986422_0002_000002 exited with  exitCode: -1000
For more detailed output, check application tracking page:http://ARS:8088/cluster/app/application_1527987986422_0002 Then, click on links to logs of each attempt.
Diagnostics: Failed to setup local dir /tmp/hadoop-intex/nm-local-dir, which was marked as good.
Failing this attempt. Failing the application.
18/06/03 06:39:58 INFO mapreduce.Job: Counters: 0

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题