大家早上好请帮我把下面的问题过来
存储到hadoop(hdfs)的数据
c:\users\intex>hadoop fs-cat/input\u dir/input\u file.txt
23 23 27 43 24 25 26 26 26 26 25 26 25
26 27 28 28 28 30 31 31 31 30 30 30 29
31 32 32 32 33 34 35 36 36 34 34 34 34
39 38 39 39 39 41 42 43 40 39 38 38 40
38 39 39 39 39 41 41 41 28 40 39 39 45
23 23 27 43 24 25 26 26 26 26 25 26 25
26 27 28 28 28 30 31 31 31 30 30 30 29
31 32 32 32 33 34 35 36 36 34 34 34 34
39 38 39 39 39 41 42 43 40 39 38 38 40
我们试图通过命令对上述数据运行mapreduce程序
hadoop jar E:/MapReduceClient.jar wordcount /input_dir /output_dir
系统开始提示一个错误,我在google上搜索并实现了一些它们不起作用的建议
输出如下:
18/06/03 06:39:49 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
18/06/03 06:39:52 INFO input.FileInputFormat: Total input paths to process : 1
18/06/03 06:39:53 INFO mapreduce.JobSubmitter: number of splits:1
18/06/03 06:39:53 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1527987986422_0002
18/06/03 06:39:54 INFO impl.YarnClientImpl: Submitted application application_1527987986422_0002
18/06/03 06:39:54 INFO mapreduce.Job: The url to track the job: http://ARS:8088/proxy/application_1527987986422_0002/
18/06/03 06:39:54 INFO mapreduce.Job: Running job: job_1527987986422_0002
18/06/03 06:39:58 INFO mapreduce.Job: Job job_1527987986422_0002 running in uber mode : false
18/06/03 06:39:58 INFO mapreduce.Job: map 0% reduce 0%
18/06/03 06:39:58 INFO mapreduce.Job: Job job_1527987986422_0002 failed with state FAILED due to: Application application_1527987986422_0002 failed 2 times due to AM Container for appattempt_1527987986422_0002_000002 exited with exitCode: -1000
For more detailed output, check application tracking page:http://ARS:8088/cluster/app/application_1527987986422_0002 Then, click on links to logs of each attempt.
Diagnostics: Failed to setup local dir /tmp/hadoop-intex/nm-local-dir, which was marked as good.
Failing this attempt. Failing the application.
18/06/03 06:39:58 INFO mapreduce.Job: Counters: 0
暂无答案!
目前还没有任何答案,快来回答吧!