我试图运行一个单词计数mapreduce作业的oozie作业,但得到一个空的输出文件。文本文件位于hdfs的'/word'目录中,jar文件位于'/map reduce/lib'中。我正在运行以下命令来执行oozie作业:
好工作-好工作http://localhost:11000/oozie-config map reduce/job.properties-运行
**My workflow.xml:**
<workflow-app xmlns="uri:oozie:workflow:0.2" name="map-reduce-wf">
<start to="mr-node"/>
<action name="mr-node">
<map-reduce>
<job-tracker>${jobTracker}</job-tracker>
<name-node>${nameNode}</name-node>
<prepare>
<delete path="{nameNode}/word_dir"></delete>
</prepare>
<configuration>
<property>
<name>mapred.job.queue.name</name>
<value>default</value>
</property>
<property>
<name>mapred.mapper.class</name>
<value>MyMap</value>
</property>
<property>
<name>mapred.reducer.class</name>
<value>MyReduce</value>
</property>
<property>
<name>mapred.output.key.class</name>
<value>org.apache.hadoop.io.Text</value>
</property>
<property>
<name>mapred.output.value.class</name>
<value>org.apache.hadoop.io.IntWritable</value>
</property>
<property>
<name>mapred.input.dir</name>
<value>/word</value>
</property>
<property>
<name>mapred.output.dir</name>
<value>/word_dir</value>
</property>
</configuration>
</map-reduce>
<ok to="end"/>
<error to="fail"/>
</action>
<kill name="fail">
<message>Map/Reduce failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message>
</kill>
<end name="end"/>
</workflow-app>
和job.properties:
nameNode=hdfs://quickstart.cloudera:8020
jobTracker=localhost:8032
oozie.wf.application.path=${nameNode}/map-reduce
请帮忙。
暂无答案!
目前还没有任何答案,快来回答吧!