作业跟踪器未运行

lmvvr0a8  于 2021-05-29  发布在  Hadoop
关注(0)|答案(1)|浏览(270)

我已经在本地机器上安装了单节点hadoop。除作业跟踪器外,所有进程都在运行。我想从ozzie那里运行我的工作,所以同样我也需要运行job tracker。
jps输出

12545 Jps
12371 SecondaryNameNode
12180 DataNode
12046 NameNode

start-dfs.sh输出

19/09/15 18:47:24 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Starting namenodes on [localhost]
localhost: starting namenode, logging to /usr/local/hadoop/logs/hadoop-hduser-namenode-ec2-18-222-170-204.us-east-2.compute.amazonaws.com.out
localhost: starting datanode, logging to /usr/local/hadoop/logs/hadoop-hduser-datanode-ec2-18-222-170-204.us-east-2.compute.amazonaws.com.out
Starting secondary namenodes [0.0.0.0]
0.0.0.0: starting secondarynamenode, logging to /usr/local/hadoop/logs/hadoop-hduser-secondarynamenode-ec2-18-222-170-204.us-east-2.compute.amazonaws.com.out
19/09/15 18:47:41 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

start-yarn.sh输出

starting yarn daemons
starting resourcemanager, logging to /usr/local/hadoop/logs/yarn-hduser-resourcemanager-ec2-18-222-170-204.us-east-2.compute.amazonaws.com.out
localhost: starting nodemanager, logging to /usr/local/hadoop/logs/yarn-hduser-nodemanager-ec2-18-222-170-204.us-east-2.compute.amazonaws.com.out

cat mapred-site.xml文件

<configuration>
 <property>
  <name>mapred.job.tracker</name>
  <value>localhost:54311</value>
  <description>The host and port that the MapReduce job tracker runs
  at.  If "local", then jobs are run in-process as a single map
  and reduce task.
  </description>
 </property>
    <property>
            <name>mapreduce.framework.name</name>
            <value>yarn</value>
    </property>
    <property>
            <name>yarn.app.mapreduce.am.env</name>
            <value>HADOOP_MAPRED_HOME=$HADOOP_INSTALL</value>
    </property>
    <property>
            <name>mapreduce.map.env</name>
            <value>HADOOP_MAPRED_HOME=$HADOOP_INSTALL</value>
    </property>
    <property>
            <name>mapreduce.reduce.env</name>
            <value>HADOOP_MAPRED_HOME=$HADOOP_INSTALL</value>
    </property>
</configuration>

cat站点.xml

<configuration>
    <property>
            <name>yarn.acl.enable</name>
            <value>0</value>
    </property>

    <property>
            <name>yarn.resourcemanager.hostname</name>
            <value>103.101.71.26</value>
    </property>

    <property>
            <name>yarn.nodemanager.aux-services</name>
            <value>mapreduce_shuffle</value>
    </property>
</configuration>

根据 mapred-site.xml 文件作业跟踪器应在上运行 localhost:54311 ,但当我这样做时,它不是作为服务运行的 JPS 甚至在网络浏览器中也没有。
我可以知道你能做些什么来运行它吗。。?
谢谢

nkkqxpd9

nkkqxpd91#

jobtracker是hadoop1的一个概念,被yarn resourcemanager取代。奥齐也用Yarn
不清楚您是如何设置配置的,但是官方安装指南中没有提到这个属性。
https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-common/singlecluster.html#yarn_on_a_single_node
事实上,大多数房产都是从 mapred.* 已弃用,您可以在此处找到有效的Map站点xml属性-https://hadoop.apache.org/docs/stable/hadoop-mapreduce-client/hadoop-mapreduce-client-core/mapred-default.xml

相关问题