我正在尝试将我的es 2.2.0版本与hadoop hdfs集成。在我的环境中,我有一个主节点和一个数据节点。在主节点上安装了es。但是,在将它与hdfs集成的同时,我的资源管理器应用程序工作却陷入了可接受的状态。不知何故,我找到了更改yarn-site.xml设置的链接:
<property>
<name>yarn.nodemanager.resource.memory-mb</name>
<value>2200</value>
<description>Amount of physical memory, in MB, that can be allocated for containers.</description>
</property>
<property>
<name>yarn.scheduler.minimum-allocation-mb</name>
<value>500</value>
</property>
我也这样做了,但它没有给我预期的产出。
形态iguration:-
我的核心站点.xml
<property>
<name>hadoop.tmp.dir</name>
<value>/app/hadoop/tmp</value>
<description>A base for other temporary directories.
</description> </property>
<property> <name>fs.default.name</name>
<value>
hdfs://localhost:54310
</value>
<description>The name of the default file system. A URI whose scheme and authority determine the FileSystem implementation. The uri's scheme determines the config property (fs.SCHEME.impl) naming the FileSystem implementation class. The uri's authority is used to determine the host, port, etc. for a filesystem.
</description>
</property>
我的mapred-site.xml,
<property>
<name>mapred.job.tracker</name>
<value>localhost:54311</value>
<description>The host and port that the MapReduce job tracker runs at. If "local", then jobs are run in-process as a single map and reduce task. </description>
</property>
我的hdfs-site.xml,
<property>
<name>dfs.replication</name> <value>1</value> <description>Default block replication. The actual number of replications can be specified when the file is created. The default is used if replication is not specified in create time. </description>
</property>
请帮助我如何将rm作业更改为运行状态,以便在hdfs上使用elasticsearch数据。
1条答案
按热度按时间qni6mghb1#
如果屏幕截图是正确的-您有0个nodemanager-因此应用程序无法开始运行-您需要启动至少1个nodemanager,以便可以启动应用程序主机和以后的任务。