容器执行器退出代码24错误

d6kp6zgx  于 2021-05-29  发布在  Hadoop
关注(0)|答案(1)|浏览(463)

我试着在Yarn上使用cgroup。
但我有点麻烦。
我使用1个namenod和3个datanode。
我不能运行容器执行器。
我想我做错事了,但我不知道
你能帮我吗??如果你需要更多的信息,我会写评论。
yarn-site.xml文件

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License. See accompanying LICENSE file.
-->
<configuration>
<property>
<name>yarn.resourcemanager.scheduler.class</name>
<value>org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler</value>
</property>
<property>
<name>yarn.scheduler.fair.allocation.file</name>
<value>/home/hadoop/tools/hadoop/etc/hadoop/fair-scheduler.xml</value>
</property>
<property>
<name>yarn.resourcemanager.hostname</name>
<value>em-name01</value>
</property>
<property>
<name>yarn.nodemanager.resource.memory-mb</name>
<value>8192</value>
</property>
<property>
<name>yarn.nodemanager.resource.cpu-vcores</name>
<value>4</value>
</property>
<property>
<name>yarn.nodemanager.resource.percentage-physical-cpu-limit</name>
<value>100</value>
</property>

<property>
<name>yarn.scheduler.fair.allow-undeclared-pools</name>
<value>false</value>
</property>
<property>
<name>yarn.scheduler.fair.preemption</name>
<value>false</value>
</property>

<!-- cgroup config -->
<property>
<name>yarn.nodemanager.container-executor.class</name>
<value>org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor</value>
</property>
<property>
<name>yarn.nodemanager.linux-container-executor.nonsecure-mode.limit-users</name>
<value>false</value>
</property>
<property>
<name>yarn.nodemanager.linux-container-executor.resources-handler.class</name>
<value>org.apache.hadoop.yarn.server.nodemanager.util.CgroupsLCEResourcesHandler</value>
</property>
<property>
<name>yarn.nodemanager.linux-container-executor.cgroups.hierarchy</name>
<value>/hadoop-yarn</value>
</property>
<property>
<name>yarn.nodemanager.linux-container-executor.cgroups.mount</name>
<value>true</value>
</property>
<property>
<name>yarn.nodemanager.linux-container-executor.cgroups.mount-path</name>
<value>/cgroup/cpu</value>
</property>
<property>
<name>yarn.nodemanager.linux-container-executor.group</name>
<value>hadoop</value>
</property>
<!--
-->
</configuration>

容器-executor.cfg
yarn.nodemanager.linux container executor.group=hadoop#yarn.nodemanager.linux-container-executor.group yarn.nodemanager.local dirs=/tmp/hadoop hadoop/nm local dir banked.users=#无法运行应用程序的用户的逗号分隔列表min.user.id=500#阻止允许的其他超级用户。system.users=hadoop#逗号分隔列表可以运行应用程序的系统用户数
容器执行器
[hadoop@em-name01 hadoop]$ll$hadoop\u主页/bin/
---sr-s---1根hadoop 160351 1 1月26日00:20容器执行器
[hadoop@em-name01 hadoop]$ll容器-executor.cfg
-rw-r--r--1根hadoop 389 5月27日02:38 container-executor.cfg
yarn-hadoop-nodemanager-em-data02.log(所有数据节点都有相同的日志)

************************************************************/2016-05-27 10:45:31586 info org.apache.hadoop.yarn.server.nodemanager.nodemanager:为[term,hup,int]注册的unix信号处理程序2016-05-27 10:45:32,826 warn org.apache.hadoop.yarn.server.nodemanager.linuxcontainerexecutor:yarn.nodemanager.lin ux-container-executor.nonsecure-mode.limit-users:未启用身份验证的模拟2016-05-27 10:45:32,830 warn org.apache.hadoop.yarn.server.nodemanager.linuxcontainerexecutor:conta iner执行器初始化的退出代码为:24 exitcodeexception exitcode=24:file/home/hadoop/tools/hadoop-2.7.2/etc/hadoop必须由root所有,但在org.apache.hadoop.util.shell.runcommand(shell。java:545)在org.apache.hadoop.util.shell.run(shell。java:456)在org.apache.hadoop.util.shell$shellcommandexecutor.execute(shell。java:722)位于org.apache.hadoop.yarn.server.nodemanager.linuxcontainerexecutor.init(linuxcontainerexecutor。java:185)在org.apache.hadoop.yarn.server.nodemanager.nodemanager.serviceinit(nodemanager。java:216)在org.apache.hadoop.service.abstractservice.init(abstractservice。java:163)在org.apache.hadoop.yarn.server.nodemanager.nodemanager.initandstartnodemanager(nodemanager。java:485)在org.apache.hadoop.yarn.server.nodemanager.nodemanager.main(节点管理器。java:533)2016-05-27 10:45:32832 info org.apache.hadoop.yarn.server.nodemanager.containerexecutor:2016-05-27 10:45:32832 info org.apache.hadoop.service.abstractservice:服务nodemanager在初始化状态下失败;原因:org.apache.hadoop.yarn.exceptions.yarnruntimeexception:未能初始化容器执行器org.apache.hadoop.yarn.exceptions.yarnruntimeexception:未能初始化位于org.apache.hadoop.yarn.server.nodemanager.nodemanager.serviceinit(nodemanager)的容器执行器。java:218)在org.apache.hadoop.service.abstractservice.init(抽象服务)。java:163)在org.apache.hadoop.yarn.server.nodemanager.nodemanager.initandstartnodemanager(nodemanager。java:485)在org.apache.hadoop.yarn.server.nodemanager.nodemanager.main(nodemanager。java:533)原因:java.io.ioexception:linux容器执行器未正确配置(错误=24)位于org.apache.hadoop.yarn.server.nodemanager.linuxcontainerexecutor.init(linuxcontainerexecutor)。java:191)位于org.apache.hadoop.yarn.server.nodemanager.nodemanager.serviceinit(nodemanager。java:216) ... 3更多原因:exitcodeexception exitcode=24:file/home/hadoop/tools/hadoop-2.7.2/etc/hadoop必须归root所有,但在org.apache.hadoop.util.shell.runcommand(shell。java:545)在org.apache.hadoop.util.shell.run(shell。java:456)在org.apache.hadoop.util.shell$shellcommandexecutor.execute(shell。java:722)位于org.apache.hadoop.yarn.server.nodemanager.linuxcontainerexecutor.init(linuxcontainerexecutor。java:185) ... 4更多2016-05-27 10:45:32,834致命org.apache.hadoop.yarn.server.nodemanager.nodemanager:启动nodemanager org.apache.hadoop.yarn.exceptions.yarnruntimeexception时出错:未能初始化org.apache.hadoop.yarn.server.nodemanager.nodemanager.serviceinit(nodemanager)上的容器执行器。java:218)在org.apache.hadoop.service.abstractservice.init(抽象服务)。java:163)在org.apache.hadoop.yarn.server.nodemanager.nodemanager.initandstartnodemanager(nodemanager。java:485)在org.apache.hadoop.yarn.server.nodemanager.nodemanager.main(nodemanager。java:533)原因:java.io.ioexception:linux容器执行器未正确配置(错误=24)位于org.apache.hadoop.yarn.server.nodemanager.linuxcontainerexecutor.init(linuxcontainerexecutor)。java:191)位于org.apache.hadoop.yarn.server.nodemanager.nodemanager.serviceinit(nodemanager。java:216) ... 3更多原因:exitcodeexception exitcode=24:file/home/hadoop/tools/hadoop-2.7.2/etc/hadoop必须归root所有,但在org.apache.hadoop.util.shell.runcommand(shell。java:545)在org.apache.hadoop.util.shell.run(shell。java:456)在org.apache.hadoop.util.shell$shellcommandexecutor.execute(shell。java:722)位于org.apache.hadoop.yarn.server.nodemanager.linuxcontainerexecutor.init(linuxcontainerexecutor。java:185) ... 4更多信息2016-05-27 10:45:32838 info org.apache.hadoop.yarn.server.nodemanager.nodemanager:shutdown\u消息:/************************shutdown\u消息:关闭位于em-data02/58.181.37.179的nodemanager/

bxjv4tth

bxjv4tth1#

试试这个:

chown "/home/hadoop/tools/hadoop-2.7.2/etc/hadoop"

用户所有者到根目录。

相关问题