hadoopYarn:fair-scheduler.xml中的aclsubmitapps不起作用?

9cbw7uwe  于 2021-06-02  发布在  Hadoop
关注(0)|答案(1)|浏览(388)

我打算做的是限制可以向其发送任务的用户或组 testmonitor 排队。
在我设置 AclSubmitApps 如下所示,我仍然可以提交一个配置单元任务,其队列设置为 testmonitor 通过 set mapred.job.queue.name=root.testmonitor; ,在用户中 monitor:monitor . 我可以保证fair-scheduler.xml是由yarn重新加载的(通过更改 maxRunningApps 并且可以在hadoop监视器网页中看到变化)。
我看不出我和我妻子之间有什么本质的区别 fair-scheduler.xml 以及官方文件给出的例子。谁能给我一些建议吗?谢谢!
我的fair-scheduler.xml

<allocations>
  <queue name="default">
    <minResources>100000 mb,64vcores</minResources>
    <maxResources>12000000 mb,720vcores</maxResources>
    <maxRunningApps>50</maxRunningApps>
    <weight>1.0</weight>
    <schedulingPolicy>fifo</schedulingPolicy>
    <minSharePreemptionTimeout>300</minSharePreemptionTimeout>
  </queue>

  <queue name="testmonitor">
    <minResources>12000000 mb, 600vcores</minResources>
    <maxResources>20000000 mb, 720vcores</maxResources>
    <maxRunningApps>5</maxRunningApps>
    <weight>2.0</weight>
    <schedulingPolicy>fair</schedulingPolicy>
    <minSharePreemptionTimeout>300</minSharePreemptionTimeout>
    <aclSubmitApps>testmonitor</aclSubmitApps>
  </queue>

  <userMaxAppsDefault>50</userMaxAppsDefault>
  <fairSharePreemptionTimeout>6000</fairSharePreemptionTimeout>
  <defaultQueueSchedulingPolicy>fifo</defaultQueueSchedulingPolicy>
</allocations>

运行任务的监视:

关于展会日程安排的官方文件示例:

<?xml version="1.0"?>
<allocations>
  <queue name="sample_queue">
    <minResources>10000 mb,0vcores</minResources>
    <maxResources>90000 mb,0vcores</maxResources>
    <maxRunningApps>50</maxRunningApps>
    <weight>2.0</weight>
    <schedulingPolicy>fair</schedulingPolicy>
    <queue name="sample_sub_queue">
      <aclSubmitApps>charlie</aclSubmitApps>
      <minResources>5000 mb,0vcores</minResources>
    </queue>
  </queue>

  <user name="sample_user">
    <maxRunningApps>30</maxRunningApps>
  </user>
  <userMaxAppsDefault>5</userMaxAppsDefault>

  <queuePlacementPolicy>
    <rule name="specified" />
    <rule name="primaryGroup" create="false" />
    <rule name="default" />
  </queuePlacementPolicy>
</allocations>
rn0zuynd

rn0zuynd1#

将根队列添加为父队列。

<queue name="root">
<aclSubmitApps> </aclSubmitApps>
<queue name="queue1">
    <minResources>10000mb,10vcores</minResources>
    <maxResources>30000mb,30vcores</maxResources>
    <maxRunningApps>10</maxRunningApps>
    <weight>2.0</weight>
    <schedulingMode>fair</schedulingMode>
    <aclAdministerApps>User1</aclAdministerApps>
    <aclSubmitApps>User1</aclSubmitApps>
</queue> 
</queue>

相关问题