我试着排了3个队。为此,我配置了capacityscheduler.xml,如下所示。但在这之后,jobtracker就要关闭了。我还将这些队列的名称添加到mapred-site.xml中。任何人都知道原因。
enter code here
* <!-- queue: BatchJobs-Queue -->
<property>
<name>mapred.capacity-scheduler.queue.BatchJobsQueue.capacity</name>
<value>70</value>
</property>
<property>
<name>mapred.capacity-scheduler.queue.BatchJobsQueue.supports-priority</name>
<value>false</value>
</property>
<property>
<name>mapred.capacity-scheduler.queue.BatchJobsQueue.minimum-user-limit-percent</name>
<value>20</value>
</property>
<property>
<name>mapred.capacity-scheduler.queue.BatchJobsQueue.user-limit-factor</name>
<value>1</value>
</property>
<property>
<name>mapred.capacity-scheduler.queue.BatchJobsQueue.maximum-initialized-active-tasks</name>
<value>200000</value>
</property>
<property>
<name>mapred.capacity-scheduler.queue.BatchJobsQueue.maximum-initialized-active-tasks-per-user</name>
<value>100000</value>
</property>
<property>
<name>mapred.capacity-scheduler.queue.BatchJobsQueue.init-accept-jobs-factor</name>
<value>10</value>
</property>
enter code here
<!-- queue: AdHocJobs-Queue -->
<property>
<name>mapred.capacity-scheduler.queue.AdHocJobsQueue.capacity</name>
<value>20<value>
</property>
<property>
<name>mapred.capacity-scheduler.queue.AdHocJobsQueue.supports-priority</name>
<value>false</value>
</property>
<property>
<name>mapred.capacity-scheduler.queue.AdHocJobsQueue.minimum-user-limit-percent</name>
<value>20</value>
</property>
<property>
<name>mapred.capacity-scheduler.queue.AdHocJobsQueue.user-limit-factor</name>
<value>1</value>
</property>
<property>
<name>mapred.capacity-scheduler.queue.AdHocJobsQueue.maximum-initialized-active-tasks</name>
<value>200000</value>
</property>
<property>
<name>mapred.capacity-scheduler.queue.AdHocJobsQueue.maximum-initialized-active-tasks-per-user</name>
<value>100000</value>
</property>
<property>
<name>mapred.capacity-scheduler.queue.AdHocJobsQueue.init-accept-jobs-factor</name>
<value>10</value>
</property>
enter code here
<!-- queue: MyQueue -->
<property>
<name>mapred.capacity-scheduler.queue.MyQueue.capacity</name>
<value>10<value>
</property>
<property>
<name>mapred.capacity-scheduler.queue.MyQueue.supports-priority</name>
<value>false</value>
</property>
<property>
<name>mapred.capacity-scheduler.queue.MyQueue.minimum-user-limit-percent</name>
<value>20</value>
</property>
<property>
<name>mapred.capacity-scheduler.queue.MyQueue.user-limit-factor</name>
<value>1</value>
</property>
<property>
<name>mapred.capacity-scheduler.queue.MyQueue.maximum-initialized-active-tasks</name>
<value>200000</value>
</property>
<property>
<name>mapred.capacity-scheduler.queue.MyQueue.maximum-initialized-active-tasks-per-user</name>
<value>100000</value>
</property>
<property>
<name>mapred.capacity-scheduler.queue.MyQueue.init-accept-jobs-factor</name>
<value>10</value>
</property>*
enter code here
1条答案
按热度按时间x6h2sr281#
作业跟踪器日志的输出是什么?
假设您正在运行linux,请尝试运行以下命令: