spark提交到yarn时出现错误“unknown queue:root.default”

de90aj5v  于 2021-05-26  发布在  Hadoop
关注(0)|答案(1)|浏览(1879)

我提交了一个简单的pyspark字数工作,一个新建立的Yarn集群,通过气流和SparkSubmitor。作业命中了Yarn,我可以在resourcemanager ui中看到它,但由于以下错误而失败:
“诊断:应用程序\u 1582076991 \u 0002由用户root提交到未知队列:root.default”


* User:  root

Name:   PySpark Wordcount
Application Type:   SPARK
Application Tags:   
YarnApplicationState:   FAILED
Queue:  root.default
FinalStatus Reported by AM: FAILED
Started:    Fri Feb 21 08:01:25 +1100 2020
Elapsed:    0sec
Tracking URL:   History
Diagnostics:    Application application_1582063076991_0002 submitted by user root to unknown queue: root.default*

default.root队列似乎确实存在:


* Application Queues

  Legend:CapacityUsedUsed (over capacity)Max Capacity
      .root    0.0% used
          ..Queue: default    0.0% used

'default' Queue Status
Queue State:    RUNNING
Used Capacity:  0.0%
Configured Capacity:    100.0%
Configured Max Capacity:    100.0%
Absolute Used Capacity: 0.0%
Absolute Configured Capacity:   100.0%
Absolute Configured Max Capacity:   100.0%
Used Resources: <memory:0, vCores:0>
Num Schedulable Applications:   0
Num Non-Schedulable Applications:   0
Num Containers: 0
Max Applications:   10000
Max Applications Per User:  10000
Max Application Master Resources:   <memory:3072, vCores:1>
Used Application Master Resources:  <memory:0, vCores:0>
Max Application Master Resources Per User:  <memory:3072, vCores:1>
Configured Minimum User Limit Percent:  100%
Configured User Limit Factor:   1.0
Accessible Node Labels: *
Preemption: disabled*

我错过了什么?谢谢

dz6r00yl

dz6r00yl1#

使用队列名称提交 default .
这个 root 在资源管理器中,仅用于按层次结构形式对队列进行分组。

相关问题