hadoop - 如何删除 YARN 中的队列？

Question

我在 yarn 配置文件中看到一个我想删除的队列:

<property>
  <name>yarn.scheduler.capacity.root.queues</name>
  <value>a,b,c</value>
  <description>The queues at the this level (root is the root queue).
  </description>
</property>

<property>
  <name>yarn.scheduler.capacity.root.a.queues</name>
  <value>a1,a2</value>
  <description>The queues at the this level (root is the root queue).
  </description>
</property>

<property>
  <name>yarn.scheduler.capacity.root.b.queues</name>
  <value>b1,b2,b3</value>
  <description>The queues at the this level (root is the root queue).
  </description>
</property>

假设我要删除队列 c .我删除 c来自 <name>yarn.scheduler.capacity.root.queues</name> 行下的列表所以那一行看起来像这样:

<value>a,b,c</value>

然后我转到命令行并运行 yarn rmadmin -refreshQueues .

但是我收到以下错误信息:

Caused by java.io.IOException: c cannot be found during refresh!`

我正在尝试删除队列 c .我该如何删除它？

我注意到了 here它说

Note: Queues cannot be deleted, only addition of new queues is supported - the updated queue configuration should be a valid one i.e. queue-capacity at each level should be equal to 100%.

...那么，如果我不再需要某个队列，该如何删除它呢？

谢谢。

Answer 1

从那个页面:

Administrators can add additional queues at runtime, but queues cannot be deleted at runtime.

听起来您无法在运行时删除，但您可以停止/终止 YARN，更新配置文件(并删除 c)并使用新配置运行 YARN。因此，如果您有能力停止/启动 YARN，那么流程如下:

注意:在杀死 YARN 之前阅读 here取决于您的 YARN 版本对系统的影响。

流程如下:

Stop the MapReduce JobHistory service, ResourceManager service, and NodeManager on all nodes where they are running, as follows:

 sudo service hadoop-mapreduce-historyserver stop
 sudo service hadoop-yarn-resourcemanager stop
 sudo service hadoop-yarn-nodemanager stop

然后编辑配置文件并删除c

Start the MapReduce JobHistory server, ResourceManager, and NodeManager on all nodes where they were previously running, as follows:

 sudo service hadoop-mapreduce-historyserver start
 sudo service hadoop-yarn-resourcemanager start
 sudo service hadoop-yarn-nodemanager start

命令来自here