You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-dev@hadoop.apache.org by "Prabhu Joseph (Jira)" <ji...@apache.org> on 2020/03/06 14:46:00 UTC

[jira] [Created] (YARN-10183) Auto Created Leaf Queues does not start

Prabhu Joseph created YARN-10183:
------------------------------------

             Summary: Auto Created Leaf Queues does not start 
                 Key: YARN-10183
                 URL: https://issues.apache.org/jira/browse/YARN-10183
             Project: Hadoop YARN
          Issue Type: Bug
    Affects Versions: 3.3.0
            Reporter: Prabhu Joseph
            Assignee: Prabhu Joseph


Auto Created Leaf Queues does not start. Have a Parent queue with auto create leaf queue enabled.

{code}
    <property>
      <name>yarn.scheduler.capacity.root.batch.auto-create-child-queue.enabled</name>
      <value>true</value>
    </property>

    <property>
      <name>yarn.scheduler.capacity.root.batch.leaf-queue-template.capacity</name>
      <value>30</value>
    </property>
{code}

Stopping Parent Queue stops auto created leaf queues. But Starting Parent Queue / Auto Created Leaf Queue does not start the Leaf Queue causing subsequent jobs submitted failing.

{code}

    <property>
      <name>yarn.scheduler.capacity.root.batch.state</name>
      <value>RUNNING</value>
    </property>

    <property>
      <name>yarn.scheduler.capacity.root.batch.hive.state</name>
      <value>RUNNING</value>
    </property>
{code}

Subsequent job fails

{code}

Caused by: org.apache.hadoop.yarn.exceptions.YarnException: Failed to submit application_1583503947651_0002 to YARN : org.apache.hadoop.security.AccessControlException: Queue root.batch.hive is STOPPED. Cannot accept submission of application: application_1583503947651_0002
	at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.submitApplication(YarnClientImpl.java:327)
	at org.apache.hadoop.mapred.ResourceMgrDelegate.submitApplication(ResourceMgrDelegate.java:303)
	at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:330)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org