[jira] [Created] (SPARK-20135) spark thriftserver2: no job running but cores not release on yarn

["bruce xu (JIRA)" <ji...@apache.org>]

bruce xu created SPARK-20135:
--------------------------------

             Summary: spark thriftserver2: no job running but cores not release on yarn
                 Key: SPARK-20135
                 URL: https://issues.apache.org/jira/browse/SPARK-20135
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 2.0.1
         Environment: spark 2.0.1 with hadoop 2.6.0 
            Reporter: bruce xu


i opened the executor dynamic allocation feature, however it doesn't work sometimes.

i set the initial executor num 50,  after job finished the cores and mem resource did not release. 

from the spark web UI, the active job/running task/stage num is 0 , but the executors page show  cores 1276, active task 7288.

from the yarn web UI,  the thriftserver job's running containers is 639

this may be a bug. 




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org