You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Prabhu Joseph (JIRA)" <ji...@apache.org> on 2017/11/02 09:36:00 UTC

[jira] [Created] (SPARK-22426) Spark AM launching containers on node where External spark shuffle service failed to initialize

Prabhu Joseph created SPARK-22426:
-------------------------------------

             Summary: Spark AM launching containers on node where External spark shuffle service failed to initialize
                 Key: SPARK-22426
                 URL: https://issues.apache.org/jira/browse/SPARK-22426
             Project: Spark
          Issue Type: Bug
          Components: Shuffle
    Affects Versions: 1.6.3
            Reporter: Prabhu Joseph
            Priority: Major


When Spark External Shuffle Service on a NodeManager fails, the remote executors will fail while fetching the data from the executors launched on this Node. Spark ApplicationMaster should not launch containers on this Node or not use external shuffle service.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org