You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Prabhu Joseph (JIRA)" <ji...@apache.org> on 2017/11/02 09:36:00 UTC

[jira] [Updated] (SPARK-22426) Spark AM launching containers on node where External spark shuffle service failed to initialize

     [ https://issues.apache.org/jira/browse/SPARK-22426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Prabhu Joseph updated SPARK-22426:
----------------------------------
    Component/s: YARN

> Spark AM launching containers on node where External spark shuffle service failed to initialize
> -----------------------------------------------------------------------------------------------
>
>                 Key: SPARK-22426
>                 URL: https://issues.apache.org/jira/browse/SPARK-22426
>             Project: Spark
>          Issue Type: Bug
>          Components: Shuffle, YARN
>    Affects Versions: 1.6.3
>            Reporter: Prabhu Joseph
>            Priority: Major
>
> When Spark External Shuffle Service on a NodeManager fails, the remote executors will fail while fetching the data from the executors launched on this Node. Spark ApplicationMaster should not launch containers on this Node or not use external shuffle service.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org