You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Mohamadreza Rostami (Jira)" <ji...@apache.org> on 2021/10/19 14:30:00 UTC

[jira] [Created] (SPARK-37060) Report driver status does not handle response from backup masters

Mohamadreza Rostami created SPARK-37060:
-------------------------------------------

             Summary: Report driver status does not handle response from backup masters
                 Key: SPARK-37060
                 URL: https://issues.apache.org/jira/browse/SPARK-37060
             Project: Spark
          Issue Type: Bug
          Components: Spark Core
    Affects Versions: 3.2.0, 3.1.2, 3.1.1, 3.1.0
            Reporter: Mohamadreza Rostami


After a improvement in SPARK-31486, contributor uses 'asyncSendToMasterAndForwardReply' method instead of 'activeMasterEndpoint.askSync' to get the status of driver. Since the driver's status is only available inactive master and the 'asyncSendToMasterAndForwardReply' method iterate over all of the masters, we have to handle the response from the backup masters in the client, which the developer did not consider in the SPARK-31486 change. So drivers running in cluster mode and on a cluster with multi-master affected by this bug.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org