You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Roger Liu (Jira)" <ji...@apache.org> on 2019/09/03 23:29:00 UTC

[jira] [Created] (SPARK-28966) Cached DNS name resolution error

Roger Liu created SPARK-28966:
---------------------------------

             Summary: Cached DNS name resolution error
                 Key: SPARK-28966
                 URL: https://issues.apache.org/jira/browse/SPARK-28966
             Project: Spark
          Issue Type: Bug
          Components: YARN
    Affects Versions: 2.4.0, 2.3.0, 2.2.0, 2.1.0, 2.0.0
            Reporter: Roger Liu


In Kubernetes, the a node may go down and then come back later with a different IP address. Yarn clients which are already running will be unable to rediscover the node after it comes back up due to caching the original IP address. This is problematic for cases such as Spark HA on Kubernetes, as the node containing the resource manager may go down and come back up, meaning existing node managers must then also be restarted.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org