You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Jose Luis Pedrosa (JIRA)" <ji...@apache.org> on 2019/06/24 17:10:00 UTC

[jira] [Updated] (SPARK-28149) Disable negeative DNS caching

     [ https://issues.apache.org/jira/browse/SPARK-28149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jose Luis Pedrosa updated SPARK-28149:
--------------------------------------
    Summary: Disable negeative DNS caching  (was: Disable negeative DNS caching.)

> Disable negeative DNS caching
> -----------------------------
>
>                 Key: SPARK-28149
>                 URL: https://issues.apache.org/jira/browse/SPARK-28149
>             Project: Spark
>          Issue Type: Improvement
>          Components: Kubernetes
>    Affects Versions: 2.4.3
>            Reporter: Jose Luis Pedrosa
>            Priority: Minor
>
> By default JVM caches the failures for the DNS resolutions, by default is cached by 10 seconds.
> Alpine JDK used in the images for kubernetes has a default timout of 5 seconds.
> This means that in clusters with slow init time (network sidecar pods, slow network start up) executor will never run, because the first attempt to connect to the driver will fail, and that failure will be cached, causing  the retries to happen in a tight loop without actually trying again.
>  
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org