[GitHub] [spark] jlpedrosa opened a new pull request #24702: Added retries on the connection to the driver for k8s

[GitBox <gi...@apache.org>]

jlpedrosa opened a new pull request #24702: Added retries on the connection to the driver for k8s
URL: https://github.com/apache/spark/pull/24702
 
 
   Disabled negative dns caching for docker images
   
   Improved logging on DNS resolution, convenient for slow k8s clusters
   
   ## What changes were proposed in this pull request?
   Added retries when building the connection to the driver in K8s.
   In some scenarios DNS reslution can take more than the timeout.
   Also openjdk-8 by default has negative dns caching enabled, which means even retries may not help depending on the times.
   
   ## How was this patch tested?
   This patch was tested agains an specific k8s cluster with slow response time in DNS to ensure it woks.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org