[GitHub] [spark] khogeland edited a comment on issue #26687: [SPARK-30055][k8s] Allow configuration of restart policy for Kubernetes pods

[GitBox <gi...@apache.org>]

khogeland edited a comment on issue #26687: [SPARK-30055][k8s] Allow configuration of restart policy for Kubernetes pods
URL: https://github.com/apache/spark/pull/26687#issuecomment-561743930
 
 
   >Now, let's assume we restart the executors
   
   I think you're misunderstanding what the restart policy does. The restart policy is a Kubernetes setting that controls what the host does when the pod containers exit (in this case, when the executor process exits). Setting the restart policy to always tells the host to always restart _executors processes that have exited._ It is a failure handling mechanism.
   
   >in what scenario "always" restarting the executors are better than the driver resending tasks?
   
   These are orthogonal and there is no trade-off. The driver resends tasks to available executors. Kubernetes keeps the executors running.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org