You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2021/10/26 08:16:33 UTC
[GitHub] [spark] wfxxh commented on pull request #34378: spark executor pod anti affinity when run on k8s
wfxxh commented on pull request #34378:
URL: https://github.com/apache/spark/pull/34378#issuecomment-951685133
.setConf("spark.kubernetes.executor.label.YOURKEY", "YOURVALUE")
.setConf("spark.kubernetes.executor.podAffinityKey", "YOURKEY")
.setConf("spark.kubernetes.executor.podAffinityOperator", "In")
.setConf("spark.kubernetes.executor.podAffinityValue", "YOURVALUE")
Set spark config like above, YOURKEY must be the same and YOURVAULE must be the same too.
The executor started by the same driver can not be start on the same node.
The different spark job must set different YOURKEY.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org