[GitHub] [spark] dongjoon-hyun commented on a diff in pull request #36358: [SPARK-39023] [K8s] Add Executor Pod inter-pod anti-affinity

[GitBox <gi...@apache.org>]

dongjoon-hyun commented on code in PR #36358:
URL: https://github.com/apache/spark/pull/36358#discussion_r876653355


##########
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Config.scala:
##########
@@ -684,6 +684,15 @@ private[spark] object Config extends Logging {
       .checkValue(value => value > 0, "Maximum number of pending pods should be a positive integer")
       .createWithDefault(Int.MaxValue)
 
+  private [spark] val KUBERNETES_EXECUTOR_POD_ANTI_AFFINITY =
+    ConfigBuilder("spark.kubernetes.executor.pod.antiAffinity.enable")
+      .doc("If enable, register executor with anti affinity. This anti affinity will help " +
+        "Kubernetes assign executors of the same Application to different nodes " +
+        "as much as possible")
+      .version("3.2.1")

Review Comment:
   In addition, Apache Spark follows Semantic Versioning policy which means new features and improvements should be the version of `master` branch, currently, 3.4.0.
   - https://spark.apache.org/versioning-policy.html



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org