[GitHub] [spark] dongjoon-hyun edited a comment on pull request #35830: [WIP][K8S][INFRA] Enable K8S integration tests in Github Action

[GitBox <gi...@apache.org>]

dongjoon-hyun edited a comment on pull request #35830:
URL: https://github.com/apache/spark/pull/35830#issuecomment-1066031136


   @Yikun . Fine tuning is just to aim to launch the tests, not for guaranteeing the stability. The minimum requirement of CI is stability. As you see, we are already hitting many flakiness issues in GitHub Action due to the memory issues and the committers are manually mitigating them by re-triggering . Unless we can get a bigger VM machine, this addition will add another complexity and instability to Apache Spark GitHub Action.
   
   > Kubernetes is using 0.85 CPU 0.25G memeory, so only 1.15 CPU left, we can give 0.5 for driver, 0.2 for others executor (3 is max limited).
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org