[GitHub] [spark] dongjoon-hyun commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

[GitBox <gi...@apache.org>]

dongjoon-hyun commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support
URL: https://github.com/apache/spark/pull/26440#issuecomment-586557802
 
 
   Hi, @holdenk . This PR seems to add a flaky test on `master` branch.
   - https://github.com/apache/spark/pull/27589
   
   ```
   KubernetesSuite:
   - Run SparkPi with no resources
   - Run SparkPi with a very long application name.
   - Use SparkLauncher.NO_RESOURCE
   - Run SparkPi with a master URL without a scheme.
   - Run SparkPi with an argument.
   - Run SparkPi with custom labels, annotations, and environment variables.
   - All pods have the same service account by default
   - Run extraJVMOptions check on driver
   - Run SparkRemoteFileTest using a remote data file
   - Run SparkPi with env and mount secrets.
   - Run PySpark on simple pi.py example
   - Run PySpark with Python2 to test a pyfiles example
   - Run PySpark with Python3 to test a pyfiles example
   - Run PySpark with memory customization
   - Run in client mode.
   - Start pod creation from template
   - PVs with local storage
   - Launcher client dependencies
   - Test basic decommissioning *** FAILED ***
     The code passed to eventually never returned normally. Attempted 126 times over 2.0003060982000003 minutes.
   
   Last failure message: "++ id -u ..." did not contain "decommissioning executor" The application did not complete.. (KubernetesSuite.scala:383)
   - Run SparkR on simple dataframe.R example
   ```

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org