[jira] [Updated] (SPARK-32335) Remove Python2 test from K8s IT

["Dongjoon Hyun (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-32335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dongjoon Hyun updated SPARK-32335:
----------------------------------
        Parent: SPARK-33005
    Issue Type: Sub-task  (was: Task)

> Remove Python2 test from K8s IT
> -------------------------------
>
>                 Key: SPARK-32335
>                 URL: https://issues.apache.org/jira/browse/SPARK-32335
>             Project: Spark
>          Issue Type: Sub-task
>          Components: Kubernetes, Tests
>    Affects Versions: 3.1.0
>            Reporter: Dongjoon Hyun
>            Assignee: Dongjoon Hyun
>            Priority: Major
>             Fix For: 3.1.0
>
>
> Since we removed Python 2 support, the test case fails.
> {code}
> KubernetesSuite:
> - Run SparkPi with no resources
> - Run SparkPi with a very long application name.
> - Use SparkLauncher.NO_RESOURCE
> - Run SparkPi with a master URL without a scheme.
> - Run SparkPi with an argument.
> - Run SparkPi with custom labels, annotations, and environment variables.
> - All pods have the same service account by default
> - Run extraJVMOptions check on driver
> - Run SparkRemoteFileTest using a remote data file
> - Run SparkPi with env and mount secrets.
> - Run PySpark on simple pi.py example
> - Run PySpark with Python2 to test a pyfiles example *** FAILED ***
>   The code passed to eventually never returned normally. Attempted 113 times over 2.0014854648999996 minutes. Last failure message: false was not true. (KubernetesSuite.scala:370)
> - Run PySpark with Python3 to test a pyfiles example
> - Run PySpark with memory customization
> - Run in client mode.
> - Start pod creation from template
> - PVs with local storage
> - Launcher client dependencies
> - Test basic decommissioning
> - Run SparkR on simple dataframe.R example
> Run completed in 11 minutes, 15 seconds.
> Total number of tests run: 20
> Suites: completed 2, aborted 0
> Tests: succeeded 19, failed 1, canceled 0, ignored 0, pending 0
> *** 1 TEST FAILED ***
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org