[jira] [Commented] (ARROW-17498) [CI] Nightly build failure on integration tests with spark master job

["Raúl Cumplido (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/ARROW-17498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17583044#comment-17583044 ] 

Raúl Cumplido commented on ARROW-17498:
---------------------------------------

This is the last nightly job that worked: [https://github.com/ursacomputing/crossbow/runs/7935265982]
There were only 84 tests run:
{code:java}
Total number of tests run: 84 {code}
When running the current failing command:
{code:java}
build/mvn -B -Dtest=none -DwildcardSuites=$(IFS=,; echo "${spark_scala_tests[*]}") test{code}

> [CI] Nightly build failure on integration tests with spark master job
> ---------------------------------------------------------------------
>
>                 Key: ARROW-17498
>                 URL: https://issues.apache.org/jira/browse/ARROW-17498
>             Project: Apache Arrow
>          Issue Type: Bug
>          Components: Continuous Integration
>            Reporter: Raúl Cumplido
>            Assignee: Raúl Cumplido
>            Priority: Major
>              Labels: Nightly
>
> The nightly integration test with spark job is failing:
> [test-conda-python-3.9-spark-master|https://github.com/ursacomputing/crossbow/runs/7942893732?check_suite_focus=true]
> with the following error:
> {code:java}
>  Testing Spark:
> org.apache.spark.sql.execution.arrow
> org.apache.spark.sql.execution.vectorized.ColumnarBatchSuite
> org.apache.spark.sql.execution.vectorized.ArrowColumnVectorSuite
> Using `mvn` from path: /spark/build/apache-maven-3.8.6/bin/mvn
> [WARNING] format.skipSources set, ignoring main directories
> [WARNING] format.skipTestSources set, ignoring validateOnly directories
> [WARNING] No sources specified, skipping formatting
> [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:3.0.0-M7:test (test) on project spark-parent_2.12: No tests matching pattern "none" were executed! (Set -Dsurefire.failIfNoSpecifiedTests=false to ignore this error.) -> [Help 1]{code}
> I can reproduce locally with:
> {code:java}
> $ PYTHON=3.9 SPARK=master docker-compose build conda-python-spark
> $ PYTHON=3.9 SPARK=master docker-compose run --rm -e SETUPTOOLS_SCM_PRETEND_VERSION=9.0.0.dev620 conda-python-spark {code}
> The issue seems to be triggered by this commit on spark master [https://github.com/apache/spark/commit/3ed382f391911ec4a79fb204f4986728017dfa4a] which updates the version of maven-surefire-plugin to 3.0.0-M7



--
This message was sent by Atlassian Jira
(v8.20.10#820010)