[jira] [Created] (ARROW-17498) [CI] Nightly build failure on integration tests with spark master job

["Raúl Cumplido (Jira)" <ji...@apache.org>]

Raúl Cumplido created ARROW-17498:
-------------------------------------

             Summary: [CI] Nightly build failure on integration tests with spark master job
                 Key: ARROW-17498
                 URL: https://issues.apache.org/jira/browse/ARROW-17498
             Project: Apache Arrow
          Issue Type: Bug
          Components: Continuous Integration
            Reporter: Raúl Cumplido
            Assignee: Raúl Cumplido


The nightly integration test with spark job is failing:

[test-conda-python-3.9-spark-master|https://github.com/ursacomputing/crossbow/runs/7942893732?check_suite_focus=true]

with the following error:
{code:java}
 Testing Spark:
org.apache.spark.sql.execution.arrow
org.apache.spark.sql.execution.vectorized.ColumnarBatchSuite
org.apache.spark.sql.execution.vectorized.ArrowColumnVectorSuite
Using `mvn` from path: /spark/build/apache-maven-3.8.6/bin/mvn
[WARNING] format.skipSources set, ignoring main directories
[WARNING] format.skipTestSources set, ignoring validateOnly directories
[WARNING] No sources specified, skipping formatting
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:3.0.0-M7:test (test) on project spark-parent_2.12: No tests matching pattern "none" were executed! (Set -Dsurefire.failIfNoSpecifiedTests=false to ignore this error.) -> [Help 1]{code}
I can reproduce locally with:
{code:java}
$ PYTHON=3.9 SPARK=master docker-compose build conda-python-spark
$ PYTHON=3.9 SPARK=master docker-compose run --rm -e SETUPTOOLS_SCM_PRETEND_VERSION=9.0.0.dev620 conda-python-spark {code}
The issue seems to be triggered by this commit on spark master [https://github.com/apache/spark/commit/3ed382f391911ec4a79fb204f4986728017dfa4a] which updates the version of maven-surefire-plugin to 3.0.0-M7



--
This message was sent by Atlassian Jira
(v8.20.10#820010)