You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Stavros Kontopoulos (JIRA)" <ji...@apache.org> on 2018/11/02 19:12:00 UTC

[jira] [Created] (SPARK-25930) Fix scala version string detection when maven-help-plugin is not pre-installed

Stavros Kontopoulos created SPARK-25930:
-------------------------------------------

             Summary: Fix scala version string detection when maven-help-plugin is not pre-installed
                 Key: SPARK-25930
                 URL: https://issues.apache.org/jira/browse/SPARK-25930
             Project: Spark
          Issue Type: Bug
          Components: Kubernetes
    Affects Versions: 2.4.0, 3.0.0
            Reporter: Stavros Kontopoulos


This line [https://github.com/apache/spark/blob/c71db43e11fb90d6675421604ad29f596f2b8bfe/resource-managers/kubernetes/integration-tests/dev/dev-run-integration-tests.sh#L32] detects the scala version based on the line that does not contain character `[`

All lines contain text in brackets besides the scala version:

[WARNING] Failed to retrieve plugin descriptor for org.eclipse.m2e:lifecycle-mapping:1.0.0: Plugin org.eclipse.m2e:lifecycle-mapping:1.0.0 or one of its dependencies could not be resolved: Failure to find org.eclipse.m2e:lifecycle-mapping:jar:1.0.0 in https://repo.maven.apache.org/maven2 was cached in the local repository, resolution will not be reattempted until the update interval of central has elapsed or updates are forced

[INFO] 
2.11
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] Spark Project Parent POM 3.0.0-SNAPSHOT ............ SUCCESS [ 0.446 s]
[INFO] Spark Project Tags ................................. SKIPPED
[INFO] Spark Project Sketch ............................... SKIPPED

 

If the plugin is not installed several lines will be added to the output :

[INFO] --- maven-help-plugin:2.1.1:evaluate (default-cli) @ spark-parent_2.11 ---
Downloading from central: [https://repo.maven.apache.org/maven2/org/apache/maven/plugin-tools/maven-plugin-tools-api/2.4.3/maven-plugin-tools-api-2.4.3.pom]

This will mess with the logic above and the scala version will be wrong failing the tests. 

We should only pick the last string. Although tests are run now manually, this should be fixed.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org