[jira] [Created] (SPARK-25999) Spark make-distribution failure with --r and -Phadoop-provided

["shanyu zhao (JIRA)" <ji...@apache.org>]

shanyu zhao created SPARK-25999:
-----------------------------------

             Summary: Spark make-distribution failure with --r and -Phadoop-provided
                 Key: SPARK-25999
                 URL: https://issues.apache.org/jira/browse/SPARK-25999
             Project: Spark
          Issue Type: Bug
          Components: Build
    Affects Versions: 2.4.0, 2.3.2
            Reporter: shanyu zhao


It is not possible to build a distribution that doesn't contain hadoop dependencies but include SparkR. This is because R/check_cran.sh builds R document which depends on hadoop dependencies in assembly/target/scala-xxx/jars folder.

To reproduce:

MAVEN_BUILD_OPTS="-Dmaven.javadoc.skip=true -Pyarn -Phadoop-2.7 -Phive -Psparkr -Phadoop-provided"

./dev/make-distribution.sh --tgz --r $MAVEN_BUILD_OPTS

 

Error:
* creating vignettes ... ERROR
...
Error: A JNI error has occurred, please check your installation and try again
Exception in thread "main" java.lang.NoClassDefFoundError: org/slf4j/Logger



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org