[jira] [Commented] (BIGTOP-3127) spark smoke-test fails in bigtop 1.3

["Evans Ye (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BIGTOP-3127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16735591#comment-16735591 ] 

Evans Ye commented on BIGTOP-3127:
----------------------------------

[~docularxu] this is because of SPARK_HOME is unset. I'll have this fixed in CI with BIGTOP-3124. Meanwhile, for those consuming bigtop tests to test other Hadoop distribution, we need to update the smoke test document to have SPARK_HOME exported.

> spark smoke-test fails in bigtop 1.3 
> -------------------------------------
>
>                 Key: BIGTOP-3127
>                 URL: https://issues.apache.org/jira/browse/BIGTOP-3127
>             Project: Bigtop
>          Issue Type: Bug
>          Components: spark, tests
>    Affects Versions: 1.3.0
>            Reporter: Guodong Xu
>            Priority: Major
>
> In Bigtop 1.3, when smoke-tests 'spark' using docker containers, it fails to run. Log report says: "> undeclared env variable: SPARK_HOME"
> Steps to reproduce:
>  # create a local 3-node containers cluster
>  ** $ cd provisioner/docker/
>  ** $ ./docker-hadoop.sh -C smoketests-spark_centos-7.yaml -c 3
>  # run smoke tests,
>  ** $ ./docker-hadoop.sh -s
>  # check the output log, it reports failure:
> :bigtop-tests:smoke-tests:spark:test (Thread[Task worker for ':' Thread 19,5,main]) started.
> :bigtop-tests:smoke-tests:spark:test
> Putting task artifact state for task ':bigtop-tests:smoke-tests:spark:test' into context took 0.0 secs.
> Up-to-date check for task ':bigtop-tests:smoke-tests:spark:test' took 0.035 secs. It is not up-to-date because:
>  No history is available.
> :bigtop-tests:smoke-tests:spark:test FAILED
> :bigtop-tests:smoke-tests:spark:test (Thread[Task worker for ':' Thread 19,5,main]) completed. Took 0.065 secs.
> FAILURE: Build failed with an exception.
> * Where:
> Build file '/bigtop-home/bigtop-tests/smoke-tests/build.gradle' line: 26
>  * What went wrong:
> Execution failed for task ':bigtop-tests:smoke-tests:spark:test'.
> > undeclared env variable: SPARK_HOME



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)