You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@zeppelin.apache.org by "polar wang (JIRA)" <ji...@apache.org> on 2016/07/18 15:20:20 UTC
[jira] [Created] (ZEPPELIN-1207) to build Spark Interpreter occur
problem
polar wang created ZEPPELIN-1207:
------------------------------------
Summary: to build Spark Interpreter occur problem
Key: ZEPPELIN-1207
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1207
Project: Zeppelin
Issue Type: Test
Components: zeppelin-interpreter
Affects Versions: 0.5.6
Environment: centos6.5 x64; Hadoop 2.5.0-zdh2.0.2-SNAPSHOT; spark version 1.4.1
Reporter: polar wang
Fix For: 0.5.6
[mr@2en ~]$ hadoop version
Hadoop 2.5.0-zdh2.0.2-SNAPSHOT
Subversion http://svn.server/svn/ZXNVA/branches/Br_DAPV20.14.30/Br_ZDH -r Unknown
Compiled by root on 2015-09-10T01:48Z
Compiled with protoc 2.5.0
From source with checksum 1f61e7cdf5a34deb654260e6ae3bfc2a
This command was run using /home/mr/yarn/share/hadoop/common/hadoop-common-2.5.0-zdh2.0.2-SNAPSHOT.jar
[mr@2en bin]$ pwd
/home/mr/spark/bin
[mr@2en bin]$ ./spark-submit --version
Welcome to
____ __
/ __/__ ___ _____/ /__
_\ \/ _ \/ _ `/ __/ '_/
/___/ .__/\_,_/_/ /_/\_\ version 1.4.1
/_/
Type --help for more information.
[mr@2en conf]# vim /home/polar/zeppelin-0.5.6/conf/zeppelin-env.sh
export SPARK_HOME=/home/mr/spark/bin
export SPARK_SUBMIT_OPTIONS='--packages com.databricks:spark-csv_2.10:1.2.0'
export HADOOP_CONF_DIR=/home/hdfs/hdfs/lib/native
(refer：https://github.com/apache/zeppelin/tree/v0.5.6)
build Spark Interpreter occur a problem：
[root@2en zeppelin-0.5.6]# mvn clean package -Pspark-1.4 -Dhadoop.version=2.5.0-cdh2.0.2-SNAPSHOT -Phadoop 2.5 -Pvendor-repo -DskipTests
[INFO] ------------------------------------------------------------------------
[INFO] Building Zeppelin 0.5.6-incubating
[INFO] ------------------------------------------------------------------------
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Zeppelin ........................................... FAILURE [ 0.071 s]
[INFO] Zeppelin: Interpreter .............................. SKIPPED
[INFO] Zeppelin: Zengine .................................. SKIPPED
[INFO] Zeppelin: Spark dependencies ....................... SKIPPED
[INFO] Zeppelin: Spark .................................... SKIPPED
[INFO] Zeppelin: Markdown interpreter ..................... SKIPPED
[INFO] Zeppelin: Angular interpreter ...................... SKIPPED
[INFO] Zeppelin: Shell interpreter ........................ SKIPPED
[INFO] Zeppelin: Hive interpreter ......................... SKIPPED
[INFO] Zeppelin: Apache Phoenix Interpreter ............... SKIPPED
[INFO] Zeppelin: PostgreSQL interpreter ................... SKIPPED
[INFO] Zeppelin: Tajo interpreter ......................... SKIPPED
[INFO] Zeppelin: Flink .................................... SKIPPED
[INFO] Zeppelin: Apache Ignite interpreter ................ SKIPPED
[INFO] Zeppelin: Kylin interpreter ........................ SKIPPED
[INFO] Zeppelin: Lens interpreter ......................... SKIPPED
[INFO] Zeppelin: Cassandra ................................ SKIPPED
[INFO] Zeppelin: Elasticsearch interpreter ................ SKIPPED
[INFO] Zeppelin: web Application .......................... SKIPPED
[INFO] Zeppelin: Server ................................... SKIPPED
[INFO] Zeppelin: Packaging distribution ................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 0.692 s
[INFO] Finished at: 2016-07-18T18:33:10+08:00
[INFO] Final Memory: 28M/1963M
[INFO] ------------------------------------------------------------------------
[WARNING] The requested profile "hadoop" could not be activated because it does not exist.
[ERROR] Unknown lifecycle phase "2.5". You must specify a valid lifecycle phase or a goal in the format <plugin-prefix>:<goal> or <plugin-group-id>:<plugin-artifact-id>[:<plugin-version>]:<goal>. Available lifecycle phases are: validate, initialize, generate-sources, process-sources, generate-resources, process-resources, compile, process-classes, generate-test-sources, process-test-sources, generate-test-resources, process-test-resources, test-compile, process-test-classes, test, prepare-package, package, pre-integration-test, integration-test, post-integration-test, verify, install, deploy, pre-clean, clean, post-clean, pre-site, site, post-site, site-deploy. -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/LifecyclePhaseNotFoundException
[root@2en zeppelin-0.5.6]#
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
Re: [jira] [Created] (ZEPPELIN-1207) to build Spark Interpreter occur problem
Posted by Hyung Sung Shim <hs...@nflabs.com>.
hi.
Maybe it must be the "-Phadoop-2.5" not "-Phadoop 2.5" .(you missed the
'-')
2016-07-19 0:20 GMT+09:00 polar wang (JIRA) <ji...@apache.org>:
> polar wang created ZEPPELIN-1207:
> ------------------------------------
>
> Summary: to build Spark Interpreter occur problem
> Key: ZEPPELIN-1207
> URL: https://issues.apache.org/jira/browse/ZEPPELIN-1207
> Project: Zeppelin
> Issue Type: Test
> Components: zeppelin-interpreter
> Affects Versions: 0.5.6
> Environment: centos6.5 x64; Hadoop 2.5.0-zdh2.0.2-SNAPSHOT; spark
> version 1.4.1
> Reporter: polar wang
> Fix For: 0.5.6
>
>
> [mr@2en ~]$ hadoop version
> Hadoop 2.5.0-zdh2.0.2-SNAPSHOT
> Subversion http://svn.server/svn/ZXNVA/branches/Br_DAPV20.14.30/Br_ZDH -r
> Unknown
> Compiled by root on 2015-09-10T01:48Z
> Compiled with protoc 2.5.0
> From source with checksum 1f61e7cdf5a34deb654260e6ae3bfc2a
> This command was run using
> /home/mr/yarn/share/hadoop/common/hadoop-common-2.5.0-zdh2.0.2-SNAPSHOT.jar
> [mr@2en bin]$ pwd
> /home/mr/spark/bin
> [mr@2en bin]$ ./spark-submit --version
> Welcome to
> ____ __
> / __/__ ___ _____/ /__
> _\ \/ _ \/ _ `/ __/ '_/
> /___/ .__/\_,_/_/ /_/\_\ version 1.4.1
> /_/
>
> Type --help for more information.
>
> [mr@2en conf]# vim /home/polar/zeppelin-0.5.6/conf/zeppelin-env.sh
> export SPARK_HOME=/home/mr/spark/bin
> export SPARK_SUBMIT_OPTIONS='--packages
> com.databricks:spark-csv_2.10:1.2.0'
> export HADOOP_CONF_DIR=/home/hdfs/hdfs/lib/native
>
>
> (refer：https://github.com/apache/zeppelin/tree/v0.5.6)
> build Spark Interpreter occur a problem：
> [root@2en zeppelin-0.5.6]# mvn clean package -Pspark-1.4
> -Dhadoop.version=2.5.0-cdh2.0.2-SNAPSHOT -Phadoop 2.5 -Pvendor-repo
> -DskipTests
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Building Zeppelin 0.5.6-incubating
> [INFO]
> ------------------------------------------------------------------------
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Zeppelin ........................................... FAILURE [
> 0.071 s]
> [INFO] Zeppelin: Interpreter .............................. SKIPPED
> [INFO] Zeppelin: Zengine .................................. SKIPPED
> [INFO] Zeppelin: Spark dependencies ....................... SKIPPED
> [INFO] Zeppelin: Spark .................................... SKIPPED
> [INFO] Zeppelin: Markdown interpreter ..................... SKIPPED
> [INFO] Zeppelin: Angular interpreter ...................... SKIPPED
> [INFO] Zeppelin: Shell interpreter ........................ SKIPPED
> [INFO] Zeppelin: Hive interpreter ......................... SKIPPED
> [INFO] Zeppelin: Apache Phoenix Interpreter ............... SKIPPED
> [INFO] Zeppelin: PostgreSQL interpreter ................... SKIPPED
> [INFO] Zeppelin: Tajo interpreter ......................... SKIPPED
> [INFO] Zeppelin: Flink .................................... SKIPPED
> [INFO] Zeppelin: Apache Ignite interpreter ................ SKIPPED
> [INFO] Zeppelin: Kylin interpreter ........................ SKIPPED
> [INFO] Zeppelin: Lens interpreter ......................... SKIPPED
> [INFO] Zeppelin: Cassandra ................................ SKIPPED
> [INFO] Zeppelin: Elasticsearch interpreter ................ SKIPPED
> [INFO] Zeppelin: web Application .......................... SKIPPED
> [INFO] Zeppelin: Server ................................... SKIPPED
> [INFO] Zeppelin: Packaging distribution ................... SKIPPED
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 0.692 s
> [INFO] Finished at: 2016-07-18T18:33:10+08:00
> [INFO] Final Memory: 28M/1963M
> [INFO]
> ------------------------------------------------------------------------
> [WARNING] The requested profile "hadoop" could not be activated because it
> does not exist.
> [ERROR] Unknown lifecycle phase "2.5". You must specify a valid lifecycle
> phase or a goal in the format <plugin-prefix>:<goal> or
> <plugin-group-id>:<plugin-artifact-id>[:<plugin-version>]:<goal>. Available
> lifecycle phases are: validate, initialize, generate-sources,
> process-sources, generate-resources, process-resources, compile,
> process-classes, generate-test-sources, process-test-sources,
> generate-test-resources, process-test-resources, test-compile,
> process-test-classes, test, prepare-package, package, pre-integration-test,
> integration-test, post-integration-test, verify, install, deploy,
> pre-clean, clean, post-clean, pre-site, site, post-site, site-deploy. ->
> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/LifecyclePhaseNotFoundException
> [root@2en zeppelin-0.5.6]#
>
>
>
> --
> This message was sent by Atlassian JIRA
> (v6.3.4#6332)
>