You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2019/07/07 18:54:53 UTC
[GitHub] [spark] srowen commented on a change in pull request #25063:
[SPARK-28267][DOC] Update building-spark.md(build with Hive 2.3)
srowen commented on a change in pull request #25063: [SPARK-28267][DOC] Update building-spark.md(build with Hive 2.3)
URL: https://github.com/apache/spark/pull/25063#discussion_r300880292
##########
File path: docs/building-spark.md
##########
@@ -79,15 +81,23 @@ Example:
./build/mvn -Pyarn -Dhadoop.version=2.8.5 -DskipTests clean package
+ ./build/mvn -Pyarn -Phadoop-3.2 -Dhadoop.version=3.1.2 -DskipTests clean package
+
## Building With Hive and JDBC Support
To enable Hive integration for Spark SQL along with its JDBC server and CLI,
add the `-Phive` and `Phive-thriftserver` profiles to your existing build options.
-By default Spark will build with Hive 1.2.1 bindings.
+By default, Spark will build hadoop-2.7 with Hive 1.2.1 and hadoop-3.2 with Hive 2.3.5.
# With Hive 1.2.1 support
./build/mvn -Pyarn -Phive -Phive-thriftserver -DskipTests clean package
+ # With Hive 2.3.5 support
+ ./build/mvn -Pyarn -Phive -Phive-thriftserver -Phadoop-3.2 -DskipTests clean package
+
+ # Hadoop 2.7 with Hive 2.3.5 support
+ ./build/mvn -Pyarn -Phive -Phive-thriftserver -Phadoop-3.2 -Dhadoop.version=2.7.4 -Dcurator.version=2.7.1 -Dzookeeper.version=3.4.6 -DskipTests clean package
Review comment:
Yes, we don't need to spell out every possible combination especially unconventional ones. I would not add this clause.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org