You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Vinod Kancharana <vi...@gmail.com> on 2020/02/14 17:09:35 UTC

Spark 2.4.4 with Hive 2.3.6

I am trying to build Spark 2.4.4 from the source code. I see the default
Hive version as 1.2.1.

Is there a way I can compile spark with Hive 2.3.6?

I tried running ./dev/make-distribution.sh --pip --tgz -Phadoop-2.7
-Dhadoop.version=2.8.5 -Psparkr -Phive -Phive-thriftserver
-Dhive.group=org.apache.hive -Dhive.version=2.3.6
-Dhive.version.short=2.3.6 -Pmesos -Pyarn -Pkubernetes but running into
errors while compiling hive.

Any suggestions?