You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by jiahong li <mo...@gmail.com> on 2021/03/10 02:49:56 UTC

spark 3.1.1 support hive 1.2

Hi,sorry to bother you.In spark 3.0.1,hive-1.2 is supported,but in spark
3.1.x maven profile hive-1.1 is removed.Is that means hive-1.2 does not
supported  in spark 3.1.x? how can i support hive-1.2 in spark 3.1.x,or any
jira? can anyone help me ?

Re: spark 3.1.1 support hive 1.2

Posted by jiahong li <mo...@gmail.com>.
thanks, i try it right now

Kent Yao <ya...@qq.com> 于2021年3月10日周三 上午11:11写道:

> Hi Li,
> Have you tried `Interacting with Different Versions of Hive Metastore`
> http://spark.apache.org/docs/latest/sql-data-sources-hive-tables.html#interacting-with-different-versions-of-hive-metastore
>
>
> Bests,
>
> *Kent Yao *
> @ Data Science Center, Hangzhou Research Institute, NetEase Corp.
> *a spark enthusiast*
> *kyuubi <https://github.com/yaooqinn/kyuubi>is a unified multi-tenant JDBC
> interface for large-scale data processing and analytics, built on top
> of Apache Spark <http://spark.apache.org/>.*
> *spark-authorizer <https://github.com/yaooqinn/spark-authorizer>A Spark
> SQL extension which provides SQL Standard Authorization for **Apache
> Spark <http://spark.apache.org/>.*
> *spark-postgres <https://github.com/yaooqinn/spark-postgres> A library for
> reading data from and transferring data to Postgres / Greenplum with Spark
> SQL and DataFrames, 10~100x faster.*
> *spark-func-extras <https://github.com/yaooqinn/spark-func-extras>A
> library that brings excellent and useful functions from various modern
> database management systems to Apache Spark <http://spark.apache.org/>.*
>
>
>
> On 03/10/2021 10:56,jiahong li<mo...@gmail.com>
> <mo...@gmail.com> wrote:
>
> Hi,sorry to bother you.In spark 3.0.1,hive-1.2 is supported,but in spark
> 3.1.x maven profile hive-1.1 is removed.Is that means hive-1.2 does not
> supported  in spark 3.1.x? how can i support hive-1.2 in spark 3.1.x,or any
> jira? can anyone help me ?
>
>

Re:spark 3.1.1 support hive 1.2

Posted by Kent Yao <ya...@qq.com>.
Hi Li,

Have you tried `Interacting with Different Versions of Hive Metastore`
<http://spark.apache.org/docs/latest/sql-data-sources-hive-
tables.html#interacting-with-different-versions-of-hive-metastore>

  

Bests,

  

**Kent Yao  **

@ Data Science Center, Hangzhou Research Institute, NetEase Corp.

 ** _a s_ _park  enthusiast_**

 _[kyuubi](https://github.com/yaooqinn/kyuubi) is a unified multi-tenant JDBC
interface for large-scale data processing and analytics, built on top of
[Apache Spark](http://spark.apache.org/)._

#

 _[spark-authorizer](https://github.com/yaooqinn/spark-authorizer) A Spark SQL
extension which provides SQL Standard Authorization for _ _[Apache
Spark](http://spark.apache.org/)._

 _ _[spark-postgres](https://github.com/yaooqinn/spark-postgres)  A library
for reading data from and transferring data to Postgres / Greenplum with Spark
SQL and DataFrames, 10~100x faster.__

 _ _[spark-func-extras](https://github.com/yaooqinn/spark-func-extras) A
library that brings excellent and useful functions from various modern
database management systems to _ _[Apache Spark](http://spark.apache.org/).__

#

  

  

  

On 03/10/2021 10:56,[jiahong
li<mo...@gmail.com>](mailto:monkeyboy.ljh@gmail.com) wrote:

> Hi,sorry to bother you.In spark 3.0.1,hive-1.2 is supported,but in spark
3.1.x maven profile hive-1.1 is removed.Is that means hive-1.2 does not
supported  in spark 3.1.x? how can i support hive-1.2 in spark 3.1.x,or any
jira? can anyone help me ?  
>