You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by dongjoon-hyun <gi...@git.apache.org> on 2018/05/22 23:16:49 UTC

[GitHub] spark pull request #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore

GitHub user dongjoon-hyun opened a pull request:

    https://github.com/apache/spark/pull/21404

    [SPARK-24360][SQL] Support Hive 3.0 metastore

    ## What changes were proposed in this pull request?
    
    Hive 3.0 is released. This PR aims to support Hive 3.0 metastore.
    
    ## How was this patch tested?
    
    Pass the Jenkins with the updated test cases including 3.0.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/dongjoon-hyun/spark SPARK-24360

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/spark/pull/21404.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #21404
    
----
commit 1523b6592725c3ca465ec0b6b63167cb4e6e3aec
Author: Dongjoon Hyun <do...@...>
Date:   2018-05-22T17:16:57Z

    [SPARK-24360][SQL] Support Hive 3.0 metastore

----


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/21404
  
    Test FAILed.
    Refer to this link for build results (access rights to CI server needed): 
    https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91001/
    Test FAILed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/21404
  
    Merged build finished. Test FAILed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore

Posted by dongjoon-hyun <gi...@git.apache.org>.
Github user dongjoon-hyun commented on the issue:

    https://github.com/apache/spark/pull/21404
  
    @tooptoop4 . Since this is a new feature, it's now targeting for Apache Spark 2.5 since `branch-2.4` is already cut. In addition, this will not be allowed for backporting `branch-2.4`. Is it urgent for you, @tooptoop4 ?


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore

Posted by gatorsmile <gi...@git.apache.org>.
Github user gatorsmile commented on the issue:

    https://github.com/apache/spark/pull/21404
  
    @wangyum I do not think we should deprecate the support of the previous versions of Hive metastore. Many Spark users are still using them. 


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/21404
  
    Test PASSed.
    Refer to this link for build results (access rights to CI server needed): 
    https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3485/
    Test PASSed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore

Posted by HyukjinKwon <gi...@git.apache.org>.
Github user HyukjinKwon commented on a diff in the pull request:

    https://github.com/apache/spark/pull/21404#discussion_r190097176
  
    --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala ---
    @@ -1148,3 +1149,128 @@ private[client] class Shim_v2_1 extends Shim_v2_0 {
     private[client] class Shim_v2_2 extends Shim_v2_1
     
     private[client] class Shim_v2_3 extends Shim_v2_1
    +
    +private[client] class Shim_v3_0 extends Shim_v2_3 {
    +  // Spark supports only non-ACID operations
    +  protected lazy val isAcidIUDoperation = JBoolean.FALSE
    +
    +  // Writer ID can be 0 for non-ACID operations
    +  protected lazy val writeIdInLoadTableOrPartition: JLong = 0L
    +
    +  // Statement ID
    +  protected lazy val stmtIdInLoadTableOrPartition: JInteger = 0
    +
    +  protected lazy val listBucketingLevel: JInteger = 0
    +
    +  private lazy val clazzLoadFileType = getClass.getClassLoader.loadClass(
    +    "org.apache.hadoop.hive.ql.plan.LoadTableDesc$LoadFileType")
    +
    +  private lazy val loadPartitionMethod =
    --- End diff --
    
    BTW, I tracked and checked all the signature changed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore

Posted by tooptoop4 <gi...@git.apache.org>.
Github user tooptoop4 commented on the issue:

    https://github.com/apache/spark/pull/21404
  
    bump


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore

Posted by dongjoon-hyun <gi...@git.apache.org>.
Github user dongjoon-hyun commented on the issue:

    https://github.com/apache/spark/pull/21404
  
    That would be helpful for us in the end. But, sorry for now. I'm currently not planning it open soon because the next release (Apache Spark 2.5 or 3.0) will next year.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/21404
  
    Test PASSed.
    Refer to this link for build results (access rights to CI server needed): 
    https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3481/
    Test PASSed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore

Posted by wangyum <gi...@git.apache.org>.
Github user wangyum commented on a diff in the pull request:

    https://github.com/apache/spark/pull/21404#discussion_r215232389
  
    --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/IsolatedClientLoader.scala ---
    @@ -99,6 +99,7 @@ private[hive] object IsolatedClientLoader extends Logging {
         case "2.1" | "2.1.0" | "2.1.1" => hive.v2_1
         case "2.2" | "2.2.0" => hive.v2_2
         case "2.3" | "2.3.0" | "2.3.1" | "2.3.2" | "2.3.3" => hive.v2_3
    +    case "3.0" | "3.0.0" => hive.v3_0
    --- End diff --
    
    @dongjoon-hyun Please update sql-programming-guide.md:  https://github.com/apache/spark/blob/05974f9431e9718a5f331a9892b7d81aca8387a6/docs/sql-programming-guide.md#L1217


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the issue:

    https://github.com/apache/spark/pull/21404
  
    **[Test build #91001 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91001/testReport)** for PR 21404 at commit [`1523b65`](https://github.com/apache/spark/commit/1523b6592725c3ca465ec0b6b63167cb4e6e3aec).
     * This patch **fails Spark unit tests**.
     * This patch merges cleanly.
     * This patch adds no public classes.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/21404
  
    Merged build finished. Test PASSed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the issue:

    https://github.com/apache/spark/pull/21404
  
    **[Test build #91003 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91003/testReport)** for PR 21404 at commit [`079771d`](https://github.com/apache/spark/commit/079771d6df16fd27fdf3cbd9b22f091c52990151).


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/21404
  
    Test FAILed.
    Refer to this link for build results (access rights to CI server needed): 
    https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91003/
    Test FAILed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore

Posted by tooptoop4 <gi...@git.apache.org>.
Github user tooptoop4 commented on the issue:

    https://github.com/apache/spark/pull/21404
  
    Also, can hive 3.1 be supported easily or are there some breaking changes? 


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the issue:

    https://github.com/apache/spark/pull/21404
  
    **[Test build #91003 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91003/testReport)** for PR 21404 at commit [`079771d`](https://github.com/apache/spark/commit/079771d6df16fd27fdf3cbd9b22f091c52990151).
     * This patch **fails Spark unit tests**.
     * This patch merges cleanly.
     * This patch adds no public classes.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore

Posted by dongjoon-hyun <gi...@git.apache.org>.
Github user dongjoon-hyun commented on the issue:

    https://github.com/apache/spark/pull/21404
  
    Retest this please.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore

Posted by gatorsmile <gi...@git.apache.org>.
Github user gatorsmile commented on a diff in the pull request:

    https://github.com/apache/spark/pull/21404#discussion_r190086082
  
    --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/package.scala ---
    @@ -79,7 +79,12 @@ package object client {
           exclusions = Seq("org.apache.curator:*",
             "org.pentaho:pentaho-aggdesigner-algorithm"))
     
    -    val allSupportedHiveVersions = Set(v12, v13, v14, v1_0, v1_1, v1_2, v2_0, v2_1, v2_2, v2_3)
    +    case object v3_0 extends HiveVersion("3.0.0",
    +      exclusions = Seq("org.apache.curator:*",
    +        "org.apache.hadoop:hadoop-aws",
    --- End diff --
    
    What happened if we do not have this?


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore

Posted by tooptoop4 <gi...@git.apache.org>.
Github user tooptoop4 commented on the issue:

    https://github.com/apache/spark/pull/21404
  
    @dongjoon-hyun I was planning to do my own custom build by cherrypicking your PR if you had it available


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/21404
  
    Merged build finished. Test FAILed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the issue:

    https://github.com/apache/spark/pull/21404
  
    **[Test build #91001 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91001/testReport)** for PR 21404 at commit [`1523b65`](https://github.com/apache/spark/commit/1523b6592725c3ca465ec0b6b63167cb4e6e3aec).


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/21404
  
    Test PASSed.
    Refer to this link for build results (access rights to CI server needed): 
    https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3482/
    Test PASSed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore

Posted by HyukjinKwon <gi...@git.apache.org>.
Github user HyukjinKwon commented on the issue:

    https://github.com/apache/spark/pull/21404
  
    Probably separate ticket for Spark 3.0.0.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the issue:

    https://github.com/apache/spark/pull/21404
  
    **[Test build #91008 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91008/testReport)** for PR 21404 at commit [`079771d`](https://github.com/apache/spark/commit/079771d6df16fd27fdf3cbd9b22f091c52990151).
     * This patch **fails Spark unit tests**.
     * This patch merges cleanly.
     * This patch adds no public classes.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore

Posted by dongjoon-hyun <gi...@git.apache.org>.
Github user dongjoon-hyun commented on a diff in the pull request:

    https://github.com/apache/spark/pull/21404#discussion_r190088876
  
    --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/package.scala ---
    @@ -79,7 +79,12 @@ package object client {
           exclusions = Seq("org.apache.curator:*",
             "org.pentaho:pentaho-aggdesigner-algorithm"))
     
    -    val allSupportedHiveVersions = Set(v12, v13, v14, v1_0, v1_1, v1_2, v2_0, v2_1, v2_2, v2_3)
    +    case object v3_0 extends HiveVersion("3.0.0",
    +      exclusions = Seq("org.apache.curator:*",
    +        "org.apache.hadoop:hadoop-aws",
    --- End diff --
    
    Thanks. I'll remove this in this PR.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore

Posted by gatorsmile <gi...@git.apache.org>.
Github user gatorsmile commented on the issue:

    https://github.com/apache/spark/pull/21404
  
    @dongjoon-hyun Thanks for your investigation!


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore

Posted by dongjoon-hyun <gi...@git.apache.org>.
Github user dongjoon-hyun commented on the issue:

    https://github.com/apache/spark/pull/21404
  
    The failures some from `ClassNotFoundException: org.apache.logging.log4j.util.Strings`.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the issue:

    https://github.com/apache/spark/pull/21404
  
    **[Test build #91008 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91008/testReport)** for PR 21404 at commit [`079771d`](https://github.com/apache/spark/commit/079771d6df16fd27fdf3cbd9b22f091c52990151).


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/21404
  
    Merged build finished. Test PASSed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore

Posted by dongjoon-hyun <gi...@git.apache.org>.
Github user dongjoon-hyun commented on a diff in the pull request:

    https://github.com/apache/spark/pull/21404#discussion_r190101719
  
    --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala ---
    @@ -1148,3 +1149,128 @@ private[client] class Shim_v2_1 extends Shim_v2_0 {
     private[client] class Shim_v2_2 extends Shim_v2_1
     
     private[client] class Shim_v2_3 extends Shim_v2_1
    +
    +private[client] class Shim_v3_0 extends Shim_v2_3 {
    +  // Spark supports only non-ACID operations
    +  protected lazy val isAcidIUDoperation = JBoolean.FALSE
    +
    +  // Writer ID can be 0 for non-ACID operations
    +  protected lazy val writeIdInLoadTableOrPartition: JLong = 0L
    +
    +  // Statement ID
    +  protected lazy val stmtIdInLoadTableOrPartition: JInteger = 0
    +
    +  protected lazy val listBucketingLevel: JInteger = 0
    +
    +  private lazy val clazzLoadFileType = getClass.getClassLoader.loadClass(
    +    "org.apache.hadoop.hive.ql.plan.LoadTableDesc$LoadFileType")
    +
    +  private lazy val loadPartitionMethod =
    --- End diff --
    
    Thank you, @HyukjinKwon .


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/21404
  
    Merged build finished. Test PASSed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore

Posted by dongjoon-hyun <gi...@git.apache.org>.
Github user dongjoon-hyun commented on the issue:

    https://github.com/apache/spark/pull/21404
  
    I'm investigating timing issue here. Spark loads Hive Metastore class lazily. Here, Spark is trying to access Hive metastore tables like `DBS` before it's created. 


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore

Posted by dongjoon-hyun <gi...@git.apache.org>.
Github user dongjoon-hyun commented on the issue:

    https://github.com/apache/spark/pull/21404
  
    Thank you for review, @tooptoop4 and @wangyum .
    I'm going to update this to the latest Hive 3.1.0.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore

Posted by wangyum <gi...@git.apache.org>.
Github user wangyum commented on the issue:

    https://github.com/apache/spark/pull/21404
  
    Can we remove the old hive support? such as 0.12, 0.13 and 0.14.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/21404
  
    Merged build finished. Test FAILed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore

Posted by tooptoop4 <gi...@git.apache.org>.
Github user tooptoop4 commented on the issue:

    https://github.com/apache/spark/pull/21404
  
    @dongjoon-hyun @wangyum @gatorsmile @HyukjinKwon Anything left on this? can it be merged to master?


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/21404
  
    Test FAILed.
    Refer to this link for build results (access rights to CI server needed): 
    https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91008/
    Test FAILed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org