You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "t oo (JIRA)" <ji...@apache.org> on 2019/02/15 23:50:00 UTC

[jira] [Commented] (SPARK-24338) Spark SQL fails to create a Hive table when running in a Apache Sentry-secured Environment

    [ https://issues.apache.org/jira/browse/SPARK-24338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769871#comment-16769871 ] 

t oo commented on SPARK-24338:
------------------------------

gentle ping

> Spark SQL fails to create a Hive table when running in a Apache Sentry-secured Environment
> ------------------------------------------------------------------------------------------
>
>                 Key: SPARK-24338
>                 URL: https://issues.apache.org/jira/browse/SPARK-24338
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 2.3.0
>            Reporter: Chaoran Yu
>            Priority: Critical
>         Attachments: exception.txt
>
>
> This [commit|https://github.com/apache/spark/commit/ce13c2672318242748f7520ed4ce6bcfad4fb428] introduced a bug that caused Spark SQL "CREATE TABLE" statement to fail in Hive when Apache Sentry is used to control cluster authorization. This bug exists in Spark 2.1.0 and all later releases. The error message thrown is in the attached file.[^exception.txt]
> Cloudera in their fork of Spark fixed this bug as shown [here|https://github.com/cloudera/spark/blob/spark2-2.2.0-cloudera2/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala#L229]. It would make sense for this fix to be merged back upstream.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org