You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2019/05/21 04:35:44 UTC

[jira] [Resolved] (SPARK-15147) Catalog should have a property to indicate case-sensitivity

     [ https://issues.apache.org/jira/browse/SPARK-15147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hyukjin Kwon resolved SPARK-15147.
----------------------------------
    Resolution: Incomplete

> Catalog should have a property to indicate case-sensitivity
> -----------------------------------------------------------
>
>                 Key: SPARK-15147
>                 URL: https://issues.apache.org/jira/browse/SPARK-15147
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 2.0.0
>            Reporter: Cheng Lian
>            Priority: Major
>              Labels: bulk-closed
>
> We are moving from Hive metastore catalog to a more general extensible catalog design. One problem that hasn't been taken care of in current Spark 2.0 interfaces is case sensitivity. More specifically, Hive metastore is case insensitive. It simply stores column names, table names, struct field names, and function names in lower case, and thus isn't even case-preserving. However, case sensitivity in Spark SQL is configurable. We need to add property (or properties) to {{Catalog}} interface to indicate case-sensitivity of underlying catalog implementations.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org