You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Michael Armbrust (JIRA)" <ji...@apache.org> on 2015/06/23 03:31:00 UTC
[jira] [Commented] (SPARK-8377) Identifiers caseness information
should be available at any time
[ https://issues.apache.org/jira/browse/SPARK-8377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14596974#comment-14596974 ]
Michael Armbrust commented on SPARK-8377:
-----------------------------------------
I'm not sure I follow. Case insensitivity does not just lowercase everything (Hive Metastore does this, but Spark SQL's analyzer has not since 1.2). In general we try to be case insensitive but case preserving. When interacting with other datasources we use expression IDs to look up the original attributes capitalization.
> Identifiers caseness information should be available at any time
> ----------------------------------------------------------------
>
> Key: SPARK-8377
> URL: https://issues.apache.org/jira/browse/SPARK-8377
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Reporter: Santiago M. Mola
>
> Currently, we have the option of having a case sensitive catalog or not. A case insensitive catalog just lowercases all identifiers. However, when pushing down to a data source, we lose the information about if an identifier should be case insensitive or strictly lowercase.
> Ideally, we would be able to distinguish a case insensitive identifier from a case sensitive one.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org