You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@phoenix.apache.org by "Istvan Toth (Jira)" <ji...@apache.org> on 2022/09/14 11:21:00 UTC

[jira] [Commented] (PHOENIX-6668) Spark3 connector cannot distinguish column name cases

    [ https://issues.apache.org/jira/browse/PHOENIX-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17604025#comment-17604025 ] 

Istvan Toth commented on PHOENIX-6668:
--------------------------------------

This is the failing test:

[https://github.com/apache/phoenix-connectors/blob/30e85c50936c11de58b681dbffe960163862121b/phoenix5-spark3-it/src/it/scala/org/apache/phoenix/spark/PhoenixSparkIT.scala#L620]

That particular test is not very detailed, but we should also be able to handle tables where multiple column names differ ONLY in case.

> Spark3 connector cannot distinguish column name cases
> -----------------------------------------------------
>
>                 Key: PHOENIX-6668
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-6668
>             Project: Phoenix
>          Issue Type: Bug
>            Reporter: Istvan Toth
>            Priority: Major
>
> The Spark2 connector handled lowercase and mixed case column names correctly in DataFrame definitions.
> Spark3 only does case-insensitive column resolving, and even _spark.sql.caseSensitive_  doesn't seem to do anything, neither backquouting.
> Again, this is not something that can likely be fixes from the Phoenix side without changes in Spark, and this ticket is mainy for documenting this regression.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)