You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@orc.apache.org by "Vaibhav Gumashta (JIRA)" <ji...@apache.org> on 2018/11/14 07:53:00 UTC

[jira] [Created] (ORC-437) Make acid schema checks case insensitive

Vaibhav Gumashta created ORC-437:
------------------------------------

             Summary: Make acid schema checks case insensitive
                 Key: ORC-437
                 URL: https://issues.apache.org/jira/browse/ORC-437
             Project: ORC
          Issue Type: Bug
          Components: Java
    Affects Versions: 1.5.3
            Reporter: Vaibhav Gumashta


When reading from an Orc file, SchemaEvolution evolution tries to determine if this is an Acid compliant format by comparing field names with Acid event names in {{SchemaEvolution.checkAcidSchema}}. Would be good to make this comparison case insensitive.
This requirement comes in from HIVE-20699 where a Hive query is being used to run compaction (and hence write the compacted data to the bucket files via a HiveQL query). Since hive converts all column names to lower case, the compacted files end up with lower case Acid schema columns. The change is much simpler when made in Orc.





--
This message was sent by Atlassian JIRA
(v7.6.3#76005)