You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@orc.apache.org by "Pavan Lanka (Jira)" <ji...@apache.org> on 2021/09/02 16:28:00 UTC

[jira] [Created] (ORC-980) Filter processing ignores the schema case-sensitivity flag

Pavan Lanka created ORC-980:
-------------------------------

             Summary: Filter processing ignores the schema case-sensitivity flag
                 Key: ORC-980
                 URL: https://issues.apache.org/jira/browse/ORC-980
             Project: ORC
          Issue Type: Bug
          Components: Java
    Affects Versions: 1.7.0, master
            Reporter: Pavan Lanka
            Assignee: Pavan Lanka


The current SArg to Filter Conversion ignores the case-sensitivity setting during read and always perform case-sensitive search of fields leads to exceptions such as
{quote}java.lang.IllegalArgumentException: Field RIDX not found in struct<f1:bigint,f2:decimal(20,6),f3:bigint,f4:string,ridx:bigint>

at org.apache.orc.impl.ParserUtils.findColumn(ParserUtils.java:399)
 at org.apache.orc.impl.ParserUtils.findColumn(ParserUtils.java:337)
 at org.apache.orc.impl.ParserUtils.findSubtype(ParserUtils.java:285)
 at org.apache.orc.TypeDescription.findSubtype(TypeDescription.java:820)
 at org.apache.orc.TypeDescription.findSubtype(TypeDescription.java:814)
 at org.apache.orc.impl.filter.leaf.LeafFilterFactory.createLeafVectorFilter(LeafFilterFactory.java:230)
 at org.apache.orc.impl.filter.FilterFactory.createSArgFilter(FilterFactory.java:123)
 at org.apache.orc.impl.filter.FilterFactory.createBatchFilter(FilterFactory.java:63)
 at org.apache.orc.impl.RecordReaderImpl.<init>(RecordReaderImpl.java:284)
{quote}
This needs to change instead to respect the configuration passed down via the reader options.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)