[jira] [Resolved] (ORC-980) Filter processing ignores the schema case-sensitivity flag

["Dongjoon Hyun (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/ORC-980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dongjoon Hyun resolved ORC-980.
-------------------------------
    Fix Version/s: 1.8.0
                   1.7.0
       Resolution: Fixed

This is resolved via https://github.com/apache/orc/pull/893

> Filter processing ignores the schema case-sensitivity flag
> ----------------------------------------------------------
>
>                 Key: ORC-980
>                 URL: https://issues.apache.org/jira/browse/ORC-980
>             Project: ORC
>          Issue Type: Bug
>          Components: Java
>    Affects Versions: 1.7.0, 1.8.0
>            Reporter: Pavan Lanka
>            Assignee: Pavan Lanka
>            Priority: Blocker
>             Fix For: 1.7.0, 1.8.0
>
>
> The current SArg to Filter Conversion ignores the case-sensitivity setting during read and always perform case-sensitive search of fields even when asked to perform case-insensitive match using
> {quote}options()
>  .searchArgument(sarg{color:#cc7832}, new {color}String[] {{color:#6a8759}"RIDX"{color}})
>  .allowSARGToFilter({color:#cc7832}true{color})
>  .isSchemaEvolutionCaseAware({color:#cc7832}false{color}){quote}
> leading to the following exceptions that the field is not found in the schema
> {quote}java.lang.IllegalArgumentException: Field RIDX not found in struct<f1:bigint,f2:decimal(20,6),f3:bigint,f4:string,ridx:bigint>
> at org.apache.orc.impl.ParserUtils.findColumn(ParserUtils.java:399)
>  at org.apache.orc.impl.ParserUtils.findColumn(ParserUtils.java:337)
>  at org.apache.orc.impl.ParserUtils.findSubtype(ParserUtils.java:285)
>  at org.apache.orc.TypeDescription.findSubtype(TypeDescription.java:820)
>  at org.apache.orc.TypeDescription.findSubtype(TypeDescription.java:814)
>  at org.apache.orc.impl.filter.leaf.LeafFilterFactory.createLeafVectorFilter(LeafFilterFactory.java:230)
>  at org.apache.orc.impl.filter.FilterFactory.createSArgFilter(FilterFactory.java:123)
>  at org.apache.orc.impl.filter.FilterFactory.createBatchFilter(FilterFactory.java:63)
>  at org.apache.orc.impl.RecordReaderImpl.<init>(RecordReaderImpl.java:284)
> {quote}
> SArg to Filter conversion should respect the case-sensitivity option as supplied by the reader.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)