You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@orc.apache.org by "Pavan Lanka (Jira)" <ji...@apache.org> on 2021/01/25 22:31:00 UTC

[jira] [Updated] (ORC-741) Schema Evolution missing column is not handled in the presence of filters

     [ https://issues.apache.org/jira/browse/ORC-741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Pavan Lanka updated ORC-741:
----------------------------
        Parent: ORC-744
    Issue Type: Sub-task  (was: Bug)

> Schema Evolution missing column is not handled in the presence of filters
> -------------------------------------------------------------------------
>
>                 Key: ORC-741
>                 URL: https://issues.apache.org/jira/browse/ORC-741
>             Project: ORC
>          Issue Type: Sub-task
>          Components: evolution, Reader
>    Affects Versions: master
>            Reporter: Pavan Lanka
>            Assignee: Pavan Lanka
>            Priority: Major
>
> ORC-577 introduced the ability to specify filters to allow row filtering.
> Schema evolution of a missing column is not handled leading to
>  {{java.lang.IllegalArgumentException: Filter could not find column with name:}}
> It is triggered in the following scenario:
>  * Read schema is supplied
>  * File schema is missing a column
>  * Provide a filter that uses that column during read
> The expectation is that the column is read as null and the filter applied on the read column.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)