You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@orc.apache.org by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/01/25 22:56:00 UTC

[jira] [Commented] (ORC-741) Schema Evolution missing column is not handled in the presence of filters

    [ https://issues.apache.org/jira/browse/ORC-741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17271717#comment-17271717 ] 

Dongjoon Hyun commented on ORC-741:
-----------------------------------

Thank you for reporting, [~planka]. So, this is a bug only at ORC 1.7.0, right?

> Schema Evolution missing column is not handled in the presence of filters
> -------------------------------------------------------------------------
>
>                 Key: ORC-741
>                 URL: https://issues.apache.org/jira/browse/ORC-741
>             Project: ORC
>          Issue Type: Sub-task
>          Components: evolution, Reader
>    Affects Versions: 1.7.0
>            Reporter: Pavan Lanka
>            Assignee: Pavan Lanka
>            Priority: Major
>
> ORC-577 introduced the ability to specify filters to allow row filtering.
> Schema evolution of a missing column is not handled leading to
>  {{java.lang.IllegalArgumentException: Filter could not find column with name:}}
> It is triggered in the following scenario:
>  * Read schema is supplied
>  * File schema is missing a column
>  * Provide a filter that uses that column during read
> The expectation is that the column is read as null and the filter applied on the read column.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)