You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@orc.apache.org by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/01/25 22:56:00 UTC
[jira] [Commented] (ORC-741) Schema Evolution missing column is not
handled in the presence of filters
[ https://issues.apache.org/jira/browse/ORC-741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17271717#comment-17271717 ]
Dongjoon Hyun commented on ORC-741:
-----------------------------------
Thank you for reporting, [~planka]. So, this is a bug only at ORC 1.7.0, right?
> Schema Evolution missing column is not handled in the presence of filters
> -------------------------------------------------------------------------
>
> Key: ORC-741
> URL: https://issues.apache.org/jira/browse/ORC-741
> Project: ORC
> Issue Type: Sub-task
> Components: evolution, Reader
> Affects Versions: 1.7.0
> Reporter: Pavan Lanka
> Assignee: Pavan Lanka
> Priority: Major
>
> ORC-577 introduced the ability to specify filters to allow row filtering.
> Schema evolution of a missing column is not handled leading to
> {{java.lang.IllegalArgumentException: Filter could not find column with name:}}
> It is triggered in the following scenario:
> * Read schema is supplied
> * File schema is missing a column
> * Provide a filter that uses that column during read
> The expectation is that the column is read as null and the filter applied on the read column.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)