You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@orc.apache.org by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2024/12/20 17:41:00 UTC
[jira] [Commented] (ORC-1813) Incompatibility with ORC files written in version 0.12 due to missing hasNull field in C++ Reader
[ https://issues.apache.org/jira/browse/ORC-1813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17907454#comment-17907454 ]
Dongjoon Hyun commented on ORC-1813:
------------------------------------
This is backported to branch-2.0 via https://github.com/apache/orc/pull/2086
> Incompatibility with ORC files written in version 0.12 due to missing hasNull field in C++ Reader
> -------------------------------------------------------------------------------------------------
>
> Key: ORC-1813
> URL: https://issues.apache.org/jira/browse/ORC-1813
> Project: ORC
> Issue Type: Bug
> Components: C++
> Affects Versions: 2.0.3
> Reporter: suyiteng
> Assignee: suyiteng
> Priority: Minor
> Fix For: 2.1.0, 2.0.4
>
>
> We encountered an issue with the C++ implementation of the ORC reader when handling ORC files written with version 0.12. Specifically, files written in this version do not include the hasNull field in the column statistics metadata. While the Java implementation of the ORC reader handles this gracefully by defaulting hasNull to true when the field is absent, the C++ implementation does not handle this scenario correctly.
> *This issue prevents predicates like IS NULL from being pushed down to the ORC reader!!! As a result, all rows in the file are filtered out, leading to incorrect query results :(*
--
This message was sent by Atlassian Jira
(v8.20.10#820010)