[jira] [Resolved] (ORC-613) OrcMapredRecordReader mis-reuse struct object when actual children schema differs

["Owen O'Malley (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/ORC-613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Owen O'Malley resolved ORC-613.
-------------------------------
    Fix Version/s: 1.6.3
                   1.5.10
         Assignee: Lei Sun
       Resolution: Fixed

I committed this. Thanks, Lei!

> OrcMapredRecordReader mis-reuse struct object when actual children schema differs
> ---------------------------------------------------------------------------------
>
>                 Key: ORC-613
>                 URL: https://issues.apache.org/jira/browse/ORC-613
>             Project: ORC
>          Issue Type: Bug
>          Components: Java
>            Reporter: Lei Sun
>            Assignee: Lei Sun
>            Priority: Major
>             Fix For: 1.5.10, 1.6.3
>
>          Time Spent: 20m
>  Remaining Estimate: 0h
>
> When reading from schema like following:  
> {{uniontype <struct<field0, field1, ..., fieldN>, struct<>> }}
> `org.apache.orc.mapreduce.OrcMapreduceRecordReader#nextStruct` will determine if previous object's schema can be reused or not. The determination of this is problematic, since it only checks the top-level type (OrcStruct) but not the schema of OrcStruct. Therefore, if encountering schema like above, and when struct at tag_0 is processed followed with a struct at tag_1, it will reuse the tag_0's struct schema which results in in correct result. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)