You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@orc.apache.org by Dongjoon Hyun <do...@gmail.com> on 2021/09/01 04:46:07 UTC

[UPDATE] Apache Spark 1.7.0 Preparation

Hi, All.

Here is 1.7.0 preparation status as of today.

# On-going blocker issues.
- ORC-968: Column names used to build SearchArgument
                    should be full path names
- ORC-978: Fix NPE in TestFlinkOrcReaderWriter

# Updated umbrella JIRA issues
- ORC-744 (LazyIO of non-filter columns) is resolved.
- ORC-731 (Improve `Java Tools`) is resolved.
- ORC-798 (Add `@since` tag to public interfaces and classes) landed 3
patches.
- ORC-979 (C++ API QA) landed 4 patches but has ORC-968 as a blocker.

# Other resolved blocker issues
- ORC-965 (Fix ZSTD 'Overflow detected' failure) is fixed at both 1.7.0/
1.6.11.

Best,
Dongjoon.

Re: [UPDATE] Apache ORC 1.7.0 Preparation

Posted by Dongjoon Hyun <do...@apache.org>.
Thank you, William.

BTW, I realized that I made a typo in the title.
This thread is for Apache ORC 1.7.0.
Sorry for making you confused.

Here are additional updates.

- Thanks to Yiqun Zhang with ORC-978,
  Apache ORC 1.7.0 snapshot passed Apache Iceberg Integration Test
- Thanks to Pavan Lanka with ORC-980
  `Filter processing respects the case-sensitivity flag` was fixed.

The only blocker-level JIRA issue is C++ issue.

ORC-968: Column names used to build SearchArgument should be full path names

Dongjoon.

On 2021/09/03 00:19:49, William Hyun <wi...@apache.org> wrote: 
> Thank you for the status update. 
> 
> On 2021/09/01 04:46:07, Dongjoon Hyun <do...@gmail.com> wrote: 
> > Hi, All.
> > 
> > Here is 1.7.0 preparation status as of today.
> > 
> > # On-going blocker issues.
> > - ORC-968: Column names used to build SearchArgument
> >                     should be full path names
> > - ORC-978: Fix NPE in TestFlinkOrcReaderWriter
> > 
> > # Updated umbrella JIRA issues
> > - ORC-744 (LazyIO of non-filter columns) is resolved.
> > - ORC-731 (Improve `Java Tools`) is resolved.
> > - ORC-798 (Add `@since` tag to public interfaces and classes) landed 3
> > patches.
> > - ORC-979 (C++ API QA) landed 4 patches but has ORC-968 as a blocker.
> > 
> > # Other resolved blocker issues
> > - ORC-965 (Fix ZSTD 'Overflow detected' failure) is fixed at both 1.7.0/
> > 1.6.11.
> > 
> > Best,
> > Dongjoon.
> > 
> 

Re: [UPDATE] Apache Spark 1.7.0 Preparation

Posted by William Hyun <wi...@apache.org>.
Thank you for the status update. 

On 2021/09/01 04:46:07, Dongjoon Hyun <do...@gmail.com> wrote: 
> Hi, All.
> 
> Here is 1.7.0 preparation status as of today.
> 
> # On-going blocker issues.
> - ORC-968: Column names used to build SearchArgument
>                     should be full path names
> - ORC-978: Fix NPE in TestFlinkOrcReaderWriter
> 
> # Updated umbrella JIRA issues
> - ORC-744 (LazyIO of non-filter columns) is resolved.
> - ORC-731 (Improve `Java Tools`) is resolved.
> - ORC-798 (Add `@since` tag to public interfaces and classes) landed 3
> patches.
> - ORC-979 (C++ API QA) landed 4 patches but has ORC-968 as a blocker.
> 
> # Other resolved blocker issues
> - ORC-965 (Fix ZSTD 'Overflow detected' failure) is fixed at both 1.7.0/
> 1.6.11.
> 
> Best,
> Dongjoon.
>