You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@orc.apache.org by Panos Garefalakis <pa...@gmail.com> on 2021/01/15 23:08:16 UTC
Apache ORC 1.6.7 Release
Hello all,
Keeping up the momentum from the recent backwards compatible Spark release
(1.6.6), I would like to propose a new 1.6.7 release as the fist compatible
version for Apache Hive!
To achieve this, the community had to resolve a number of issues including:
* ORC-705 <https://issues.apache.org/jira/browse/ORC-705>: Predicate
evaluation taking into account writer calendar
* ORC-706 <https://issues.apache.org/jira/browse/ORC-706>: Putting back
DataReaderProperties default maxDiskRangeChunkLimit
* ORC-709 <https://issues.apache.org/jira/browse/ORC-709>: Boolean to
StringGroup schema evolution
* ORC-724 <https://issues.apache.org/jira/browse/ORC-724>: PPD: IN single
value comparison throwing ClassCastException with Date objects
As of yesterday Hive precommit tests are also passing using the latest
1.6.7-SNAPSHOT version and Hive community is already discussing the upgrade
-- check HIVE-23553 <https://issues.apache.org/jira/browse/HIVE-23553> for
the implementation details.
Is there anything else that should also go in?
Please let me know what you think!
Cheers,
Panagiotis
Re: Apache ORC 1.6.7 Release
Posted by Panos Garefalakis <pa...@gmail.com>.
That's great!
Thanks for volunteering for the release and triggering the tests
upstream Dongjoon :)
Cheers,
Panagiotis
On Sat, Jan 16, 2021 at 6:50 PM Dongjoon Hyun <do...@gmail.com>
wrote:
> This is the result of Apache ORC 1.6.7-SNAPSHOT with Spark and Iceberg.
>
> All UTs passed.
>
> - https://github.com/dongjoon-hyun/spark/pull/49 (Test Apache ORC
> 1.6.7-SNAPSHOT)
> - https://github.com/dongjoon-hyun/iceberg/pull/2 (Test Apache ORC
> 1.6.7-SNAPSHOT)
>
> Bests,
> Dongjoon.
>
>
> On Fri, Jan 15, 2021 at 3:51 PM Dongjoon Hyun <do...@gmail.com>
> wrote:
>
> > It's great. Thank you so much for leading this, Panos.
> >
> > +1 for starting Apache Spark 1.6.7 release.
> >
> > I'm also expecting a release for the following patch which was merged
> last
> > week.
> >
> > ORC-711: Support CryptoExtension in create/decryptLocalKey
> >
> > For now, the current snapshot seems to keep working well with Apache
> Spark
> > and Apache Iceberg, too.
> >
> > I'll volunteer for a release manager for 1.6.7 and cut a release next
> > Monday if there are no other issues.
> >
> > Bests,
> > Dongjoon.
> >
> >
> > On Fri, Jan 15, 2021 at 3:08 PM Panos Garefalakis <pa...@gmail.com>
> > wrote:
> >
> >> Hello all,
> >>
> >> Keeping up the momentum from the recent backwards compatible Spark
> release
> >> (1.6.6), I would like to propose a new 1.6.7 release as the fist
> >> compatible
> >> version for Apache Hive!
> >> To achieve this, the community had to resolve a number of issues
> >> including:
> >>
> >> * ORC-705 <https://issues.apache.org/jira/browse/ORC-705>: Predicate
> >> evaluation taking into account writer calendar
> >> * ORC-706 <https://issues.apache.org/jira/browse/ORC-706>: Putting back
> >> DataReaderProperties default maxDiskRangeChunkLimit
> >> * ORC-709 <https://issues.apache.org/jira/browse/ORC-709>: Boolean to
> >> StringGroup schema evolution
> >> * ORC-724 <https://issues.apache.org/jira/browse/ORC-724>: PPD: IN
> single
> >> value comparison throwing ClassCastException with Date objects
> >>
> >> As of yesterday Hive precommit tests are also passing using the latest
> >> 1.6.7-SNAPSHOT version and Hive community is already discussing the
> >> upgrade
> >> -- check HIVE-23553 <https://issues.apache.org/jira/browse/HIVE-23553>
> >> for
> >> the implementation details.
> >>
> >> Is there anything else that should also go in?
> >> Please let me know what you think!
> >>
> >> Cheers,
> >> Panagiotis
> >>
> >
>
Re: Apache ORC 1.6.7 Release
Posted by Dongjoon Hyun <do...@gmail.com>.
This is the result of Apache ORC 1.6.7-SNAPSHOT with Spark and Iceberg.
All UTs passed.
- https://github.com/dongjoon-hyun/spark/pull/49 (Test Apache ORC
1.6.7-SNAPSHOT)
- https://github.com/dongjoon-hyun/iceberg/pull/2 (Test Apache ORC
1.6.7-SNAPSHOT)
Bests,
Dongjoon.
On Fri, Jan 15, 2021 at 3:51 PM Dongjoon Hyun <do...@gmail.com>
wrote:
> It's great. Thank you so much for leading this, Panos.
>
> +1 for starting Apache Spark 1.6.7 release.
>
> I'm also expecting a release for the following patch which was merged last
> week.
>
> ORC-711: Support CryptoExtension in create/decryptLocalKey
>
> For now, the current snapshot seems to keep working well with Apache Spark
> and Apache Iceberg, too.
>
> I'll volunteer for a release manager for 1.6.7 and cut a release next
> Monday if there are no other issues.
>
> Bests,
> Dongjoon.
>
>
> On Fri, Jan 15, 2021 at 3:08 PM Panos Garefalakis <pa...@gmail.com>
> wrote:
>
>> Hello all,
>>
>> Keeping up the momentum from the recent backwards compatible Spark release
>> (1.6.6), I would like to propose a new 1.6.7 release as the fist
>> compatible
>> version for Apache Hive!
>> To achieve this, the community had to resolve a number of issues
>> including:
>>
>> * ORC-705 <https://issues.apache.org/jira/browse/ORC-705>: Predicate
>> evaluation taking into account writer calendar
>> * ORC-706 <https://issues.apache.org/jira/browse/ORC-706>: Putting back
>> DataReaderProperties default maxDiskRangeChunkLimit
>> * ORC-709 <https://issues.apache.org/jira/browse/ORC-709>: Boolean to
>> StringGroup schema evolution
>> * ORC-724 <https://issues.apache.org/jira/browse/ORC-724>: PPD: IN single
>> value comparison throwing ClassCastException with Date objects
>>
>> As of yesterday Hive precommit tests are also passing using the latest
>> 1.6.7-SNAPSHOT version and Hive community is already discussing the
>> upgrade
>> -- check HIVE-23553 <https://issues.apache.org/jira/browse/HIVE-23553>
>> for
>> the implementation details.
>>
>> Is there anything else that should also go in?
>> Please let me know what you think!
>>
>> Cheers,
>> Panagiotis
>>
>
Re: Apache ORC 1.6.7 Release
Posted by Dongjoon Hyun <do...@gmail.com>.
It's great. Thank you so much for leading this, Panos.
+1 for starting Apache Spark 1.6.7 release.
I'm also expecting a release for the following patch which was merged last
week.
ORC-711: Support CryptoExtension in create/decryptLocalKey
For now, the current snapshot seems to keep working well with Apache Spark
and Apache Iceberg, too.
I'll volunteer for a release manager for 1.6.7 and cut a release next
Monday if there are no other issues.
Bests,
Dongjoon.
On Fri, Jan 15, 2021 at 3:08 PM Panos Garefalakis <pa...@gmail.com>
wrote:
> Hello all,
>
> Keeping up the momentum from the recent backwards compatible Spark release
> (1.6.6), I would like to propose a new 1.6.7 release as the fist compatible
> version for Apache Hive!
> To achieve this, the community had to resolve a number of issues including:
>
> * ORC-705 <https://issues.apache.org/jira/browse/ORC-705>: Predicate
> evaluation taking into account writer calendar
> * ORC-706 <https://issues.apache.org/jira/browse/ORC-706>: Putting back
> DataReaderProperties default maxDiskRangeChunkLimit
> * ORC-709 <https://issues.apache.org/jira/browse/ORC-709>: Boolean to
> StringGroup schema evolution
> * ORC-724 <https://issues.apache.org/jira/browse/ORC-724>: PPD: IN single
> value comparison throwing ClassCastException with Date objects
>
> As of yesterday Hive precommit tests are also passing using the latest
> 1.6.7-SNAPSHOT version and Hive community is already discussing the upgrade
> -- check HIVE-23553 <https://issues.apache.org/jira/browse/HIVE-23553> for
> the implementation details.
>
> Is there anything else that should also go in?
> Please let me know what you think!
>
> Cheers,
> Panagiotis
>