You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by Ryan Blue <rb...@netflix.com.INVALID> on 2017/01/06 23:16:14 UTC
1.8.2 patch release
Hi everyone,
There was some discussion last month about getting a 1.8.2 patch release
out so that some projects like Spark can take advantage of recent bug
fixes, but not pull in more risky changes like the byte buffer read path.
I've gone ahead an filtered the commits since 1.8.1 and created a list of
what I think should go into the 1.8.2 release here:
https://docs.google.com/spreadsheets/d/1NAuY3c77Egs6REu-UVkQqPswpVYVgZTTnY3bM0SPVRs/edit?usp=sharing
I also built a branch with these commits backported:
https://github.com/rdblue/parquet-mr/tree/parquet-1.8.x
I'd like to get a 1.8.2 release candidate out sometime soon, so please look
at what I've included and comment on the doc if there's anything else you'd
like to get in, or if you think some commits shouldn't be there.
Thanks!
rb
--
Ryan Blue
Software Engineer
Netflix
Re: 1.8.2 patch release
Posted by Piyush Narang <pn...@twitter.com.INVALID>.
Thanks for putting this together Ryan. The list looks good to me. Once
we've got 1.8.2 artifacts, I can run some of our internal tests to see how
the new release stacks up performance wise.
On Mon, Jan 9, 2017 at 5:14 PM, Cheng Lian <li...@gmail.com> wrote:
> Already reviewed the list and left comments on the spreadsheet.
>
> The current list LGTM. Thanks Ryan for doing this!
>
> Cheng
>
>
> On 1/9/17 1:36 PM, Ryan Blue wrote:
>
>> I posted a note on the Spark list pointing to this thread. I also know
>> most
>> of the issues that they're interested in fixing, so I've marked those on
>> the backports doc. We should also do a benchmark to compare 1.8.1 with
>> 1.8.2 to ensure we don't have a performance regression.
>>
>> rb
>>
>> On Fri, Jan 6, 2017 at 3:37 PM, Julien Le Dem <ju...@ledem.net> wrote:
>>
>> Thanks Ryan!
>>> Do we know who are the folks from the Spark project that need to review
>>> this?
>>> It would be great to get their explicit review/approval here.
>>> can you cc them on the thread?
>>> Julien
>>>
>>>
>>> On Jan 6, 2017, at 3:16 PM, Ryan Blue <rb...@netflix.com.INVALID> wrote:
>>>>
>>>> Hi everyone,
>>>>
>>>> There was some discussion last month about getting a 1.8.2 patch release
>>>> out so that some projects like Spark can take advantage of recent bug
>>>> fixes, but not pull in more risky changes like the byte buffer read
>>>> path.
>>>> I've gone ahead an filtered the commits since 1.8.1 and created a list
>>>> of
>>>> what I think should go into the 1.8.2 release here:
>>>>
>>>>
>>>> https://docs.google.com/spreadsheets/d/1NAuY3c77Egs6REu-
>>>>
>>> UVkQqPswpVYVgZTTnY3bM0SPVRs/edit?usp=sharing
>>>
>>>> I also built a branch with these commits backported:
>>>>
>>>> https://github.com/rdblue/parquet-mr/tree/parquet-1.8.x
>>>>
>>>> I'd like to get a 1.8.2 release candidate out sometime soon, so please
>>>>
>>> look
>>>
>>>> at what I've included and comment on the doc if there's anything else
>>>>
>>> you'd
>>>
>>>> like to get in, or if you think some commits shouldn't be there.
>>>>
>>>> Thanks!
>>>>
>>>> rb
>>>>
>>>> --
>>>> Ryan Blue
>>>> Software Engineer
>>>> Netflix
>>>>
>>>
>>>
>>
>
--
- Piyush
Re: 1.8.2 patch release
Posted by Cheng Lian <li...@gmail.com>.
Already reviewed the list and left comments on the spreadsheet.
The current list LGTM. Thanks Ryan for doing this!
Cheng
On 1/9/17 1:36 PM, Ryan Blue wrote:
> I posted a note on the Spark list pointing to this thread. I also know most
> of the issues that they're interested in fixing, so I've marked those on
> the backports doc. We should also do a benchmark to compare 1.8.1 with
> 1.8.2 to ensure we don't have a performance regression.
>
> rb
>
> On Fri, Jan 6, 2017 at 3:37 PM, Julien Le Dem <ju...@ledem.net> wrote:
>
>> Thanks Ryan!
>> Do we know who are the folks from the Spark project that need to review
>> this?
>> It would be great to get their explicit review/approval here.
>> can you cc them on the thread?
>> Julien
>>
>>
>>> On Jan 6, 2017, at 3:16 PM, Ryan Blue <rb...@netflix.com.INVALID> wrote:
>>>
>>> Hi everyone,
>>>
>>> There was some discussion last month about getting a 1.8.2 patch release
>>> out so that some projects like Spark can take advantage of recent bug
>>> fixes, but not pull in more risky changes like the byte buffer read path.
>>> I've gone ahead an filtered the commits since 1.8.1 and created a list of
>>> what I think should go into the 1.8.2 release here:
>>>
>>>
>>> https://docs.google.com/spreadsheets/d/1NAuY3c77Egs6REu-
>> UVkQqPswpVYVgZTTnY3bM0SPVRs/edit?usp=sharing
>>> I also built a branch with these commits backported:
>>>
>>> https://github.com/rdblue/parquet-mr/tree/parquet-1.8.x
>>>
>>> I'd like to get a 1.8.2 release candidate out sometime soon, so please
>> look
>>> at what I've included and comment on the doc if there's anything else
>> you'd
>>> like to get in, or if you think some commits shouldn't be there.
>>>
>>> Thanks!
>>>
>>> rb
>>>
>>> --
>>> Ryan Blue
>>> Software Engineer
>>> Netflix
>>
>
Re: 1.8.2 patch release
Posted by Ryan Blue <rb...@netflix.com.INVALID>.
I posted a note on the Spark list pointing to this thread. I also know most
of the issues that they're interested in fixing, so I've marked those on
the backports doc. We should also do a benchmark to compare 1.8.1 with
1.8.2 to ensure we don't have a performance regression.
rb
On Fri, Jan 6, 2017 at 3:37 PM, Julien Le Dem <ju...@ledem.net> wrote:
> Thanks Ryan!
> Do we know who are the folks from the Spark project that need to review
> this?
> It would be great to get their explicit review/approval here.
> can you cc them on the thread?
> Julien
>
>
> > On Jan 6, 2017, at 3:16 PM, Ryan Blue <rb...@netflix.com.INVALID> wrote:
> >
> > Hi everyone,
> >
> > There was some discussion last month about getting a 1.8.2 patch release
> > out so that some projects like Spark can take advantage of recent bug
> > fixes, but not pull in more risky changes like the byte buffer read path.
> > I've gone ahead an filtered the commits since 1.8.1 and created a list of
> > what I think should go into the 1.8.2 release here:
> >
> >
> > https://docs.google.com/spreadsheets/d/1NAuY3c77Egs6REu-
> UVkQqPswpVYVgZTTnY3bM0SPVRs/edit?usp=sharing
> >
> > I also built a branch with these commits backported:
> >
> > https://github.com/rdblue/parquet-mr/tree/parquet-1.8.x
> >
> > I'd like to get a 1.8.2 release candidate out sometime soon, so please
> look
> > at what I've included and comment on the doc if there's anything else
> you'd
> > like to get in, or if you think some commits shouldn't be there.
> >
> > Thanks!
> >
> > rb
> >
> > --
> > Ryan Blue
> > Software Engineer
> > Netflix
>
>
--
Ryan Blue
Software Engineer
Netflix
Re: 1.8.2 patch release
Posted by Julien Le Dem <ju...@ledem.net>.
Thanks Ryan!
Do we know who are the folks from the Spark project that need to review this?
It would be great to get their explicit review/approval here.
can you cc them on the thread?
Julien
> On Jan 6, 2017, at 3:16 PM, Ryan Blue <rb...@netflix.com.INVALID> wrote:
>
> Hi everyone,
>
> There was some discussion last month about getting a 1.8.2 patch release
> out so that some projects like Spark can take advantage of recent bug
> fixes, but not pull in more risky changes like the byte buffer read path.
> I've gone ahead an filtered the commits since 1.8.1 and created a list of
> what I think should go into the 1.8.2 release here:
>
>
> https://docs.google.com/spreadsheets/d/1NAuY3c77Egs6REu-UVkQqPswpVYVgZTTnY3bM0SPVRs/edit?usp=sharing
>
> I also built a branch with these commits backported:
>
> https://github.com/rdblue/parquet-mr/tree/parquet-1.8.x
>
> I'd like to get a 1.8.2 release candidate out sometime soon, so please look
> at what I've included and comment on the doc if there's anything else you'd
> like to get in, or if you think some commits shouldn't be there.
>
> Thanks!
>
> rb
>
> --
> Ryan Blue
> Software Engineer
> Netflix