You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@celeborn.apache.org by Ethan Feng <et...@gmail.com> on 2023/03/08 03:54:50 UTC
[NOTICE] Fix solution about rare data loss in release 0.2.0.
Hello users,
Regretfully to inform you that we found a bug[2] in release 0.2.0
yesterday. The bug[2] caused data loss rarely when reading from skew
partitions on a high-pressure cluster.
You need to apply this patch[1] to your Celeborn client jar. We'll
ship this patch in our next release.
Feel free to contact us if you encounter any other questions.
Regards,
Ethan Feng
-------------------------------------------------------
1. https://github.com/apache/incubator-celeborn/pull/1315
2. https://issues.apache.org/jira/browse/CELEBORN-383
Re: [NOTICE] Fix solution about rare data loss in release 0.2.0.
Posted by Yu Li <ca...@gmail.com>.
Thanks for the update and good to know, Keyong.
Best Regards,
Yu
On Thu, 9 Mar 2023 at 14:47, keyong zhou <wa...@gmail.com> wrote:
> Hi Yu,
>
> We do have a plan for a quick fix, before that we'd like to do more tests
> and
> collect more feedbacks for about a week.
>
> Thanks,
> Keyong Zhou
>
> Yu Li <ca...@gmail.com> 于2023年3月9日周四 13:48写道：
>
> > Thanks for the note Ethan.
> >
> > I'm not sure but maybe it is worth a quick bug fix release, i.e. 0.2.1?
> Any
> > plan for that?
> >
> > Best Regards,
> > Yu
> >
> >
> > On Wed, 8 Mar 2023 at 11:55, Ethan Feng <et...@gmail.com>
> > wrote:
> >
> > > Hello users,
> > > Regretfully to inform you that we found a bug[2] in release 0.2.0
> > > yesterday. The bug[2] caused data loss rarely when reading from skew
> > > partitions on a high-pressure cluster.
> > > You need to apply this patch[1] to your Celeborn client jar. We'll
> > > ship this patch in our next release.
> > > Feel free to contact us if you encounter any other questions.
> > >
> > > Regards,
> > > Ethan Feng
> > >
> > > -------------------------------------------------------
> > > 1. https://github.com/apache/incubator-celeborn/pull/1315
> > > 2. https://issues.apache.org/jira/browse/CELEBORN-383
> > >
> >
>
Re: [NOTICE] Fix solution about rare data loss in release 0.2.0.
Posted by keyong zhou <wa...@gmail.com>.
Hi Yu,
We do have a plan for a quick fix, before that we'd like to do more tests
and
collect more feedbacks for about a week.
Thanks,
Keyong Zhou
Yu Li <ca...@gmail.com> 于2023年3月9日周四 13:48写道：
> Thanks for the note Ethan.
>
> I'm not sure but maybe it is worth a quick bug fix release, i.e. 0.2.1? Any
> plan for that?
>
> Best Regards,
> Yu
>
>
> On Wed, 8 Mar 2023 at 11:55, Ethan Feng <et...@gmail.com>
> wrote:
>
> > Hello users,
> > Regretfully to inform you that we found a bug[2] in release 0.2.0
> > yesterday. The bug[2] caused data loss rarely when reading from skew
> > partitions on a high-pressure cluster.
> > You need to apply this patch[1] to your Celeborn client jar. We'll
> > ship this patch in our next release.
> > Feel free to contact us if you encounter any other questions.
> >
> > Regards,
> > Ethan Feng
> >
> > -------------------------------------------------------
> > 1. https://github.com/apache/incubator-celeborn/pull/1315
> > 2. https://issues.apache.org/jira/browse/CELEBORN-383
> >
>
Re: [NOTICE] Fix solution about rare data loss in release 0.2.0.
Posted by Yu Li <ca...@gmail.com>.
Thanks for the note Ethan.
I'm not sure but maybe it is worth a quick bug fix release, i.e. 0.2.1? Any
plan for that?
Best Regards,
Yu
On Wed, 8 Mar 2023 at 11:55, Ethan Feng <et...@gmail.com>
wrote:
> Hello users,
> Regretfully to inform you that we found a bug[2] in release 0.2.0
> yesterday. The bug[2] caused data loss rarely when reading from skew
> partitions on a high-pressure cluster.
> You need to apply this patch[1] to your Celeborn client jar. We'll
> ship this patch in our next release.
> Feel free to contact us if you encounter any other questions.
>
> Regards,
> Ethan Feng
>
> -------------------------------------------------------
> 1. https://github.com/apache/incubator-celeborn/pull/1315
> 2. https://issues.apache.org/jira/browse/CELEBORN-383
>