You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pulsar.apache.org by Lari Hotari <la...@sagire.fi> on 2021/01/25 17:05:22 UTC
[Discuss] draft PIP for "Changes to flaky test handling"
Dear Pulsar community members,
The current test suites in Apache Pulsar build contain flaky tests that
make the builds fail very frequently.
To address the issues caused by flaky tests, I have been preparing a draft
PIP for "Changes to flaky test handling" together with Enrico Olivelli.
The document is a Google doc:
https://docs.google.com/document/d/10lmn4pW1IsT_8D1ZE0vMjASX0HhjdGdjB794iyScwns/edit?usp=sharing
I also hope to get guidance from the Pulsar committers about how to take
this draft forward to become an actual PIP. I have understood that taking
an idea to discussion on the mailing list is the first step for making a
Pulsar Improvement Proposal (PIP).
Let's discuss!
I'm looking forward to your comments, questions and suggestions. Thank you.
BR, Lari
Re: [Discuss] draft PIP for "Changes to flaky test handling"
Posted by Yong Zhang <zh...@gmail.com>.
Looking forward to the Pulsar test be more stable and CI can pass easily!
--
Yong
On Fri, 29 Jan 2021 at 00:35, Lari Hotari <La...@hotari.net> wrote:
> Thank you Jennifer. I'll take a look soon.
> Regards, Lari
>
> On Thu, Jan 28, 2021 at 4:13 PM Jinfeng Huang <hjf@streamnative.io.invalid
> >
> wrote:
>
> > Hi Lari,
> > Thank you very much for driving the process.
> > I've left some comments and my concerns in your google doc, hope it won't
> > bother you too much.
> >
> > Best Regards,
> > Jennifer
> >
> >
> > On Wed, Jan 27, 2021 at 10:54 PM Enrico Olivelli <eo...@gmail.com>
> > wrote:
> >
> > > I really would love to see our CI environment in good shape.
> > > Sending a PR now is very hard, most of the time is spent in /pulsar-bot
> > > run-failure-tests
> > >
> > > Thanks Lari for driving this effort
> > >
> > > Enrico
> > >
> > > Il giorno lun 25 gen 2021 alle ore 18:57 Devin Bost <
> > devin.bost@gmail.com>
> > > ha scritto:
> > >
> > > > Thanks for working on this.
> > > >
> > > > --
> > > > Devin G. Bost
> > > >
> > > > On Mon, Jan 25, 2021, 10:05 AM Lari Hotari <la...@sagire.fi>
> > > wrote:
> > > >
> > > > > Dear Pulsar community members,
> > > > >
> > > > > The current test suites in Apache Pulsar build contain flaky tests
> > that
> > > > > make the builds fail very frequently.
> > > > >
> > > > > To address the issues caused by flaky tests, I have been preparing
> a
> > > > draft
> > > > > PIP for "Changes to flaky test handling" together with Enrico
> > Olivelli.
> > > > >
> > > > > The document is a Google doc:
> > > > >
> > > > >
> > > >
> > >
> >
> https://docs.google.com/document/d/10lmn4pW1IsT_8D1ZE0vMjASX0HhjdGdjB794iyScwns/edit?usp=sharing
> > > > >
> > > > > I also hope to get guidance from the Pulsar committers about how to
> > > take
> > > > > this draft forward to become an actual PIP. I have understood that
> > > taking
> > > > > an idea to discussion on the mailing list is the first step for
> > making
> > > a
> > > > > Pulsar Improvement Proposal (PIP).
> > > > >
> > > > > Let's discuss!
> > > > >
> > > > > I'm looking forward to your comments, questions and suggestions.
> > Thank
> > > > you.
> > > > >
> > > > > BR, Lari
> > > > >
> > > >
> > >
> >
>
Re: [Discuss] draft PIP for "Changes to flaky test handling"
Posted by Lari Hotari <La...@hotari.net>.
Thank you Jennifer. I'll take a look soon.
Regards, Lari
On Thu, Jan 28, 2021 at 4:13 PM Jinfeng Huang <hj...@streamnative.io.invalid>
wrote:
> Hi Lari,
> Thank you very much for driving the process.
> I've left some comments and my concerns in your google doc, hope it won't
> bother you too much.
>
> Best Regards,
> Jennifer
>
>
> On Wed, Jan 27, 2021 at 10:54 PM Enrico Olivelli <eo...@gmail.com>
> wrote:
>
> > I really would love to see our CI environment in good shape.
> > Sending a PR now is very hard, most of the time is spent in /pulsar-bot
> > run-failure-tests
> >
> > Thanks Lari for driving this effort
> >
> > Enrico
> >
> > Il giorno lun 25 gen 2021 alle ore 18:57 Devin Bost <
> devin.bost@gmail.com>
> > ha scritto:
> >
> > > Thanks for working on this.
> > >
> > > --
> > > Devin G. Bost
> > >
> > > On Mon, Jan 25, 2021, 10:05 AM Lari Hotari <la...@sagire.fi>
> > wrote:
> > >
> > > > Dear Pulsar community members,
> > > >
> > > > The current test suites in Apache Pulsar build contain flaky tests
> that
> > > > make the builds fail very frequently.
> > > >
> > > > To address the issues caused by flaky tests, I have been preparing a
> > > draft
> > > > PIP for "Changes to flaky test handling" together with Enrico
> Olivelli.
> > > >
> > > > The document is a Google doc:
> > > >
> > > >
> > >
> >
> https://docs.google.com/document/d/10lmn4pW1IsT_8D1ZE0vMjASX0HhjdGdjB794iyScwns/edit?usp=sharing
> > > >
> > > > I also hope to get guidance from the Pulsar committers about how to
> > take
> > > > this draft forward to become an actual PIP. I have understood that
> > taking
> > > > an idea to discussion on the mailing list is the first step for
> making
> > a
> > > > Pulsar Improvement Proposal (PIP).
> > > >
> > > > Let's discuss!
> > > >
> > > > I'm looking forward to your comments, questions and suggestions.
> Thank
> > > you.
> > > >
> > > > BR, Lari
> > > >
> > >
> >
>
Re: [Discuss] draft PIP for "Changes to flaky test handling"
Posted by Jinfeng Huang <hj...@streamnative.io.INVALID>.
Hi Lari,
Thank you very much for driving the process.
I've left some comments and my concerns in your google doc, hope it won't
bother you too much.
Best Regards,
Jennifer
On Wed, Jan 27, 2021 at 10:54 PM Enrico Olivelli <eo...@gmail.com>
wrote:
> I really would love to see our CI environment in good shape.
> Sending a PR now is very hard, most of the time is spent in /pulsar-bot
> run-failure-tests
>
> Thanks Lari for driving this effort
>
> Enrico
>
> Il giorno lun 25 gen 2021 alle ore 18:57 Devin Bost <de...@gmail.com>
> ha scritto:
>
> > Thanks for working on this.
> >
> > --
> > Devin G. Bost
> >
> > On Mon, Jan 25, 2021, 10:05 AM Lari Hotari <la...@sagire.fi>
> wrote:
> >
> > > Dear Pulsar community members,
> > >
> > > The current test suites in Apache Pulsar build contain flaky tests that
> > > make the builds fail very frequently.
> > >
> > > To address the issues caused by flaky tests, I have been preparing a
> > draft
> > > PIP for "Changes to flaky test handling" together with Enrico Olivelli.
> > >
> > > The document is a Google doc:
> > >
> > >
> >
> https://docs.google.com/document/d/10lmn4pW1IsT_8D1ZE0vMjASX0HhjdGdjB794iyScwns/edit?usp=sharing
> > >
> > > I also hope to get guidance from the Pulsar committers about how to
> take
> > > this draft forward to become an actual PIP. I have understood that
> taking
> > > an idea to discussion on the mailing list is the first step for making
> a
> > > Pulsar Improvement Proposal (PIP).
> > >
> > > Let's discuss!
> > >
> > > I'm looking forward to your comments, questions and suggestions. Thank
> > you.
> > >
> > > BR, Lari
> > >
> >
>
Re: [Discuss] draft PIP for "Changes to flaky test handling"
Posted by Enrico Olivelli <eo...@gmail.com>.
I really would love to see our CI environment in good shape.
Sending a PR now is very hard, most of the time is spent in /pulsar-bot
run-failure-tests
Thanks Lari for driving this effort
Enrico
Il giorno lun 25 gen 2021 alle ore 18:57 Devin Bost <de...@gmail.com>
ha scritto:
> Thanks for working on this.
>
> --
> Devin G. Bost
>
> On Mon, Jan 25, 2021, 10:05 AM Lari Hotari <la...@sagire.fi> wrote:
>
> > Dear Pulsar community members,
> >
> > The current test suites in Apache Pulsar build contain flaky tests that
> > make the builds fail very frequently.
> >
> > To address the issues caused by flaky tests, I have been preparing a
> draft
> > PIP for "Changes to flaky test handling" together with Enrico Olivelli.
> >
> > The document is a Google doc:
> >
> >
> https://docs.google.com/document/d/10lmn4pW1IsT_8D1ZE0vMjASX0HhjdGdjB794iyScwns/edit?usp=sharing
> >
> > I also hope to get guidance from the Pulsar committers about how to take
> > this draft forward to become an actual PIP. I have understood that taking
> > an idea to discussion on the mailing list is the first step for making a
> > Pulsar Improvement Proposal (PIP).
> >
> > Let's discuss!
> >
> > I'm looking forward to your comments, questions and suggestions. Thank
> you.
> >
> > BR, Lari
> >
>
Re: [Discuss] draft PIP for "Changes to flaky test handling"
Posted by Devin Bost <de...@gmail.com>.
Thanks for working on this.
--
Devin G. Bost
On Mon, Jan 25, 2021, 10:05 AM Lari Hotari <la...@sagire.fi> wrote:
> Dear Pulsar community members,
>
> The current test suites in Apache Pulsar build contain flaky tests that
> make the builds fail very frequently.
>
> To address the issues caused by flaky tests, I have been preparing a draft
> PIP for "Changes to flaky test handling" together with Enrico Olivelli.
>
> The document is a Google doc:
>
> https://docs.google.com/document/d/10lmn4pW1IsT_8D1ZE0vMjASX0HhjdGdjB794iyScwns/edit?usp=sharing
>
> I also hope to get guidance from the Pulsar committers about how to take
> this draft forward to become an actual PIP. I have understood that taking
> an idea to discussion on the mailing list is the first step for making a
> Pulsar Improvement Proposal (PIP).
>
> Let's discuss!
>
> I'm looking forward to your comments, questions and suggestions. Thank you.
>
> BR, Lari
>