You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@apisix.apache.org by flyingfox <id...@gmail.com> on 2020/10/31 00:02:46 UTC
proposal: chaos test
Hi, Community,
I want to recommend chaos test this time.
1.Background
In the real world, various faults may occur anytime and anywhere, such
as sudden disk write failure, or sudden network disconnection in the
computer room, etc. In order to more easily verify APISIX's tolerance for
various faults, we need to perform chaos testing.
2.Purpose
Check whether APISIX can work normally in the case of various external
faults.
3.Method
Thanks to @Yiyiyimu for recommending a good testing tool that can
simulate various system failures--chaos-mesh, we can add a separate action
to combine chaos-mesh to perform chaos testing on APISXI.
Re: proposal: chaos test
Posted by Ming Wen <we...@apache.org>.
Yes, many abnormal situations can be simulated. Do you have a plan?
Thanks,
Ming Wen, Apache APISIX & Apache SkyWalking
Twitter: _WenMing
flyingfox <id...@gmail.com> 于2020年11月2日周一 下午2:11写道：
> It can also simulate various experimental scenarios, such as high IO load,
> high CPU load, high memory load, full disk, etc. These scenarios can be
> used to test the stability of APISIX;
> ETCD crashes, ETCD process hangs, designated ports are occupied, etc. These
> scenarios can be used to test the fault tolerance of APISIX.
>
> Ming Wen <we...@apache.org> 于2020年11月2日周一 下午12:28写道：
>
> > If it is a test network packet loss, I don't think this is of any use to
> > Apache APISIX.
> > http, https, tcp are all reliable transmission protocols
> >
> > Thanks,
> > Ming Wen, Apache APISIX & Apache SkyWalking
> > Twitter: _WenMing
> >
> >
> > flyingfox <id...@gmail.com> 于2020年11月2日周一 上午11:48写道：
> >
> > > Hi, thanks reply.
> > > Chaos Mesh is just an example. After posting this proposal, I found
> > > Alibaba's chaosblade, which is easier to use,
> > > For example, to simulate network packet loss like this:
> > > `blade create network loss --percent 80 --interface eth0 --local-port
> > 8080`
> > > We deploy it with APISIX, then we can verify the self-fault tolerance
> of
> > > APISIX in the case of network abnormalities.
> > >
> > > Ming Wen <we...@apache.org> 于2020年10月31日周六 上午8:31写道：
> > >
> > > > Hi,
> > > > What specific problems will chaos mesh help Apache APISIX solve? Can
> > you
> > > > give us an example?
> > > >
> > > > Thanks,
> > > > Ming Wen, Apache APISIX & Apache SkyWalking
> > > > Twitter: _WenMing
> > > >
> > > >
> > > > flyingfox <id...@gmail.com> 于2020年10月31日周六 上午8:03写道：
> > > >
> > > > > Hi, Community,
> > > > > I want to recommend chaos test this time.
> > > > > 1.Background
> > > > > In the real world, various faults may occur anytime and
> > anywhere,
> > > > such
> > > > > as sudden disk write failure, or sudden network disconnection in
> the
> > > > > computer room, etc. In order to more easily verify APISIX's
> tolerance
> > > for
> > > > > various faults, we need to perform chaos testing.
> > > > > 2.Purpose
> > > > > Check whether APISIX can work normally in the case of various
> > > > external
> > > > > faults.
> > > > > 3.Method
> > > > > Thanks to @Yiyiyimu for recommending a good testing tool that
> > can
> > > > > simulate various system failures--chaos-mesh, we can add a separate
> > > > action
> > > > > to combine chaos-mesh to perform chaos testing on APISXI.
> > > > >
> > > >
> > >
> >
>
Re: proposal: chaos test
Posted by YuanSheng Wang <me...@apache.org>.
we need a plan for the chaos test.
@flyingfox I advise we can write a plan with a case list, then we can
support it step by step.
what do you think?
On Mon, Nov 2, 2020 at 6:31 PM flyingfox <id...@gmail.com> wrote:
> My plan is to first disassemble each scene into an action test,
> and each test includes the installation of APISIX, the use of common
> functions, such as routing settings, and the effectiveness of routing.
>
> YuanSheng Wang <me...@apache.org> 于2020年11月2日周一 下午5:46写道：
>
> > On Mon, Nov 2, 2020 at 2:11 PM flyingfox <id...@gmail.com> wrote:
> >
> > > It can also simulate various experimental scenarios, such as high IO
> > load,
> > > high CPU load, high memory load, full disk, etc. These scenarios can be
> > > used to test the stability of APISIX;
> > >
> >
> > we need a list for those case, that is very important ^_^
> >
> >
> >
> > > ETCD crashes, ETCD process hangs, designated ports are occupied, etc.
> > These
> > > scenarios can be used to test the fault tolerance of APISIX.
> > >
> > > Ming Wen <we...@apache.org> 于2020年11月2日周一 下午12:28写道：
> > >
> > > > If it is a test network packet loss, I don't think this is of any use
> > to
> > > > Apache APISIX.
> > > > http, https, tcp are all reliable transmission protocols
> > > >
> > > > Thanks,
> > > > Ming Wen, Apache APISIX & Apache SkyWalking
> > > > Twitter: _WenMing
> > > >
> > > >
> > > > flyingfox <id...@gmail.com> 于2020年11月2日周一 上午11:48写道：
> > > >
> > > > > Hi, thanks reply.
> > > > > Chaos Mesh is just an example. After posting this proposal, I found
> > > > > Alibaba's chaosblade, which is easier to use,
> > > > > For example, to simulate network packet loss like this:
> > > > > `blade create network loss --percent 80 --interface eth0
> --local-port
> > > > 8080`
> > > > > We deploy it with APISIX, then we can verify the self-fault
> tolerance
> > > of
> > > > > APISIX in the case of network abnormalities.
> > > > >
> > > > > Ming Wen <we...@apache.org> 于2020年10月31日周六 上午8:31写道：
> > > > >
> > > > > > Hi,
> > > > > > What specific problems will chaos mesh help Apache APISIX solve?
> > Can
> > > > you
> > > > > > give us an example?
> > > > > >
> > > > > > Thanks,
> > > > > > Ming Wen, Apache APISIX & Apache SkyWalking
> > > > > > Twitter: _WenMing
> > > > > >
> > > > > >
> > > > > > flyingfox <id...@gmail.com> 于2020年10月31日周六 上午8:03写道：
> > > > > >
> > > > > > > Hi, Community,
> > > > > > > I want to recommend chaos test this time.
> > > > > > > 1.Background
> > > > > > > In the real world, various faults may occur anytime and
> > > > anywhere,
> > > > > > such
> > > > > > > as sudden disk write failure, or sudden network disconnection
> in
> > > the
> > > > > > > computer room, etc. In order to more easily verify APISIX's
> > > tolerance
> > > > > for
> > > > > > > various faults, we need to perform chaos testing.
> > > > > > > 2.Purpose
> > > > > > > Check whether APISIX can work normally in the case of
> > various
> > > > > > external
> > > > > > > faults.
> > > > > > > 3.Method
> > > > > > > Thanks to @Yiyiyimu for recommending a good testing tool
> > that
> > > > can
> > > > > > > simulate various system failures--chaos-mesh, we can add a
> > separate
> > > > > > action
> > > > > > > to combine chaos-mesh to perform chaos testing on APISXI.
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> >
> > --
> >
> > *MembPhis*
> > My GitHub: https://github.com/membphis
> > Apache APISIX: https://github.com/apache/apisix
> >
>
--
*MembPhis*
My GitHub: https://github.com/membphis
Apache APISIX: https://github.com/apache/apisix
Re: proposal: chaos test
Posted by flyingfox <id...@gmail.com>.
My plan is to first disassemble each scene into an action test,
and each test includes the installation of APISIX, the use of common
functions, such as routing settings, and the effectiveness of routing.
YuanSheng Wang <me...@apache.org> 于2020年11月2日周一 下午5:46写道：
> On Mon, Nov 2, 2020 at 2:11 PM flyingfox <id...@gmail.com> wrote:
>
> > It can also simulate various experimental scenarios, such as high IO
> load,
> > high CPU load, high memory load, full disk, etc. These scenarios can be
> > used to test the stability of APISIX;
> >
>
> we need a list for those case, that is very important ^_^
>
>
>
> > ETCD crashes, ETCD process hangs, designated ports are occupied, etc.
> These
> > scenarios can be used to test the fault tolerance of APISIX.
> >
> > Ming Wen <we...@apache.org> 于2020年11月2日周一 下午12:28写道：
> >
> > > If it is a test network packet loss, I don't think this is of any use
> to
> > > Apache APISIX.
> > > http, https, tcp are all reliable transmission protocols
> > >
> > > Thanks,
> > > Ming Wen, Apache APISIX & Apache SkyWalking
> > > Twitter: _WenMing
> > >
> > >
> > > flyingfox <id...@gmail.com> 于2020年11月2日周一 上午11:48写道：
> > >
> > > > Hi, thanks reply.
> > > > Chaos Mesh is just an example. After posting this proposal, I found
> > > > Alibaba's chaosblade, which is easier to use,
> > > > For example, to simulate network packet loss like this:
> > > > `blade create network loss --percent 80 --interface eth0 --local-port
> > > 8080`
> > > > We deploy it with APISIX, then we can verify the self-fault tolerance
> > of
> > > > APISIX in the case of network abnormalities.
> > > >
> > > > Ming Wen <we...@apache.org> 于2020年10月31日周六 上午8:31写道：
> > > >
> > > > > Hi,
> > > > > What specific problems will chaos mesh help Apache APISIX solve?
> Can
> > > you
> > > > > give us an example?
> > > > >
> > > > > Thanks,
> > > > > Ming Wen, Apache APISIX & Apache SkyWalking
> > > > > Twitter: _WenMing
> > > > >
> > > > >
> > > > > flyingfox <id...@gmail.com> 于2020年10月31日周六 上午8:03写道：
> > > > >
> > > > > > Hi, Community,
> > > > > > I want to recommend chaos test this time.
> > > > > > 1.Background
> > > > > > In the real world, various faults may occur anytime and
> > > anywhere,
> > > > > such
> > > > > > as sudden disk write failure, or sudden network disconnection in
> > the
> > > > > > computer room, etc. In order to more easily verify APISIX's
> > tolerance
> > > > for
> > > > > > various faults, we need to perform chaos testing.
> > > > > > 2.Purpose
> > > > > > Check whether APISIX can work normally in the case of
> various
> > > > > external
> > > > > > faults.
> > > > > > 3.Method
> > > > > > Thanks to @Yiyiyimu for recommending a good testing tool
> that
> > > can
> > > > > > simulate various system failures--chaos-mesh, we can add a
> separate
> > > > > action
> > > > > > to combine chaos-mesh to perform chaos testing on APISXI.
> > > > > >
> > > > >
> > > >
> > >
> >
>
>
> --
>
> *MembPhis*
> My GitHub: https://github.com/membphis
> Apache APISIX: https://github.com/apache/apisix
>
Re: proposal: chaos test
Posted by YuanSheng Wang <me...@apache.org>.
On Mon, Nov 2, 2020 at 2:11 PM flyingfox <id...@gmail.com> wrote:
> It can also simulate various experimental scenarios, such as high IO load,
> high CPU load, high memory load, full disk, etc. These scenarios can be
> used to test the stability of APISIX;
>
we need a list for those case, that is very important ^_^
> ETCD crashes, ETCD process hangs, designated ports are occupied, etc. These
> scenarios can be used to test the fault tolerance of APISIX.
>
> Ming Wen <we...@apache.org> 于2020年11月2日周一 下午12:28写道：
>
> > If it is a test network packet loss, I don't think this is of any use to
> > Apache APISIX.
> > http, https, tcp are all reliable transmission protocols
> >
> > Thanks,
> > Ming Wen, Apache APISIX & Apache SkyWalking
> > Twitter: _WenMing
> >
> >
> > flyingfox <id...@gmail.com> 于2020年11月2日周一 上午11:48写道：
> >
> > > Hi, thanks reply.
> > > Chaos Mesh is just an example. After posting this proposal, I found
> > > Alibaba's chaosblade, which is easier to use,
> > > For example, to simulate network packet loss like this:
> > > `blade create network loss --percent 80 --interface eth0 --local-port
> > 8080`
> > > We deploy it with APISIX, then we can verify the self-fault tolerance
> of
> > > APISIX in the case of network abnormalities.
> > >
> > > Ming Wen <we...@apache.org> 于2020年10月31日周六 上午8:31写道：
> > >
> > > > Hi,
> > > > What specific problems will chaos mesh help Apache APISIX solve? Can
> > you
> > > > give us an example?
> > > >
> > > > Thanks,
> > > > Ming Wen, Apache APISIX & Apache SkyWalking
> > > > Twitter: _WenMing
> > > >
> > > >
> > > > flyingfox <id...@gmail.com> 于2020年10月31日周六 上午8:03写道：
> > > >
> > > > > Hi, Community,
> > > > > I want to recommend chaos test this time.
> > > > > 1.Background
> > > > > In the real world, various faults may occur anytime and
> > anywhere,
> > > > such
> > > > > as sudden disk write failure, or sudden network disconnection in
> the
> > > > > computer room, etc. In order to more easily verify APISIX's
> tolerance
> > > for
> > > > > various faults, we need to perform chaos testing.
> > > > > 2.Purpose
> > > > > Check whether APISIX can work normally in the case of various
> > > > external
> > > > > faults.
> > > > > 3.Method
> > > > > Thanks to @Yiyiyimu for recommending a good testing tool that
> > can
> > > > > simulate various system failures--chaos-mesh, we can add a separate
> > > > action
> > > > > to combine chaos-mesh to perform chaos testing on APISXI.
> > > > >
> > > >
> > >
> >
>
--
*MembPhis*
My GitHub: https://github.com/membphis
Apache APISIX: https://github.com/apache/apisix
Re: proposal: chaos test
Posted by flyingfox <id...@gmail.com>.
It can also simulate various experimental scenarios, such as high IO load,
high CPU load, high memory load, full disk, etc. These scenarios can be
used to test the stability of APISIX;
ETCD crashes, ETCD process hangs, designated ports are occupied, etc. These
scenarios can be used to test the fault tolerance of APISIX.
Ming Wen <we...@apache.org> 于2020年11月2日周一 下午12:28写道：
> If it is a test network packet loss, I don't think this is of any use to
> Apache APISIX.
> http, https, tcp are all reliable transmission protocols
>
> Thanks,
> Ming Wen, Apache APISIX & Apache SkyWalking
> Twitter: _WenMing
>
>
> flyingfox <id...@gmail.com> 于2020年11月2日周一 上午11:48写道：
>
> > Hi, thanks reply.
> > Chaos Mesh is just an example. After posting this proposal, I found
> > Alibaba's chaosblade, which is easier to use,
> > For example, to simulate network packet loss like this:
> > `blade create network loss --percent 80 --interface eth0 --local-port
> 8080`
> > We deploy it with APISIX, then we can verify the self-fault tolerance of
> > APISIX in the case of network abnormalities.
> >
> > Ming Wen <we...@apache.org> 于2020年10月31日周六 上午8:31写道：
> >
> > > Hi,
> > > What specific problems will chaos mesh help Apache APISIX solve? Can
> you
> > > give us an example?
> > >
> > > Thanks,
> > > Ming Wen, Apache APISIX & Apache SkyWalking
> > > Twitter: _WenMing
> > >
> > >
> > > flyingfox <id...@gmail.com> 于2020年10月31日周六 上午8:03写道：
> > >
> > > > Hi, Community,
> > > > I want to recommend chaos test this time.
> > > > 1.Background
> > > > In the real world, various faults may occur anytime and
> anywhere,
> > > such
> > > > as sudden disk write failure, or sudden network disconnection in the
> > > > computer room, etc. In order to more easily verify APISIX's tolerance
> > for
> > > > various faults, we need to perform chaos testing.
> > > > 2.Purpose
> > > > Check whether APISIX can work normally in the case of various
> > > external
> > > > faults.
> > > > 3.Method
> > > > Thanks to @Yiyiyimu for recommending a good testing tool that
> can
> > > > simulate various system failures--chaos-mesh, we can add a separate
> > > action
> > > > to combine chaos-mesh to perform chaos testing on APISXI.
> > > >
> > >
> >
>
Re: proposal: chaos test
Posted by Ming Wen <we...@apache.org>.
If it is a test network packet loss, I don't think this is of any use to
Apache APISIX.
http, https, tcp are all reliable transmission protocols
Thanks,
Ming Wen, Apache APISIX & Apache SkyWalking
Twitter: _WenMing
flyingfox <id...@gmail.com> 于2020年11月2日周一 上午11:48写道：
> Hi, thanks reply.
> Chaos Mesh is just an example. After posting this proposal, I found
> Alibaba's chaosblade, which is easier to use,
> For example, to simulate network packet loss like this:
> `blade create network loss --percent 80 --interface eth0 --local-port 8080`
> We deploy it with APISIX, then we can verify the self-fault tolerance of
> APISIX in the case of network abnormalities.
>
> Ming Wen <we...@apache.org> 于2020年10月31日周六 上午8:31写道：
>
> > Hi,
> > What specific problems will chaos mesh help Apache APISIX solve? Can you
> > give us an example?
> >
> > Thanks,
> > Ming Wen, Apache APISIX & Apache SkyWalking
> > Twitter: _WenMing
> >
> >
> > flyingfox <id...@gmail.com> 于2020年10月31日周六 上午8:03写道：
> >
> > > Hi, Community,
> > > I want to recommend chaos test this time.
> > > 1.Background
> > > In the real world, various faults may occur anytime and anywhere,
> > such
> > > as sudden disk write failure, or sudden network disconnection in the
> > > computer room, etc. In order to more easily verify APISIX's tolerance
> for
> > > various faults, we need to perform chaos testing.
> > > 2.Purpose
> > > Check whether APISIX can work normally in the case of various
> > external
> > > faults.
> > > 3.Method
> > > Thanks to @Yiyiyimu for recommending a good testing tool that can
> > > simulate various system failures--chaos-mesh, we can add a separate
> > action
> > > to combine chaos-mesh to perform chaos testing on APISXI.
> > >
> >
>
Re: proposal: chaos test
Posted by flyingfox <id...@gmail.com>.
Hi, thanks reply.
Chaos Mesh is just an example. After posting this proposal, I found
Alibaba's chaosblade, which is easier to use,
For example, to simulate network packet loss like this:
`blade create network loss --percent 80 --interface eth0 --local-port 8080`
We deploy it with APISIX, then we can verify the self-fault tolerance of
APISIX in the case of network abnormalities.
Ming Wen <we...@apache.org> 于2020年10月31日周六 上午8:31写道：
> Hi,
> What specific problems will chaos mesh help Apache APISIX solve? Can you
> give us an example?
>
> Thanks,
> Ming Wen, Apache APISIX & Apache SkyWalking
> Twitter: _WenMing
>
>
> flyingfox <id...@gmail.com> 于2020年10月31日周六 上午8:03写道：
>
> > Hi, Community,
> > I want to recommend chaos test this time.
> > 1.Background
> > In the real world, various faults may occur anytime and anywhere,
> such
> > as sudden disk write failure, or sudden network disconnection in the
> > computer room, etc. In order to more easily verify APISIX's tolerance for
> > various faults, we need to perform chaos testing.
> > 2.Purpose
> > Check whether APISIX can work normally in the case of various
> external
> > faults.
> > 3.Method
> > Thanks to @Yiyiyimu for recommending a good testing tool that can
> > simulate various system failures--chaos-mesh, we can add a separate
> action
> > to combine chaos-mesh to perform chaos testing on APISXI.
> >
>
Re: proposal: chaos test
Posted by Ming Wen <we...@apache.org>.
Hi,
What specific problems will chaos mesh help Apache APISIX solve? Can you
give us an example?
Thanks,
Ming Wen, Apache APISIX & Apache SkyWalking
Twitter: _WenMing
flyingfox <id...@gmail.com> 于2020年10月31日周六 上午8:03写道：
> Hi, Community,
> I want to recommend chaos test this time.
> 1.Background
> In the real world, various faults may occur anytime and anywhere, such
> as sudden disk write failure, or sudden network disconnection in the
> computer room, etc. In order to more easily verify APISIX's tolerance for
> various faults, we need to perform chaos testing.
> 2.Purpose
> Check whether APISIX can work normally in the case of various external
> faults.
> 3.Method
> Thanks to @Yiyiyimu for recommending a good testing tool that can
> simulate various system failures--chaos-mesh, we can add a separate action
> to combine chaos-mesh to perform chaos testing on APISXI.
>