Reproducing test failures on CI

[Anton Chernov <me...@gmail.com>]

Dear MXNet community,

We've noticed that there has been some difficulties setting up environments
and reproducing test results from failed builds on the CI. We would like to
offer some help to the community on that and therefore helding a small live
stream demo session during our User Group Meeting on the 23rd of October.
We will be:

* Reviewing a failure and make an initial guess on the cause
* Setting up environment
* Reproducing the build step from the CI
* Reproducing a failure step
* Making and submitting a fix back to the community

Feel free to propose some additional topic for the streaming.

Best regards
Anton

Re: Reproducing test failures on CI

[Anton Chernov <me...@gmail.com>]

Dear MXNet community,

Unfortunately, due to various reasons, we need to reschedule the demo to
next week's user group, to 30th of October.

Best regards,
Anton




вт, 16 окт. 2018 г. в 18:03, Pedro Larroy <pe...@gmail.com>:

> These are two separate events. The London meetup is not related to Anton's
> original email.
>
> Regarding reproducing CI failures I would suggest that we create some easy
> to use scripts and templates to launch instances rather than lengthy
> documentation or materials. If the process is complex, automation is always
> better than lengthy instructions.
>
> It should be a couple of instructions to reproduce test failures locally or
> in EC2.
> I have a personal terraform file and scripts which I use to provision
> instances to do MXNet work in which does all the tedious configuration. I
> could polish them up a bit and create a PR. Another script would be needed
> to launch build & test easily as now with the complexity of the
> JenkinsFiles is too convoluted to reverse engineer for somebody not
> familiar with CI.
>
> There's this nice guide that Marco created:
> https://cwiki.apache.org/confluence/display/MXNET/Reproducing+test+results
>
> But seems not many people read it, also it doesn't solve provisioning the
> instance and installing the initial dependencies.
>
>
> Pedro.
>
> On Mon, Oct 15, 2018 at 8:58 PM Naveen Swamy <mn...@gmail.com> wrote:
>
> > Timur,
> > Here is a meetup Scheduled for 23rd October in London, where Pedro Larroy
> > will talk about Deep Learning using MXNet!
> >
> >
> >
> https://www.meetup.com/Deep-Learning-with-Apache-MXNet-London/events/255280739/
> >
> >
> > -Naveen
> >
> > On Mon, Oct 15, 2018 at 11:18 AM Anton Chernov <me...@gmail.com>
> > wrote:
> >
> > > Sorry, Timur, I've missed that part.
> > >
> > > It will be during the regular user group meeting that is conducted in
> > > Berlin and is streamed via Chime. You can find more information on the
> > > wiki:
> > >
> > >
> > >
> >
> https://cwiki.apache.org/confluence/display/MXNET/Apache+MXNet+%28Incubating%29+User+Groups+recurring+meetings
> > >
> > > Best
> > > Anton
> > >
> > >
> > > пн, 15 окт. 2018 г. в 18:45, Timur Shenkao <ts...@timshenkao.su>:
> > >
> > > > Is it London meeting?
> > > > Or some other location?
> > > >
> > > > On Monday, October 15, 2018, Anton Chernov <me...@gmail.com>
> > wrote:
> > > >
> > > > > Dear MXNet community,
> > > > >
> > > > > We've noticed that there has been some difficulties setting up
> > > > environments
> > > > > and reproducing test results from failed builds on the CI. We would
> > > like
> > > > to
> > > > > offer some help to the community on that and therefore helding a
> > small
> > > > live
> > > > > stream demo session during our User Group Meeting on the 23rd of
> > > October.
> > > > > We will be:
> > > > >
> > > > > * Reviewing a failure and make an initial guess on the cause
> > > > > * Setting up environment
> > > > > * Reproducing the build step from the CI
> > > > > * Reproducing a failure step
> > > > > * Making and submitting a fix back to the community
> > > > >
> > > > > Feel free to propose some additional topic for the streaming.
> > > > >
> > > > > Best regards
> > > > > Anton
> > > > >
> > > >
> > >
> >
>

Re: Reproducing test failures on CI

[Pedro Larroy <pe...@gmail.com>]

These are two separate events. The London meetup is not related to Anton's
original email.

Regarding reproducing CI failures I would suggest that we create some easy
to use scripts and templates to launch instances rather than lengthy
documentation or materials. If the process is complex, automation is always
better than lengthy instructions.

It should be a couple of instructions to reproduce test failures locally or
in EC2.
I have a personal terraform file and scripts which I use to provision
instances to do MXNet work in which does all the tedious configuration. I
could polish them up a bit and create a PR. Another script would be needed
to launch build & test easily as now with the complexity of the
JenkinsFiles is too convoluted to reverse engineer for somebody not
familiar with CI.

There's this nice guide that Marco created:
https://cwiki.apache.org/confluence/display/MXNET/Reproducing+test+results

But seems not many people read it, also it doesn't solve provisioning the
instance and installing the initial dependencies.


Pedro.

On Mon, Oct 15, 2018 at 8:58 PM Naveen Swamy <mn...@gmail.com> wrote:

> Timur,
> Here is a meetup Scheduled for 23rd October in London, where Pedro Larroy
> will talk about Deep Learning using MXNet!
>
>
> https://www.meetup.com/Deep-Learning-with-Apache-MXNet-London/events/255280739/
>
>
> -Naveen
>
> On Mon, Oct 15, 2018 at 11:18 AM Anton Chernov <me...@gmail.com>
> wrote:
>
> > Sorry, Timur, I've missed that part.
> >
> > It will be during the regular user group meeting that is conducted in
> > Berlin and is streamed via Chime. You can find more information on the
> > wiki:
> >
> >
> >
> https://cwiki.apache.org/confluence/display/MXNET/Apache+MXNet+%28Incubating%29+User+Groups+recurring+meetings
> >
> > Best
> > Anton
> >
> >
> > пн, 15 окт. 2018 г. в 18:45, Timur Shenkao <ts...@timshenkao.su>:
> >
> > > Is it London meeting?
> > > Or some other location?
> > >
> > > On Monday, October 15, 2018, Anton Chernov <me...@gmail.com>
> wrote:
> > >
> > > > Dear MXNet community,
> > > >
> > > > We've noticed that there has been some difficulties setting up
> > > environments
> > > > and reproducing test results from failed builds on the CI. We would
> > like
> > > to
> > > > offer some help to the community on that and therefore helding a
> small
> > > live
> > > > stream demo session during our User Group Meeting on the 23rd of
> > October.
> > > > We will be:
> > > >
> > > > * Reviewing a failure and make an initial guess on the cause
> > > > * Setting up environment
> > > > * Reproducing the build step from the CI
> > > > * Reproducing a failure step
> > > > * Making and submitting a fix back to the community
> > > >
> > > > Feel free to propose some additional topic for the streaming.
> > > >
> > > > Best regards
> > > > Anton
> > > >
> > >
> >
>

Re: Reproducing test failures on CI

[Naveen Swamy <mn...@gmail.com>]

Timur,
Here is a meetup Scheduled for 23rd October in London, where Pedro Larroy
will talk about Deep Learning using MXNet!

https://www.meetup.com/Deep-Learning-with-Apache-MXNet-London/events/255280739/


-Naveen

On Mon, Oct 15, 2018 at 11:18 AM Anton Chernov <me...@gmail.com> wrote:

> Sorry, Timur, I've missed that part.
>
> It will be during the regular user group meeting that is conducted in
> Berlin and is streamed via Chime. You can find more information on the
> wiki:
>
>
> https://cwiki.apache.org/confluence/display/MXNET/Apache+MXNet+%28Incubating%29+User+Groups+recurring+meetings
>
> Best
> Anton
>
>
> пн, 15 окт. 2018 г. в 18:45, Timur Shenkao <ts...@timshenkao.su>:
>
> > Is it London meeting?
> > Or some other location?
> >
> > On Monday, October 15, 2018, Anton Chernov <me...@gmail.com> wrote:
> >
> > > Dear MXNet community,
> > >
> > > We've noticed that there has been some difficulties setting up
> > environments
> > > and reproducing test results from failed builds on the CI. We would
> like
> > to
> > > offer some help to the community on that and therefore helding a small
> > live
> > > stream demo session during our User Group Meeting on the 23rd of
> October.
> > > We will be:
> > >
> > > * Reviewing a failure and make an initial guess on the cause
> > > * Setting up environment
> > > * Reproducing the build step from the CI
> > > * Reproducing a failure step
> > > * Making and submitting a fix back to the community
> > >
> > > Feel free to propose some additional topic for the streaming.
> > >
> > > Best regards
> > > Anton
> > >
> >
>

Re: Reproducing test failures on CI

[Anton Chernov <me...@gmail.com>]

Sorry, Timur, I've missed that part.

It will be during the regular user group meeting that is conducted in
Berlin and is streamed via Chime. You can find more information on the wiki:

https://cwiki.apache.org/confluence/display/MXNET/Apache+MXNet+%28Incubating%29+User+Groups+recurring+meetings

Best
Anton


пн, 15 окт. 2018 г. в 18:45, Timur Shenkao <ts...@timshenkao.su>:

> Is it London meeting?
> Or some other location?
>
> On Monday, October 15, 2018, Anton Chernov <me...@gmail.com> wrote:
>
> > Dear MXNet community,
> >
> > We've noticed that there has been some difficulties setting up
> environments
> > and reproducing test results from failed builds on the CI. We would like
> to
> > offer some help to the community on that and therefore helding a small
> live
> > stream demo session during our User Group Meeting on the 23rd of October.
> > We will be:
> >
> > * Reviewing a failure and make an initial guess on the cause
> > * Setting up environment
> > * Reproducing the build step from the CI
> > * Reproducing a failure step
> > * Making and submitting a fix back to the community
> >
> > Feel free to propose some additional topic for the streaming.
> >
> > Best regards
> > Anton
> >
>

Re: Reproducing test failures on CI

[Timur Shenkao <ts...@timshenkao.su>]

Is it London meeting?
Or some other location?

On Monday, October 15, 2018, Anton Chernov <me...@gmail.com> wrote:

> Dear MXNet community,
>
> We've noticed that there has been some difficulties setting up environments
> and reproducing test results from failed builds on the CI. We would like to
> offer some help to the community on that and therefore helding a small live
> stream demo session during our User Group Meeting on the 23rd of October.
> We will be:
>
> * Reviewing a failure and make an initial guess on the cause
> * Setting up environment
> * Reproducing the build step from the CI
> * Reproducing a failure step
> * Making and submitting a fix back to the community
>
> Feel free to propose some additional topic for the streaming.
>
> Best regards
> Anton
>