You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mxnet.apache.org by Indhu <in...@gmail.com> on 2018/06/14 20:04:36 UTC

Nightly tests README accurate?

Is the README
<https://github.com/apache/incubator-mxnet/tree/master/tests/nightly> for
the nightly tests accurate? For example,

1. Are tests being run on machines with Intel i7-4790 and 4 Nvidia GTX 970
Tis?
2. Is http://ci.dmlc.ml/ the right place to look for build status?
3. Is the instruction to run on Jenkins correct?

If not, what all needs to be changed in that page?

Re: Nightly tests README accurate?

Posted by Marco de Abreu <ma...@googlemail.com.INVALID>.
Thanks for your input. Do these tests really require a p3 or would g3 be
sufficient? We got 2 GPUs on the g3 instances and they are a lot

-Marco

Indhu <in...@gmail.com> schrieb am Mo., 18. Juni 2018, 15:02:

> I was working on testing the notebooks from https://gluon.mxnet.io/ as
> part
> of the nightly tests to make sure we notice any API change that could break
> code in those notebooks.
>
> The README in the nightly folder said the tests are being run on machines
> with multiple GPUs. I was wondering if I have to run multiple notebooks in
> parallel to efficiently utilize all GPUs. After reading your email, I'm
> thinking I'll run most of the notebooks on P3.2xl and only the ones that
> require multiple GPUs on P3.8xl. Thanks for the reply.
>
>
> On Mon, Jun 18, 2018 at 2:24 PM Marco de Abreu
> <ma...@googlemail.com.invalid> wrote:
>
> > In future (next few days) the nightlies will be running on our regular CI
> > at http://jenkins.mxnet-ci.amazon-ml.com/
> >
> > On there, we support C5.18xlarge (Ubuntu, CentOS within Docker and
> > Windows), G3.8xlarge (Ubuntu, CentOS within Docker and Windows),
> P3.2xlarge
> > (Ubuntu, CentOS within docker) and (upcoming) P3.8xlarge (Ubuntu, CentOS
> > within docker).
> >
> > What exact requirements do you have, Indhu? I'm happy to assist!
> >
> > -Marco
> >
> > On Mon, Jun 18, 2018 at 1:47 PM Indhu <in...@gmail.com> wrote:
> >
> > > Thanks Meghna. Do you know what hardware the nightly tests are
> currently
> > > running on? I'm adding some nightly tests. It will be useful to know.
> > >
> > >
> > > On Mon, Jun 18, 2018 at 9:11 AM Meghna Baijal <
> > meghnabaijal2017@gmail.com>
> > > wrote:
> > >
> > > > Hi,
> > > > This readme is incorrect and I am fixing this as a part of the
> nightly
> > > > tests PR soon.
> > > >
> > > > Thanks,
> > > > Meghna
> > > >
> > > > On Sun, Jun 17, 2018 at 7:05 AM kellen sunderland <
> > > > kellen.sunderland@gmail.com> wrote:
> > > >
> > > > > I'm not a commiter, but I would say this is clearly not correct.  I
> > > would
> > > > > propose removing the doc until someone has time to verify that the
> > > steps
> > > > > work correctly, and that the descriptions are accurate.
> > > > >
> > > > > On Thu, Jun 14, 2018 at 10:04 PM Indhu <in...@gmail.com>
> > > wrote:
> > > > >
> > > > > > Is the README
> > > > > > <
> > https://github.com/apache/incubator-mxnet/tree/master/tests/nightly
> > > >
> > > > > for
> > > > > > the nightly tests accurate? For example,
> > > > > >
> > > > > > 1. Are tests being run on machines with Intel i7-4790 and 4
> Nvidia
> > > GTX
> > > > > 970
> > > > > > Tis?
> > > > > > 2. Is http://ci.dmlc.ml/ the right place to look for build
> status?
> > > > > > 3. Is the instruction to run on Jenkins correct?
> > > > > >
> > > > > > If not, what all needs to be changed in that page?
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: Nightly tests README accurate?

Posted by Indhu <in...@gmail.com>.
I was working on testing the notebooks from https://gluon.mxnet.io/ as part
of the nightly tests to make sure we notice any API change that could break
code in those notebooks.

The README in the nightly folder said the tests are being run on machines
with multiple GPUs. I was wondering if I have to run multiple notebooks in
parallel to efficiently utilize all GPUs. After reading your email, I'm
thinking I'll run most of the notebooks on P3.2xl and only the ones that
require multiple GPUs on P3.8xl. Thanks for the reply.


On Mon, Jun 18, 2018 at 2:24 PM Marco de Abreu
<ma...@googlemail.com.invalid> wrote:

> In future (next few days) the nightlies will be running on our regular CI
> at http://jenkins.mxnet-ci.amazon-ml.com/
>
> On there, we support C5.18xlarge (Ubuntu, CentOS within Docker and
> Windows), G3.8xlarge (Ubuntu, CentOS within Docker and Windows), P3.2xlarge
> (Ubuntu, CentOS within docker) and (upcoming) P3.8xlarge (Ubuntu, CentOS
> within docker).
>
> What exact requirements do you have, Indhu? I'm happy to assist!
>
> -Marco
>
> On Mon, Jun 18, 2018 at 1:47 PM Indhu <in...@gmail.com> wrote:
>
> > Thanks Meghna. Do you know what hardware the nightly tests are currently
> > running on? I'm adding some nightly tests. It will be useful to know.
> >
> >
> > On Mon, Jun 18, 2018 at 9:11 AM Meghna Baijal <
> meghnabaijal2017@gmail.com>
> > wrote:
> >
> > > Hi,
> > > This readme is incorrect and I am fixing this as a part of the nightly
> > > tests PR soon.
> > >
> > > Thanks,
> > > Meghna
> > >
> > > On Sun, Jun 17, 2018 at 7:05 AM kellen sunderland <
> > > kellen.sunderland@gmail.com> wrote:
> > >
> > > > I'm not a commiter, but I would say this is clearly not correct.  I
> > would
> > > > propose removing the doc until someone has time to verify that the
> > steps
> > > > work correctly, and that the descriptions are accurate.
> > > >
> > > > On Thu, Jun 14, 2018 at 10:04 PM Indhu <in...@gmail.com>
> > wrote:
> > > >
> > > > > Is the README
> > > > > <
> https://github.com/apache/incubator-mxnet/tree/master/tests/nightly
> > >
> > > > for
> > > > > the nightly tests accurate? For example,
> > > > >
> > > > > 1. Are tests being run on machines with Intel i7-4790 and 4 Nvidia
> > GTX
> > > > 970
> > > > > Tis?
> > > > > 2. Is http://ci.dmlc.ml/ the right place to look for build status?
> > > > > 3. Is the instruction to run on Jenkins correct?
> > > > >
> > > > > If not, what all needs to be changed in that page?
> > > > >
> > > >
> > >
> >
>

Re: Nightly tests README accurate?

Posted by Marco de Abreu <ma...@googlemail.com.INVALID>.
In future (next few days) the nightlies will be running on our regular CI
at http://jenkins.mxnet-ci.amazon-ml.com/

On there, we support C5.18xlarge (Ubuntu, CentOS within Docker and
Windows), G3.8xlarge (Ubuntu, CentOS within Docker and Windows), P3.2xlarge
(Ubuntu, CentOS within docker) and (upcoming) P3.8xlarge (Ubuntu, CentOS
within docker).

What exact requirements do you have, Indhu? I'm happy to assist!

-Marco

On Mon, Jun 18, 2018 at 1:47 PM Indhu <in...@gmail.com> wrote:

> Thanks Meghna. Do you know what hardware the nightly tests are currently
> running on? I'm adding some nightly tests. It will be useful to know.
>
>
> On Mon, Jun 18, 2018 at 9:11 AM Meghna Baijal <me...@gmail.com>
> wrote:
>
> > Hi,
> > This readme is incorrect and I am fixing this as a part of the nightly
> > tests PR soon.
> >
> > Thanks,
> > Meghna
> >
> > On Sun, Jun 17, 2018 at 7:05 AM kellen sunderland <
> > kellen.sunderland@gmail.com> wrote:
> >
> > > I'm not a commiter, but I would say this is clearly not correct.  I
> would
> > > propose removing the doc until someone has time to verify that the
> steps
> > > work correctly, and that the descriptions are accurate.
> > >
> > > On Thu, Jun 14, 2018 at 10:04 PM Indhu <in...@gmail.com>
> wrote:
> > >
> > > > Is the README
> > > > <https://github.com/apache/incubator-mxnet/tree/master/tests/nightly
> >
> > > for
> > > > the nightly tests accurate? For example,
> > > >
> > > > 1. Are tests being run on machines with Intel i7-4790 and 4 Nvidia
> GTX
> > > 970
> > > > Tis?
> > > > 2. Is http://ci.dmlc.ml/ the right place to look for build status?
> > > > 3. Is the instruction to run on Jenkins correct?
> > > >
> > > > If not, what all needs to be changed in that page?
> > > >
> > >
> >
>

Re: Nightly tests README accurate?

Posted by Indhu <in...@gmail.com>.
Thanks Meghna. Do you know what hardware the nightly tests are currently
running on? I'm adding some nightly tests. It will be useful to know.


On Mon, Jun 18, 2018 at 9:11 AM Meghna Baijal <me...@gmail.com>
wrote:

> Hi,
> This readme is incorrect and I am fixing this as a part of the nightly
> tests PR soon.
>
> Thanks,
> Meghna
>
> On Sun, Jun 17, 2018 at 7:05 AM kellen sunderland <
> kellen.sunderland@gmail.com> wrote:
>
> > I'm not a commiter, but I would say this is clearly not correct.  I would
> > propose removing the doc until someone has time to verify that the steps
> > work correctly, and that the descriptions are accurate.
> >
> > On Thu, Jun 14, 2018 at 10:04 PM Indhu <in...@gmail.com> wrote:
> >
> > > Is the README
> > > <https://github.com/apache/incubator-mxnet/tree/master/tests/nightly>
> > for
> > > the nightly tests accurate? For example,
> > >
> > > 1. Are tests being run on machines with Intel i7-4790 and 4 Nvidia GTX
> > 970
> > > Tis?
> > > 2. Is http://ci.dmlc.ml/ the right place to look for build status?
> > > 3. Is the instruction to run on Jenkins correct?
> > >
> > > If not, what all needs to be changed in that page?
> > >
> >
>

Re: Nightly tests README accurate?

Posted by Meghna Baijal <me...@gmail.com>.
Hi,
This readme is incorrect and I am fixing this as a part of the nightly
tests PR soon.

Thanks,
Meghna

On Sun, Jun 17, 2018 at 7:05 AM kellen sunderland <
kellen.sunderland@gmail.com> wrote:

> I'm not a commiter, but I would say this is clearly not correct.  I would
> propose removing the doc until someone has time to verify that the steps
> work correctly, and that the descriptions are accurate.
>
> On Thu, Jun 14, 2018 at 10:04 PM Indhu <in...@gmail.com> wrote:
>
> > Is the README
> > <https://github.com/apache/incubator-mxnet/tree/master/tests/nightly>
> for
> > the nightly tests accurate? For example,
> >
> > 1. Are tests being run on machines with Intel i7-4790 and 4 Nvidia GTX
> 970
> > Tis?
> > 2. Is http://ci.dmlc.ml/ the right place to look for build status?
> > 3. Is the instruction to run on Jenkins correct?
> >
> > If not, what all needs to be changed in that page?
> >
>

Re: Nightly tests README accurate?

Posted by kellen sunderland <ke...@gmail.com>.
I'm not a commiter, but I would say this is clearly not correct.  I would
propose removing the doc until someone has time to verify that the steps
work correctly, and that the descriptions are accurate.

On Thu, Jun 14, 2018 at 10:04 PM Indhu <in...@gmail.com> wrote:

> Is the README
> <https://github.com/apache/incubator-mxnet/tree/master/tests/nightly> for
> the nightly tests accurate? For example,
>
> 1. Are tests being run on machines with Intel i7-4790 and 4 Nvidia GTX 970
> Tis?
> 2. Is http://ci.dmlc.ml/ the right place to look for build status?
> 3. Is the instruction to run on Jenkins correct?
>
> If not, what all needs to be changed in that page?
>