You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mxnet.apache.org by Meghna Baijal <me...@gmail.com> on 2017/11/10 00:41:38 UTC
[VOTE] A Separate CI System for Apache MXNet (incubating)
Hi All,
A need has been identified for MXNet’s CI/CD setup to move away from the
Apache Jenkins Service. Over the past few days there has been active
discussion on the necessary and advanced features for such a system and the
various options available. These are being tracked in this Google Doc
<https://docs.google.com/document/d/17PEasQ2VWrXi2Cf7IGZSWGZMawxDkdlavUDASzUmLjk/edit>
(and
are also in the pdf attached).
I would like to start a vote to choose the framework for this new CI/CD
system. The options are -
[1] Jenkins (A setup separated from Apache Jenkins) - with various plugins
[2] TeamCity
[3] Travis CI
[4] GitLabCI
[5] BuildBot
[6] Other - Please Name
Please feel free to add a comment to support your choice.
This vote will be open from now until the end of the day on Monday
11/13/2017
Thanks,
Meghna Baijal
Re: [VOTE] A Separate CI System for Apache MXNet (incubating)
Posted by Hen <ba...@apache.org>.
+1 on Jenkins; makes sense to me to keep it within the same tech as used on
the Apache side.
(Noting that as this is not a required vote, I don't believe this needs to
go to general@incubator or need 3 mentor +1s). As long as 3 committers are
+1 it's good in my opinion.
Hen
On Tue, Nov 14, 2017 at 9:51 AM, kellen sunderland <
kellen.sunderland@gmail.com> wrote:
> @Sandeep, while I've had good experiences with CodeBuild, I'm not sure if
> it would address the needs of this project due to lack of instance type
> options. For example I don't believe they support GPU instances, which are
> required for a large portion of our build/test process. I'd propose we use
> simple reactive auto-scaling groups (based on Jenkins queue length) which
> should also be quite easy to maintain.
>
> -Kellen
>
> On Mon, Nov 13, 2017 at 5:25 AM, Pedro Larroy <
> pedro.larroy.lists@gmail.com>
> wrote:
>
> > +1 for [1] (A setup separated from Apache Jenkins)
> >
> > On Mon, Nov 13, 2017 at 4:50 AM, sandeep krishnamurthy
> > <sa...@gmail.com> wrote:
> > > +1 for [1] Jenkins (A setup separated from Apache Jenkins) - with
> > > preferably AWS Code Build integration to reduce the size of
> > infrastructure
> > > we need to maintain.
> > >
> > > Thanks,
> > > Sandeep
> > >
> > > On Fri, Nov 10, 2017 at 11:57 AM, Bhavin Thaker <
> bhavinthaker@gmail.com>
> > > wrote:
> > >
> > >> +1 for [1] Jenkins (A setup separated from Apache Jenkins) - with
> > various
> > >> plugins.
> > >>
> > >> Bhavin Thaker.
> > >>
> > >> On Fri, Nov 10, 2017 at 11:39 AM, Madan Jampani <
> > madan.jampani@gmail.com>
> > >> wrote:
> > >>
> > >> > +1 for (1)
> > >> >
> > >> > On Thu, Nov 9, 2017 at 4:41 PM, Meghna Baijal <
> > >> meghnabaijal2017@gmail.com>
> > >> > wrote:
> > >> >
> > >> > > Hi All,
> > >> > > A need has been identified for MXNet’s CI/CD setup to move away
> from
> > >> the
> > >> > > Apache Jenkins Service. Over the past few days there has been
> active
> > >> > > discussion on the necessary and advanced features for such a
> system
> > and
> > >> > the
> > >> > > various options available. These are being tracked in this Google
> > Doc
> > >> > > <https://docs.google.com/document/d/
> 17PEasQ2VWrXi2Cf7IGZSWGZMawxDk
> > >> > dlavUDASzUmLjk/edit> (and
> > >> > > are also in the pdf attached).
> > >> > >
> > >> > > I would like to start a vote to choose the framework for this new
> > CI/CD
> > >> > > system. The options are -
> > >> > > [1] Jenkins (A setup separated from Apache Jenkins) - with various
> > >> > plugins
> > >> > > [2] TeamCity
> > >> > > [3] Travis CI
> > >> > > [4] GitLabCI
> > >> > > [5] BuildBot
> > >> > > [6] Other - Please Name
> > >> > >
> > >> > > Please feel free to add a comment to support your choice.
> > >> > > This vote will be open from now until the end of the day on Monday
> > >> > > 11/13/2017
> > >> > >
> > >> > > Thanks,
> > >> > > Meghna Baijal
> > >> > >
> > >> > >
> > >> > >
> > >> >
> > >>
> > >
> > >
> > >
> > > --
> > > Sandeep Krishnamurthy
> >
>
Re: [VOTE] A Separate CI System for Apache MXNet (incubating)
Posted by kellen sunderland <ke...@gmail.com>.
@Sandeep, while I've had good experiences with CodeBuild, I'm not sure if
it would address the needs of this project due to lack of instance type
options. For example I don't believe they support GPU instances, which are
required for a large portion of our build/test process. I'd propose we use
simple reactive auto-scaling groups (based on Jenkins queue length) which
should also be quite easy to maintain.
-Kellen
On Mon, Nov 13, 2017 at 5:25 AM, Pedro Larroy <pe...@gmail.com>
wrote:
> +1 for [1] (A setup separated from Apache Jenkins)
>
> On Mon, Nov 13, 2017 at 4:50 AM, sandeep krishnamurthy
> <sa...@gmail.com> wrote:
> > +1 for [1] Jenkins (A setup separated from Apache Jenkins) - with
> > preferably AWS Code Build integration to reduce the size of
> infrastructure
> > we need to maintain.
> >
> > Thanks,
> > Sandeep
> >
> > On Fri, Nov 10, 2017 at 11:57 AM, Bhavin Thaker <bh...@gmail.com>
> > wrote:
> >
> >> +1 for [1] Jenkins (A setup separated from Apache Jenkins) - with
> various
> >> plugins.
> >>
> >> Bhavin Thaker.
> >>
> >> On Fri, Nov 10, 2017 at 11:39 AM, Madan Jampani <
> madan.jampani@gmail.com>
> >> wrote:
> >>
> >> > +1 for (1)
> >> >
> >> > On Thu, Nov 9, 2017 at 4:41 PM, Meghna Baijal <
> >> meghnabaijal2017@gmail.com>
> >> > wrote:
> >> >
> >> > > Hi All,
> >> > > A need has been identified for MXNet’s CI/CD setup to move away from
> >> the
> >> > > Apache Jenkins Service. Over the past few days there has been active
> >> > > discussion on the necessary and advanced features for such a system
> and
> >> > the
> >> > > various options available. These are being tracked in this Google
> Doc
> >> > > <https://docs.google.com/document/d/17PEasQ2VWrXi2Cf7IGZSWGZMawxDk
> >> > dlavUDASzUmLjk/edit> (and
> >> > > are also in the pdf attached).
> >> > >
> >> > > I would like to start a vote to choose the framework for this new
> CI/CD
> >> > > system. The options are -
> >> > > [1] Jenkins (A setup separated from Apache Jenkins) - with various
> >> > plugins
> >> > > [2] TeamCity
> >> > > [3] Travis CI
> >> > > [4] GitLabCI
> >> > > [5] BuildBot
> >> > > [6] Other - Please Name
> >> > >
> >> > > Please feel free to add a comment to support your choice.
> >> > > This vote will be open from now until the end of the day on Monday
> >> > > 11/13/2017
> >> > >
> >> > > Thanks,
> >> > > Meghna Baijal
> >> > >
> >> > >
> >> > >
> >> >
> >>
> >
> >
> >
> > --
> > Sandeep Krishnamurthy
>
Re: [VOTE] A Separate CI System for Apache MXNet (incubating)
Posted by Pedro Larroy <pe...@gmail.com>.
+1 for [1] (A setup separated from Apache Jenkins)
On Mon, Nov 13, 2017 at 4:50 AM, sandeep krishnamurthy
<sa...@gmail.com> wrote:
> +1 for [1] Jenkins (A setup separated from Apache Jenkins) - with
> preferably AWS Code Build integration to reduce the size of infrastructure
> we need to maintain.
>
> Thanks,
> Sandeep
>
> On Fri, Nov 10, 2017 at 11:57 AM, Bhavin Thaker <bh...@gmail.com>
> wrote:
>
>> +1 for [1] Jenkins (A setup separated from Apache Jenkins) - with various
>> plugins.
>>
>> Bhavin Thaker.
>>
>> On Fri, Nov 10, 2017 at 11:39 AM, Madan Jampani <ma...@gmail.com>
>> wrote:
>>
>> > +1 for (1)
>> >
>> > On Thu, Nov 9, 2017 at 4:41 PM, Meghna Baijal <
>> meghnabaijal2017@gmail.com>
>> > wrote:
>> >
>> > > Hi All,
>> > > A need has been identified for MXNet’s CI/CD setup to move away from
>> the
>> > > Apache Jenkins Service. Over the past few days there has been active
>> > > discussion on the necessary and advanced features for such a system and
>> > the
>> > > various options available. These are being tracked in this Google Doc
>> > > <https://docs.google.com/document/d/17PEasQ2VWrXi2Cf7IGZSWGZMawxDk
>> > dlavUDASzUmLjk/edit> (and
>> > > are also in the pdf attached).
>> > >
>> > > I would like to start a vote to choose the framework for this new CI/CD
>> > > system. The options are -
>> > > [1] Jenkins (A setup separated from Apache Jenkins) - with various
>> > plugins
>> > > [2] TeamCity
>> > > [3] Travis CI
>> > > [4] GitLabCI
>> > > [5] BuildBot
>> > > [6] Other - Please Name
>> > >
>> > > Please feel free to add a comment to support your choice.
>> > > This vote will be open from now until the end of the day on Monday
>> > > 11/13/2017
>> > >
>> > > Thanks,
>> > > Meghna Baijal
>> > >
>> > >
>> > >
>> >
>>
>
>
>
> --
> Sandeep Krishnamurthy
Re: [VOTE] A Separate CI System for Apache MXNet (incubating)
Posted by sandeep krishnamurthy <sa...@gmail.com>.
+1 for [1] Jenkins (A setup separated from Apache Jenkins) - with
preferably AWS Code Build integration to reduce the size of infrastructure
we need to maintain.
Thanks,
Sandeep
On Fri, Nov 10, 2017 at 11:57 AM, Bhavin Thaker <bh...@gmail.com>
wrote:
> +1 for [1] Jenkins (A setup separated from Apache Jenkins) - with various
> plugins.
>
> Bhavin Thaker.
>
> On Fri, Nov 10, 2017 at 11:39 AM, Madan Jampani <ma...@gmail.com>
> wrote:
>
> > +1 for (1)
> >
> > On Thu, Nov 9, 2017 at 4:41 PM, Meghna Baijal <
> meghnabaijal2017@gmail.com>
> > wrote:
> >
> > > Hi All,
> > > A need has been identified for MXNet’s CI/CD setup to move away from
> the
> > > Apache Jenkins Service. Over the past few days there has been active
> > > discussion on the necessary and advanced features for such a system and
> > the
> > > various options available. These are being tracked in this Google Doc
> > > <https://docs.google.com/document/d/17PEasQ2VWrXi2Cf7IGZSWGZMawxDk
> > dlavUDASzUmLjk/edit> (and
> > > are also in the pdf attached).
> > >
> > > I would like to start a vote to choose the framework for this new CI/CD
> > > system. The options are -
> > > [1] Jenkins (A setup separated from Apache Jenkins) - with various
> > plugins
> > > [2] TeamCity
> > > [3] Travis CI
> > > [4] GitLabCI
> > > [5] BuildBot
> > > [6] Other - Please Name
> > >
> > > Please feel free to add a comment to support your choice.
> > > This vote will be open from now until the end of the day on Monday
> > > 11/13/2017
> > >
> > > Thanks,
> > > Meghna Baijal
> > >
> > >
> > >
> >
>
--
Sandeep Krishnamurthy
Re: [VOTE] A Separate CI System for Apache MXNet (incubating)
Posted by Bhavin Thaker <bh...@gmail.com>.
+1 for [1] Jenkins (A setup separated from Apache Jenkins) - with various
plugins.
Bhavin Thaker.
On Fri, Nov 10, 2017 at 11:39 AM, Madan Jampani <ma...@gmail.com>
wrote:
> +1 for (1)
>
> On Thu, Nov 9, 2017 at 4:41 PM, Meghna Baijal <me...@gmail.com>
> wrote:
>
> > Hi All,
> > A need has been identified for MXNet’s CI/CD setup to move away from the
> > Apache Jenkins Service. Over the past few days there has been active
> > discussion on the necessary and advanced features for such a system and
> the
> > various options available. These are being tracked in this Google Doc
> > <https://docs.google.com/document/d/17PEasQ2VWrXi2Cf7IGZSWGZMawxDk
> dlavUDASzUmLjk/edit> (and
> > are also in the pdf attached).
> >
> > I would like to start a vote to choose the framework for this new CI/CD
> > system. The options are -
> > [1] Jenkins (A setup separated from Apache Jenkins) - with various
> plugins
> > [2] TeamCity
> > [3] Travis CI
> > [4] GitLabCI
> > [5] BuildBot
> > [6] Other - Please Name
> >
> > Please feel free to add a comment to support your choice.
> > This vote will be open from now until the end of the day on Monday
> > 11/13/2017
> >
> > Thanks,
> > Meghna Baijal
> >
> >
> >
>
Re: [VOTE] A Separate CI System for Apache MXNet (incubating)
Posted by Madan Jampani <ma...@gmail.com>.
+1 for (1)
On Thu, Nov 9, 2017 at 4:41 PM, Meghna Baijal <me...@gmail.com>
wrote:
> Hi All,
> A need has been identified for MXNet’s CI/CD setup to move away from the
> Apache Jenkins Service. Over the past few days there has been active
> discussion on the necessary and advanced features for such a system and the
> various options available. These are being tracked in this Google Doc
> <https://docs.google.com/document/d/17PEasQ2VWrXi2Cf7IGZSWGZMawxDkdlavUDASzUmLjk/edit> (and
> are also in the pdf attached).
>
> I would like to start a vote to choose the framework for this new CI/CD
> system. The options are -
> [1] Jenkins (A setup separated from Apache Jenkins) - with various plugins
> [2] TeamCity
> [3] Travis CI
> [4] GitLabCI
> [5] BuildBot
> [6] Other - Please Name
>
> Please feel free to add a comment to support your choice.
> This vote will be open from now until the end of the day on Monday
> 11/13/2017
>
> Thanks,
> Meghna Baijal
>
>
>
Re: [VOTE] A Separate CI System for Apache MXNet (incubating)
Posted by Sebastian <ss...@googlemail.com>.
+1 for 1) (binding)
On 10.11.2017 10:30, kellen sunderland wrote:
> +1 for 1 (non-binding)
>
> On Fri, Nov 10, 2017 at 6:37 AM, Chris Olivier <cj...@gmail.com>
> wrote:
>
>> +1 for 1) — Jenkins
>>
>>
>> On Thu, Nov 9, 2017 at 9:14 PM Naveen Swamy <mn...@gmail.com> wrote:
>>
>>> +1 on 1)
>>>
>>>> On Nov 9, 2017, at 8:59 PM, Steffen Rochel <st...@gmail.com>
>>> wrote:
>>>>
>>>> voting for [1]
>>>> We will need to setup testing on MAC. I will explore for AWS to cover
>> the
>>>> costs.
>>>> Steffen
>>>>
>>>> On Thu, Nov 9, 2017 at 4:41 PM Meghna Baijal <
>> meghnabaijal2017@gmail.com
>>>>
>>>> wrote:
>>>>
>>>>> Hi All,
>>>>> A need has been identified for MXNet’s CI/CD setup to move away from
>> the
>>>>> Apache Jenkins Service. Over the past few days there has been active
>>>>> discussion on the necessary and advanced features for such a system
>> and
>>> the
>>>>> various options available. These are being tracked in this Google Doc
>>>>> <
>>> https://docs.google.com/document/d/17PEasQ2VWrXi2Cf7IGZSWGZMawxDk
>> dlavUDASzUmLjk/edit>
>>> (and
>>>>> are also in the pdf attached).
>>>>>
>>>>> I would like to start a vote to choose the framework for this new
>> CI/CD
>>>>> system. The options are -
>>>>> [1] Jenkins (A setup separated from Apache Jenkins) - with various
>>> plugins
>>>>> [2] TeamCity
>>>>> [3] Travis CI
>>>>> [4] GitLabCI
>>>>> [5] BuildBot
>>>>> [6] Other - Please Name
>>>>>
>>>>> Please feel free to add a comment to support your choice.
>>>>> This vote will be open from now until the end of the day on Monday
>>>>> 11/13/2017
>>>>>
>>>>> Thanks,
>>>>> Meghna Baijal
>>>>>
>>>>>
>>>>>
>>>
>>
>
Re: [VOTE] A Separate CI System for Apache MXNet (incubating)
Posted by kellen sunderland <ke...@gmail.com>.
+1 for 1 (non-binding)
On Fri, Nov 10, 2017 at 6:37 AM, Chris Olivier <cj...@gmail.com>
wrote:
> +1 for 1) — Jenkins
>
>
> On Thu, Nov 9, 2017 at 9:14 PM Naveen Swamy <mn...@gmail.com> wrote:
>
> > +1 on 1)
> >
> > > On Nov 9, 2017, at 8:59 PM, Steffen Rochel <st...@gmail.com>
> > wrote:
> > >
> > > voting for [1]
> > > We will need to setup testing on MAC. I will explore for AWS to cover
> the
> > > costs.
> > > Steffen
> > >
> > > On Thu, Nov 9, 2017 at 4:41 PM Meghna Baijal <
> meghnabaijal2017@gmail.com
> > >
> > > wrote:
> > >
> > >> Hi All,
> > >> A need has been identified for MXNet’s CI/CD setup to move away from
> the
> > >> Apache Jenkins Service. Over the past few days there has been active
> > >> discussion on the necessary and advanced features for such a system
> and
> > the
> > >> various options available. These are being tracked in this Google Doc
> > >> <
> > https://docs.google.com/document/d/17PEasQ2VWrXi2Cf7IGZSWGZMawxDk
> dlavUDASzUmLjk/edit>
> > (and
> > >> are also in the pdf attached).
> > >>
> > >> I would like to start a vote to choose the framework for this new
> CI/CD
> > >> system. The options are -
> > >> [1] Jenkins (A setup separated from Apache Jenkins) - with various
> > plugins
> > >> [2] TeamCity
> > >> [3] Travis CI
> > >> [4] GitLabCI
> > >> [5] BuildBot
> > >> [6] Other - Please Name
> > >>
> > >> Please feel free to add a comment to support your choice.
> > >> This vote will be open from now until the end of the day on Monday
> > >> 11/13/2017
> > >>
> > >> Thanks,
> > >> Meghna Baijal
> > >>
> > >>
> > >>
> >
>
Re: [VOTE] A Separate CI System for Apache MXNet (incubating)
Posted by Chris Olivier <cj...@gmail.com>.
+1 for 1) — Jenkins
On Thu, Nov 9, 2017 at 9:14 PM Naveen Swamy <mn...@gmail.com> wrote:
> +1 on 1)
>
> > On Nov 9, 2017, at 8:59 PM, Steffen Rochel <st...@gmail.com>
> wrote:
> >
> > voting for [1]
> > We will need to setup testing on MAC. I will explore for AWS to cover the
> > costs.
> > Steffen
> >
> > On Thu, Nov 9, 2017 at 4:41 PM Meghna Baijal <meghnabaijal2017@gmail.com
> >
> > wrote:
> >
> >> Hi All,
> >> A need has been identified for MXNet’s CI/CD setup to move away from the
> >> Apache Jenkins Service. Over the past few days there has been active
> >> discussion on the necessary and advanced features for such a system and
> the
> >> various options available. These are being tracked in this Google Doc
> >> <
> https://docs.google.com/document/d/17PEasQ2VWrXi2Cf7IGZSWGZMawxDkdlavUDASzUmLjk/edit>
> (and
> >> are also in the pdf attached).
> >>
> >> I would like to start a vote to choose the framework for this new CI/CD
> >> system. The options are -
> >> [1] Jenkins (A setup separated from Apache Jenkins) - with various
> plugins
> >> [2] TeamCity
> >> [3] Travis CI
> >> [4] GitLabCI
> >> [5] BuildBot
> >> [6] Other - Please Name
> >>
> >> Please feel free to add a comment to support your choice.
> >> This vote will be open from now until the end of the day on Monday
> >> 11/13/2017
> >>
> >> Thanks,
> >> Meghna Baijal
> >>
> >>
> >>
>
Re: [VOTE] A Separate CI System for Apache MXNet (incubating)
Posted by Naveen Swamy <mn...@gmail.com>.
+1 on 1)
> On Nov 9, 2017, at 8:59 PM, Steffen Rochel <st...@gmail.com> wrote:
>
> voting for [1]
> We will need to setup testing on MAC. I will explore for AWS to cover the
> costs.
> Steffen
>
> On Thu, Nov 9, 2017 at 4:41 PM Meghna Baijal <me...@gmail.com>
> wrote:
>
>> Hi All,
>> A need has been identified for MXNet’s CI/CD setup to move away from the
>> Apache Jenkins Service. Over the past few days there has been active
>> discussion on the necessary and advanced features for such a system and the
>> various options available. These are being tracked in this Google Doc
>> <https://docs.google.com/document/d/17PEasQ2VWrXi2Cf7IGZSWGZMawxDkdlavUDASzUmLjk/edit> (and
>> are also in the pdf attached).
>>
>> I would like to start a vote to choose the framework for this new CI/CD
>> system. The options are -
>> [1] Jenkins (A setup separated from Apache Jenkins) - with various plugins
>> [2] TeamCity
>> [3] Travis CI
>> [4] GitLabCI
>> [5] BuildBot
>> [6] Other - Please Name
>>
>> Please feel free to add a comment to support your choice.
>> This vote will be open from now until the end of the day on Monday
>> 11/13/2017
>>
>> Thanks,
>> Meghna Baijal
>>
>>
>>
Re: [VOTE] A Separate CI System for Apache MXNet (incubating)
Posted by Steffen Rochel <st...@gmail.com>.
voting for [1]
We will need to setup testing on MAC. I will explore for AWS to cover the
costs.
Steffen
On Thu, Nov 9, 2017 at 4:41 PM Meghna Baijal <me...@gmail.com>
wrote:
> Hi All,
> A need has been identified for MXNet’s CI/CD setup to move away from the
> Apache Jenkins Service. Over the past few days there has been active
> discussion on the necessary and advanced features for such a system and the
> various options available. These are being tracked in this Google Doc
> <https://docs.google.com/document/d/17PEasQ2VWrXi2Cf7IGZSWGZMawxDkdlavUDASzUmLjk/edit> (and
> are also in the pdf attached).
>
> I would like to start a vote to choose the framework for this new CI/CD
> system. The options are -
> [1] Jenkins (A setup separated from Apache Jenkins) - with various plugins
> [2] TeamCity
> [3] Travis CI
> [4] GitLabCI
> [5] BuildBot
> [6] Other - Please Name
>
> Please feel free to add a comment to support your choice.
> This vote will be open from now until the end of the day on Monday
> 11/13/2017
>
> Thanks,
> Meghna Baijal
>
>
>