You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@cloudstack.apache.org by Abhinandan Prateek <ab...@shapeblue.com> on 2015/05/01 04:55:35 UTC

Re: marvin test cases + travis

+1 for increased timeouts.

At the moment we get less than 24 commits per day on master. Only a couple on other branches per day.
We can increase the timeout to upto 70 minutes or more. Will try to ensure that in general a single run does not take more than an hour.

A timeout window slightly higher will ensure that we do not see timeout failures.

> On 30-Apr-2015, at 11:25 pm, Daan Hoogland <da...@gmail.com> wrote:
>
> Travis is starting to indue the, 'oh,  a timeout again' - blindness in me.
> Let's put a safe time on it.  A result should mean something and those time
> out are like the (decreasing) abundance of Jenkins failures.
>
> So +1 for increasing the time
>
> On Thu, 30 Apr 2015 18:46 Ian Duffy <ia...@ianduffy.ie> wrote:
>
>>> Do we need to ask for an increase in run time?
>>
>> From my experience I wouldn't say its required however *it would be very
>> nice*.
>> At the moment what we do is create new parallel jobs and balance the
>> tests across them so each job is under 50mins.
>>
>> Anywho, just my 2c, see what others say/think.
>>
>> On 30 April 2015 at 17:34, David Nalley <da...@gnsa.us> wrote:
>>> Do we need to ask for an increase in run time?
>>> 50 minutes is the OSS default, but the ASF is a paying customer and we
>>> can ask for longer timeouts.
>>>
>>> --David
>>>
>>> On Thu, Apr 30, 2015 at 10:06 AM, Abhinandan Prateek
>>> <ab...@shapeblue.com> wrote:
>>>> One of the run did timeout. Will balance the runs.
>>>>
>>>>> On 30-Apr-2015, at 5:59 pm, Abhinandan Prateek <
>> abhinandan.prateek@shapeblue.com> wrote:
>>>>>
>>>>> Yes, thanks for checking. I was worried that now some of them may
>> start timing out.
>>>>> I have another 10 suites tested, will add them once everything seems
>> fine.
>>>>>
>>>>> -abhi
>>>>>
>>>>>
>>>>>> On 30-Apr-2015, at 5:32 pm, Rajani Karuturi <ra...@apache.org>
>> wrote:
>>>>>>
>>>>>> after correcting the test file path, its working fine
>>>>>>
>>>>>> https://travis-ci.org/karuturi/cloudstack/jobs/60681263
>>>>>>
>>>>>>
>>>>>>
>>>>>> ~Rajani
>>>>>>
>>>>>> On Thu, Apr 30, 2015 at 4:51 PM, Rajani Karuturi <ra...@apache.org>
>> wrote:
>>>>>>
>>>>>>> I think its due to this commit
>>>>>>>
>>>>>>>
>> https://github.com/apache/cloudstack/commit/b941480e0df0bfa3377e797126b96cf9b3fbee77
>>>>>>>
>>>>>>> Here, test file name is changed from testname to
>> [smoke,component]/testname
>>>>>>>
>>>>>>> But, while running each test file in the for loop, it prepends the
>> name
>>>>>>> with smoke and hence, it cant find the file and none of the tests in
>> the
>>>>>>> file are run
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> ~Rajani
>>>>>>>
>>>>>>> On Thu, Apr 30, 2015 at 4:37 PM, Abhinandan Prateek <
>>>>>>> abhinandan.prateek@shapeblue.com> wrote:
>>>>>>>
>>>>>>>> It is possible, I will check.
>>>>>>>>
>>>>>>>>> On 30-Apr-2015, at 3:43 pm, Rajani Karuturi <ra...@apache.org>
>> wrote:
>>>>>>>>>
>>>>>>>>> Hey Abhi,
>>>>>>>>>
>>>>>>>>> In the recent travis runs, its not printing the test case in
>> output (
>>>>>>>>> https://travis-ci.org/apache/cloudstack/jobs/60634577#L5443)
>>>>>>>>>
>>>>>>>>> It used to print the test case name and status (
>>>>>>>>> https://travis-ci.org/apache/cloudstack/jobs/59958134#L4205)
>>>>>>>>>
>>>>>>>>> Do you think it can be due to any recent changes?
>>>>>>>>>
>>>>>>>>> ~Rajani
>>>>>>>>>
>>>>>>>>> On Thu, Apr 30, 2015 at 10:32 AM, Abhinandan Prateek <
>>>>>>>>> abhinandan.prateek@shapeblue.com> wrote:
>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> There are more than 10 additional suites that can still be
>> included
>>>>>>>> to
>>>>>>>>>> the travis-CI.
>>>>>>>>>> Since the current set runs comfortably I will go ahead and add
>> more. If
>>>>>>>>>> the system gets overloaded, then we can balance the kind of test
>>>>>>>> suites and
>>>>>>>>>> amount of test suits that run comfortably on travis.
>>>>>>>>>>
>>>>>>>>>> -abhi
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Find out more about ShapeBlue and our range of CloudStack related
>>>>>>>> services
>>>>>>>>>>
>>>>>>>>>> IaaS Cloud Design & Build<
>>>>>>>>>> http://shapeblue.com/iaas-cloud-design-and-build//>
>>>>>>>>>> CSForge – rapid IaaS deployment framework<
>>>>>>>> http://shapeblue.com/csforge/>
>>>>>>>>>> CloudStack Consulting<
>> http://shapeblue.com/cloudstack-consultancy/>
>>>>>>>>>> CloudStack Software Engineering<
>>>>>>>>>> http://shapeblue.com/cloudstack-software-engineering/>
>>>>>>>>>> CloudStack Infrastructure Support<
>>>>>>>>>> http://shapeblue.com/cloudstack-infrastructure-support/>
>>>>>>>>>> CloudStack Bootcamp Training Courses<
>>>>>>>>>> http://shapeblue.com/cloudstack-training/>
>>>>>>>>>>
>>>>>>>>>> This email and any attachments to it may be confidential and are
>>>>>>>> intended
>>>>>>>>>> solely for the use of the individual to whom it is addressed. Any
>>>>>>>> views or
>>>>>>>>>> opinions expressed are solely those of the author and do not
>>>>>>>> necessarily
>>>>>>>>>> represent those of Shape Blue Ltd or related companies. If you
>> are not
>>>>>>>> the
>>>>>>>>>> intended recipient of this email, you must neither take any action
>>>>>>>> based
>>>>>>>>>> upon its contents, nor copy or show it to anyone. Please contact
>> the
>>>>>>>> sender
>>>>>>>>>> if you believe you have received this email in error. Shape Blue
>> Ltd
>>>>>>>> is a
>>>>>>>>>> company incorporated in England & Wales. ShapeBlue Services India
>> LLP
>>>>>>>> is a
>>>>>>>>>> company incorporated in India and is operated under license from
>> Shape
>>>>>>>> Blue
>>>>>>>>>> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated
>> in
>>>>>>>> Brasil
>>>>>>>>>> and is operated under license from Shape Blue Ltd. ShapeBlue SA
>> Pty
>>>>>>>> Ltd is
>>>>>>>>>> a company registered by The Republic of South Africa and is traded
>>>>>>>> under
>>>>>>>>>> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>>>>>>>>>>
>>>>>>>>
>>>>>>>> Find out more about ShapeBlue and our range of CloudStack related
>> services
>>>>>>>>
>>>>>>>> IaaS Cloud Design & Build<
>>>>>>>> http://shapeblue.com/iaas-cloud-design-and-build//>
>>>>>>>> CSForge – rapid IaaS deployment framework<
>> http://shapeblue.com/csforge/>
>>>>>>>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>>>>>>>> CloudStack Software Engineering<
>>>>>>>> http://shapeblue.com/cloudstack-software-engineering/>
>>>>>>>> CloudStack Infrastructure Support<
>>>>>>>> http://shapeblue.com/cloudstack-infrastructure-support/>
>>>>>>>> CloudStack Bootcamp Training Courses<
>>>>>>>> http://shapeblue.com/cloudstack-training/>
>>>>>>>>
>>>>>>>> This email and any attachments to it may be confidential and are
>> intended
>>>>>>>> solely for the use of the individual to whom it is addressed. Any
>> views or
>>>>>>>> opinions expressed are solely those of the author and do not
>> necessarily
>>>>>>>> represent those of Shape Blue Ltd or related companies. If you are
>> not the
>>>>>>>> intended recipient of this email, you must neither take any action
>> based
>>>>>>>> upon its contents, nor copy or show it to anyone. Please contact
>> the sender
>>>>>>>> if you believe you have received this email in error. Shape Blue
>> Ltd is a
>>>>>>>> company incorporated in England & Wales. ShapeBlue Services India
>> LLP is a
>>>>>>>> company incorporated in India and is operated under license from
>> Shape Blue
>>>>>>>> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated
>> in Brasil
>>>>>>>> and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty
>> Ltd is
>>>>>>>> a company registered by The Republic of South Africa and is traded
>> under
>>>>>>>> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>
>>>>> Find out more about ShapeBlue and our range of CloudStack related
>> services
>>>>>
>>>>> IaaS Cloud Design & Build<
>> http://shapeblue.com/iaas-cloud-design-and-build//>
>>>>> CSForge – rapid IaaS deployment framework<
>> http://shapeblue.com/csforge/>
>>>>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>>>>> CloudStack Software Engineering<
>> http://shapeblue.com/cloudstack-software-engineering/>
>>>>> CloudStack Infrastructure Support<
>> http://shapeblue.com/cloudstack-infrastructure-support/>
>>>>> CloudStack Bootcamp Training Courses<
>> http://shapeblue.com/cloudstack-training/>
>>>>>
>>>>> This email and any attachments to it may be confidential and are
>> intended solely for the use of the individual to whom it is addressed. Any
>> views or opinions expressed are solely those of the author and do not
>> necessarily represent those of Shape Blue Ltd or related companies. If you
>> are not the intended recipient of this email, you must neither take any
>> action based upon its contents, nor copy or show it to anyone. Please
>> contact the sender if you believe you have received this email in error.
>> Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue
>> Services India LLP is a company incorporated in India and is operated under
>> license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a
>> company incorporated in Brasil and is operated under license from Shape
>> Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of
>> South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is
>> a registered trademark.
>>>>
>>>> Find out more about ShapeBlue and our range of CloudStack related
>> services
>>>>
>>>> IaaS Cloud Design & Build<
>> http://shapeblue.com/iaas-cloud-design-and-build//>
>>>> CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/
>>>
>>>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>>>> CloudStack Software Engineering<
>> http://shapeblue.com/cloudstack-software-engineering/>
>>>> CloudStack Infrastructure Support<
>> http://shapeblue.com/cloudstack-infrastructure-support/>
>>>> CloudStack Bootcamp Training Courses<
>> http://shapeblue.com/cloudstack-training/>
>>>>
>>>> This email and any attachments to it may be confidential and are
>> intended solely for the use of the individual to whom it is addressed. Any
>> views or opinions expressed are solely those of the author and do not
>> necessarily represent those of Shape Blue Ltd or related companies. If you
>> are not the intended recipient of this email, you must neither take any
>> action based upon its contents, nor copy or show it to anyone. Please
>> contact the sender if you believe you have received this email in error.
>> Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue
>> Services India LLP is a company incorporated in India and is operated under
>> license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a
>> company incorporated in Brasil and is operated under license from Shape
>> Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of
>> South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is
>> a registered trademark.
>>

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>

This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: marvin test cases + travis

Posted by Rajani Karuturi <ra...@apache.org>.
At the moment we are creating 10 parallel jobs and in each job we do
1. mvn clean install
2. deploydb, deploy datacenter
3. run tests

if we change step 1 to mvn clean install -DskipTests=true and run junit
tests only in one job, that would save time.

Also, with earlier 5 jobs setup, it used to run fine on my private fork.
Now, it takes double the time(as it runs only 5 parallel jobs) and usually
timesout




~Rajani

On Fri, May 1, 2015 at 8:25 AM, Abhinandan Prateek <
abhinandan.prateek@shapeblue.com> wrote:

> +1 for increased timeouts.
>
> At the moment we get less than 24 commits per day on master. Only a couple
> on other branches per day.
> We can increase the timeout to upto 70 minutes or more. Will try to ensure
> that in general a single run does not take more than an hour.
>
> A timeout window slightly higher will ensure that we do not see timeout
> failures.
>
> > On 30-Apr-2015, at 11:25 pm, Daan Hoogland <da...@gmail.com>
> wrote:
> >
> > Travis is starting to indue the, 'oh,  a timeout again' - blindness in
> me.
> > Let's put a safe time on it.  A result should mean something and those
> time
> > out are like the (decreasing) abundance of Jenkins failures.
> >
> > So +1 for increasing the time
> >
> > On Thu, 30 Apr 2015 18:46 Ian Duffy <ia...@ianduffy.ie> wrote:
> >
> >>> Do we need to ask for an increase in run time?
> >>
> >> From my experience I wouldn't say its required however *it would be very
> >> nice*.
> >> At the moment what we do is create new parallel jobs and balance the
> >> tests across them so each job is under 50mins.
> >>
> >> Anywho, just my 2c, see what others say/think.
> >>
> >> On 30 April 2015 at 17:34, David Nalley <da...@gnsa.us> wrote:
> >>> Do we need to ask for an increase in run time?
> >>> 50 minutes is the OSS default, but the ASF is a paying customer and we
> >>> can ask for longer timeouts.
> >>>
> >>> --David
> >>>
> >>> On Thu, Apr 30, 2015 at 10:06 AM, Abhinandan Prateek
> >>> <ab...@shapeblue.com> wrote:
> >>>> One of the run did timeout. Will balance the runs.
> >>>>
> >>>>> On 30-Apr-2015, at 5:59 pm, Abhinandan Prateek <
> >> abhinandan.prateek@shapeblue.com> wrote:
> >>>>>
> >>>>> Yes, thanks for checking. I was worried that now some of them may
> >> start timing out.
> >>>>> I have another 10 suites tested, will add them once everything seems
> >> fine.
> >>>>>
> >>>>> -abhi
> >>>>>
> >>>>>
> >>>>>> On 30-Apr-2015, at 5:32 pm, Rajani Karuturi <ra...@apache.org>
> >> wrote:
> >>>>>>
> >>>>>> after correcting the test file path, its working fine
> >>>>>>
> >>>>>> https://travis-ci.org/karuturi/cloudstack/jobs/60681263
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>> ~Rajani
> >>>>>>
> >>>>>> On Thu, Apr 30, 2015 at 4:51 PM, Rajani Karuturi <rajani@apache.org
> >
> >> wrote:
> >>>>>>
> >>>>>>> I think its due to this commit
> >>>>>>>
> >>>>>>>
> >>
> https://github.com/apache/cloudstack/commit/b941480e0df0bfa3377e797126b96cf9b3fbee77
> >>>>>>>
> >>>>>>> Here, test file name is changed from testname to
> >> [smoke,component]/testname
> >>>>>>>
> >>>>>>> But, while running each test file in the for loop, it prepends the
> >> name
> >>>>>>> with smoke and hence, it cant find the file and none of the tests
> in
> >> the
> >>>>>>> file are run
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>> ~Rajani
> >>>>>>>
> >>>>>>> On Thu, Apr 30, 2015 at 4:37 PM, Abhinandan Prateek <
> >>>>>>> abhinandan.prateek@shapeblue.com> wrote:
> >>>>>>>
> >>>>>>>> It is possible, I will check.
> >>>>>>>>
> >>>>>>>>> On 30-Apr-2015, at 3:43 pm, Rajani Karuturi <ra...@apache.org>
> >> wrote:
> >>>>>>>>>
> >>>>>>>>> Hey Abhi,
> >>>>>>>>>
> >>>>>>>>> In the recent travis runs, its not printing the test case in
> >> output (
> >>>>>>>>> https://travis-ci.org/apache/cloudstack/jobs/60634577#L5443)
> >>>>>>>>>
> >>>>>>>>> It used to print the test case name and status (
> >>>>>>>>> https://travis-ci.org/apache/cloudstack/jobs/59958134#L4205)
> >>>>>>>>>
> >>>>>>>>> Do you think it can be due to any recent changes?
> >>>>>>>>>
> >>>>>>>>> ~Rajani
> >>>>>>>>>
> >>>>>>>>> On Thu, Apr 30, 2015 at 10:32 AM, Abhinandan Prateek <
> >>>>>>>>> abhinandan.prateek@shapeblue.com> wrote:
> >>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> There are more than 10 additional suites that can still be
> >> included
> >>>>>>>> to
> >>>>>>>>>> the travis-CI.
> >>>>>>>>>> Since the current set runs comfortably I will go ahead and add
> >> more. If
> >>>>>>>>>> the system gets overloaded, then we can balance the kind of test
> >>>>>>>> suites and
> >>>>>>>>>> amount of test suits that run comfortably on travis.
> >>>>>>>>>>
> >>>>>>>>>> -abhi
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> Find out more about ShapeBlue and our range of CloudStack
> related
> >>>>>>>> services
> >>>>>>>>>>
> >>>>>>>>>> IaaS Cloud Design & Build<
> >>>>>>>>>> http://shapeblue.com/iaas-cloud-design-and-build//>
> >>>>>>>>>> CSForge – rapid IaaS deployment framework<
> >>>>>>>> http://shapeblue.com/csforge/>
> >>>>>>>>>> CloudStack Consulting<
> >> http://shapeblue.com/cloudstack-consultancy/>
> >>>>>>>>>> CloudStack Software Engineering<
> >>>>>>>>>> http://shapeblue.com/cloudstack-software-engineering/>
> >>>>>>>>>> CloudStack Infrastructure Support<
> >>>>>>>>>> http://shapeblue.com/cloudstack-infrastructure-support/>
> >>>>>>>>>> CloudStack Bootcamp Training Courses<
> >>>>>>>>>> http://shapeblue.com/cloudstack-training/>
> >>>>>>>>>>
> >>>>>>>>>> This email and any attachments to it may be confidential and are
> >>>>>>>> intended
> >>>>>>>>>> solely for the use of the individual to whom it is addressed.
> Any
> >>>>>>>> views or
> >>>>>>>>>> opinions expressed are solely those of the author and do not
> >>>>>>>> necessarily
> >>>>>>>>>> represent those of Shape Blue Ltd or related companies. If you
> >> are not
> >>>>>>>> the
> >>>>>>>>>> intended recipient of this email, you must neither take any
> action
> >>>>>>>> based
> >>>>>>>>>> upon its contents, nor copy or show it to anyone. Please contact
> >> the
> >>>>>>>> sender
> >>>>>>>>>> if you believe you have received this email in error. Shape Blue
> >> Ltd
> >>>>>>>> is a
> >>>>>>>>>> company incorporated in England & Wales. ShapeBlue Services
> India
> >> LLP
> >>>>>>>> is a
> >>>>>>>>>> company incorporated in India and is operated under license from
> >> Shape
> >>>>>>>> Blue
> >>>>>>>>>> Ltd. Shape Blue Brasil Consultoria Ltda is a company
> incorporated
> >> in
> >>>>>>>> Brasil
> >>>>>>>>>> and is operated under license from Shape Blue Ltd. ShapeBlue SA
> >> Pty
> >>>>>>>> Ltd is
> >>>>>>>>>> a company registered by The Republic of South Africa and is
> traded
> >>>>>>>> under
> >>>>>>>>>> license from Shape Blue Ltd. ShapeBlue is a registered
> trademark.
> >>>>>>>>>>
> >>>>>>>>
> >>>>>>>> Find out more about ShapeBlue and our range of CloudStack related
> >> services
> >>>>>>>>
> >>>>>>>> IaaS Cloud Design & Build<
> >>>>>>>> http://shapeblue.com/iaas-cloud-design-and-build//>
> >>>>>>>> CSForge – rapid IaaS deployment framework<
> >> http://shapeblue.com/csforge/>
> >>>>>>>> CloudStack Consulting<
> http://shapeblue.com/cloudstack-consultancy/>
> >>>>>>>> CloudStack Software Engineering<
> >>>>>>>> http://shapeblue.com/cloudstack-software-engineering/>
> >>>>>>>> CloudStack Infrastructure Support<
> >>>>>>>> http://shapeblue.com/cloudstack-infrastructure-support/>
> >>>>>>>> CloudStack Bootcamp Training Courses<
> >>>>>>>> http://shapeblue.com/cloudstack-training/>
> >>>>>>>>
> >>>>>>>> This email and any attachments to it may be confidential and are
> >> intended
> >>>>>>>> solely for the use of the individual to whom it is addressed. Any
> >> views or
> >>>>>>>> opinions expressed are solely those of the author and do not
> >> necessarily
> >>>>>>>> represent those of Shape Blue Ltd or related companies. If you are
> >> not the
> >>>>>>>> intended recipient of this email, you must neither take any action
> >> based
> >>>>>>>> upon its contents, nor copy or show it to anyone. Please contact
> >> the sender
> >>>>>>>> if you believe you have received this email in error. Shape Blue
> >> Ltd is a
> >>>>>>>> company incorporated in England & Wales. ShapeBlue Services India
> >> LLP is a
> >>>>>>>> company incorporated in India and is operated under license from
> >> Shape Blue
> >>>>>>>> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated
> >> in Brasil
> >>>>>>>> and is operated under license from Shape Blue Ltd. ShapeBlue SA
> Pty
> >> Ltd is
> >>>>>>>> a company registered by The Republic of South Africa and is traded
> >> under
> >>>>>>>> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
> >>>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>
> >>>>> Find out more about ShapeBlue and our range of CloudStack related
> >> services
> >>>>>
> >>>>> IaaS Cloud Design & Build<
> >> http://shapeblue.com/iaas-cloud-design-and-build//>
> >>>>> CSForge – rapid IaaS deployment framework<
> >> http://shapeblue.com/csforge/>
> >>>>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> >>>>> CloudStack Software Engineering<
> >> http://shapeblue.com/cloudstack-software-engineering/>
> >>>>> CloudStack Infrastructure Support<
> >> http://shapeblue.com/cloudstack-infrastructure-support/>
> >>>>> CloudStack Bootcamp Training Courses<
> >> http://shapeblue.com/cloudstack-training/>
> >>>>>
> >>>>> This email and any attachments to it may be confidential and are
> >> intended solely for the use of the individual to whom it is addressed.
> Any
> >> views or opinions expressed are solely those of the author and do not
> >> necessarily represent those of Shape Blue Ltd or related companies. If
> you
> >> are not the intended recipient of this email, you must neither take any
> >> action based upon its contents, nor copy or show it to anyone. Please
> >> contact the sender if you believe you have received this email in error.
> >> Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue
> >> Services India LLP is a company incorporated in India and is operated
> under
> >> license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a
> >> company incorporated in Brasil and is operated under license from Shape
> >> Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic
> of
> >> South Africa and is traded under license from Shape Blue Ltd. ShapeBlue
> is
> >> a registered trademark.
> >>>>
> >>>> Find out more about ShapeBlue and our range of CloudStack related
> >> services
> >>>>
> >>>> IaaS Cloud Design & Build<
> >> http://shapeblue.com/iaas-cloud-design-and-build//>
> >>>> CSForge – rapid IaaS deployment framework<
> http://shapeblue.com/csforge/
> >>>
> >>>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> >>>> CloudStack Software Engineering<
> >> http://shapeblue.com/cloudstack-software-engineering/>
> >>>> CloudStack Infrastructure Support<
> >> http://shapeblue.com/cloudstack-infrastructure-support/>
> >>>> CloudStack Bootcamp Training Courses<
> >> http://shapeblue.com/cloudstack-training/>
> >>>>
> >>>> This email and any attachments to it may be confidential and are
> >> intended solely for the use of the individual to whom it is addressed.
> Any
> >> views or opinions expressed are solely those of the author and do not
> >> necessarily represent those of Shape Blue Ltd or related companies. If
> you
> >> are not the intended recipient of this email, you must neither take any
> >> action based upon its contents, nor copy or show it to anyone. Please
> >> contact the sender if you believe you have received this email in error.
> >> Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue
> >> Services India LLP is a company incorporated in India and is operated
> under
> >> license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a
> >> company incorporated in Brasil and is operated under license from Shape
> >> Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic
> of
> >> South Africa and is traded under license from Shape Blue Ltd. ShapeBlue
> is
> >> a registered trademark.
> >>
>
> Find out more about ShapeBlue and our range of CloudStack related services
>
> IaaS Cloud Design & Build<
> http://shapeblue.com/iaas-cloud-design-and-build//>
> CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> CloudStack Software Engineering<
> http://shapeblue.com/cloudstack-software-engineering/>
> CloudStack Infrastructure Support<
> http://shapeblue.com/cloudstack-infrastructure-support/>
> CloudStack Bootcamp Training Courses<
> http://shapeblue.com/cloudstack-training/>
>
> This email and any attachments to it may be confidential and are intended
> solely for the use of the individual to whom it is addressed. Any views or
> opinions expressed are solely those of the author and do not necessarily
> represent those of Shape Blue Ltd or related companies. If you are not the
> intended recipient of this email, you must neither take any action based
> upon its contents, nor copy or show it to anyone. Please contact the sender
> if you believe you have received this email in error. Shape Blue Ltd is a
> company incorporated in England & Wales. ShapeBlue Services India LLP is a
> company incorporated in India and is operated under license from Shape Blue
> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil
> and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is
> a company registered by The Republic of South Africa and is traded under
> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>

Re: marvin test cases + travis

Posted by Rohit Yadav <ro...@shapeblue.com>.
Hi Rajani,

> On 01-May-2015, at 7:39 pm, Rajani Karuturi <ra...@apache.org> wrote:
>
> -1 on increasing the time
> As a reviewer, I would like an immediate response on a pull request. By the
> time I review the code, if CI gives a +1(or -1) I can close the PR then and
> there instead of coming back again to merge.

I understand your sentiments but the issue was to increase the TravisCI job timeout. We can continue to optimize tests and build processes to decrease the round trip time.

> I would suggest running all the jobs under 30 min and increasing the number
> of parallel jobs as much as possible. we are running 10 jobs now. may be we
> could increase this to 15(dont know if this is possible)

A typical build on TravisCI is observed to take anywhere from 15-25 mins. That would only leave 5-15 mins for smoke tests to run, so we will have to aim to create jobs assuming the minimum available time window (5mins). Skipping unit tests could introduce regressions

> we should aim to run only the smoke tests and not the entire regression
> suite always.
>
> Making the jobs run on containers will speed them up. This needs some work
> on removing the sudo dependency on the jobs (which is required to install
> some additional packages and marvin).

Agree. But to do that we’ll have to figure out any other way to do the following;
- install, setup mysql-server, tomcat, uuid-runtime genisoimage python-setuptools python-pip
- pip installs
- install marvin

Regards,
Rohit Yadav
Software Architect, ShapeBlue
M. +91 88 262 30892 | rohit.yadav@shapeblue.com
Blog: bhaisaab.org | Twitter: @_bhaisaab

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>

This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: marvin test cases + travis

Posted by Abhinandan Prateek <ab...@shapeblue.com>.
I think it is a choice between fast response Vs more accurate response. I will rather wait for additional 20 minutes to get a better response.
With the commit rate we have that should not overload the system.
Yes we should definitely look for quality and coverage of the tests picked then the number.

> On 01-May-2015, at 11:09 pm, Rajani Karuturi <ra...@apache.org> wrote:
>
> -1 on increasing the time
> As a reviewer, I would like an immediate response on a pull request. By the
> time I review the code, if CI gives a +1(or -1) I can close the PR then and
> there instead of coming back again to merge.
>
> I would suggest running all the jobs under 30 min and increasing the number
> of parallel jobs as much as possible. we are running 10 jobs now. may be we
> could increase this to 15(dont know if this is possible)
>
> we should aim to run only the smoke tests and not the entire regression
> suite always.
>
> Making the jobs run on containers will speed them up. This needs some work
> on removing the sudo dependency on the jobs (which is required to install
> some additional packages and marvin).
>
> ~Rajani
>
> On Fri, May 1, 2015 at 8:25 AM, Abhinandan Prateek <
> abhinandan.prateek@shapeblue.com> wrote:
>
>> +1 for increased timeouts.
>>
>> At the moment we get less than 24 commits per day on master. Only a couple
>> on other branches per day.
>> We can increase the timeout to upto 70 minutes or more. Will try to ensure
>> that in general a single run does not take more than an hour.
>>
>> A timeout window slightly higher will ensure that we do not see timeout
>> failures.
>>
>>> On 30-Apr-2015, at 11:25 pm, Daan Hoogland <da...@gmail.com>
>> wrote:
>>>
>>> Travis is starting to indue the, 'oh,  a timeout again' - blindness in
>> me.
>>> Let's put a safe time on it.  A result should mean something and those
>> time
>>> out are like the (decreasing) abundance of Jenkins failures.
>>>
>>> So +1 for increasing the time
>>>
>>> On Thu, 30 Apr 2015 18:46 Ian Duffy <ia...@ianduffy.ie> wrote:
>>>
>>>>> Do we need to ask for an increase in run time?
>>>>
>>>> From my experience I wouldn't say its required however *it would be very
>>>> nice*.
>>>> At the moment what we do is create new parallel jobs and balance the
>>>> tests across them so each job is under 50mins.
>>>>
>>>> Anywho, just my 2c, see what others say/think.
>>>>
>>>> On 30 April 2015 at 17:34, David Nalley <da...@gnsa.us> wrote:
>>>>> Do we need to ask for an increase in run time?
>>>>> 50 minutes is the OSS default, but the ASF is a paying customer and we
>>>>> can ask for longer timeouts.
>>>>>
>>>>> --David
>>>>>
>>>>> On Thu, Apr 30, 2015 at 10:06 AM, Abhinandan Prateek
>>>>> <ab...@shapeblue.com> wrote:
>>>>>> One of the run did timeout. Will balance the runs.
>>>>>>
>>>>>>> On 30-Apr-2015, at 5:59 pm, Abhinandan Prateek <
>>>> abhinandan.prateek@shapeblue.com> wrote:
>>>>>>>
>>>>>>> Yes, thanks for checking. I was worried that now some of them may
>>>> start timing out.
>>>>>>> I have another 10 suites tested, will add them once everything seems
>>>> fine.
>>>>>>>
>>>>>>> -abhi
>>>>>>>
>>>>>>>
>>>>>>>> On 30-Apr-2015, at 5:32 pm, Rajani Karuturi <ra...@apache.org>
>>>> wrote:
>>>>>>>>
>>>>>>>> after correcting the test file path, its working fine
>>>>>>>>
>>>>>>>> https://travis-ci.org/karuturi/cloudstack/jobs/60681263
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> ~Rajani
>>>>>>>>
>>>>>>>> On Thu, Apr 30, 2015 at 4:51 PM, Rajani Karuturi <rajani@apache.org
>>>
>>>> wrote:
>>>>>>>>
>>>>>>>>> I think its due to this commit
>>>>>>>>>
>>>>>>>>>
>>>>
>> https://github.com/apache/cloudstack/commit/b941480e0df0bfa3377e797126b96cf9b3fbee77
>>>>>>>>>
>>>>>>>>> Here, test file name is changed from testname to
>>>> [smoke,component]/testname
>>>>>>>>>
>>>>>>>>> But, while running each test file in the for loop, it prepends the
>>>> name
>>>>>>>>> with smoke and hence, it cant find the file and none of the tests
>> in
>>>> the
>>>>>>>>> file are run
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> ~Rajani
>>>>>>>>>
>>>>>>>>> On Thu, Apr 30, 2015 at 4:37 PM, Abhinandan Prateek <
>>>>>>>>> abhinandan.prateek@shapeblue.com> wrote:
>>>>>>>>>
>>>>>>>>>> It is possible, I will check.
>>>>>>>>>>
>>>>>>>>>>> On 30-Apr-2015, at 3:43 pm, Rajani Karuturi <ra...@apache.org>
>>>> wrote:
>>>>>>>>>>>
>>>>>>>>>>> Hey Abhi,
>>>>>>>>>>>
>>>>>>>>>>> In the recent travis runs, its not printing the test case in
>>>> output (
>>>>>>>>>>> https://travis-ci.org/apache/cloudstack/jobs/60634577#L5443)
>>>>>>>>>>>
>>>>>>>>>>> It used to print the test case name and status (
>>>>>>>>>>> https://travis-ci.org/apache/cloudstack/jobs/59958134#L4205)
>>>>>>>>>>>
>>>>>>>>>>> Do you think it can be due to any recent changes?
>>>>>>>>>>>
>>>>>>>>>>> ~Rajani
>>>>>>>>>>>
>>>>>>>>>>> On Thu, Apr 30, 2015 at 10:32 AM, Abhinandan Prateek <
>>>>>>>>>>> abhinandan.prateek@shapeblue.com> wrote:
>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> There are more than 10 additional suites that can still be
>>>> included
>>>>>>>>>> to
>>>>>>>>>>>> the travis-CI.
>>>>>>>>>>>> Since the current set runs comfortably I will go ahead and add
>>>> more. If
>>>>>>>>>>>> the system gets overloaded, then we can balance the kind of test
>>>>>>>>>> suites and
>>>>>>>>>>>> amount of test suits that run comfortably on travis.
>>>>>>>>>>>>
>>>>>>>>>>>> -abhi
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> Find out more about ShapeBlue and our range of CloudStack
>> related
>>>>>>>>>> services
>>>>>>>>>>>>
>>>>>>>>>>>> IaaS Cloud Design & Build<
>>>>>>>>>>>> http://shapeblue.com/iaas-cloud-design-and-build//>
>>>>>>>>>>>> CSForge – rapid IaaS deployment framework<
>>>>>>>>>> http://shapeblue.com/csforge/>
>>>>>>>>>>>> CloudStack Consulting<
>>>> http://shapeblue.com/cloudstack-consultancy/>
>>>>>>>>>>>> CloudStack Software Engineering<
>>>>>>>>>>>> http://shapeblue.com/cloudstack-software-engineering/>
>>>>>>>>>>>> CloudStack Infrastructure Support<
>>>>>>>>>>>> http://shapeblue.com/cloudstack-infrastructure-support/>
>>>>>>>>>>>> CloudStack Bootcamp Training Courses<
>>>>>>>>>>>> http://shapeblue.com/cloudstack-training/>
>>>>>>>>>>>>
>>>>>>>>>>>> This email and any attachments to it may be confidential and are
>>>>>>>>>> intended
>>>>>>>>>>>> solely for the use of the individual to whom it is addressed.
>> Any
>>>>>>>>>> views or
>>>>>>>>>>>> opinions expressed are solely those of the author and do not
>>>>>>>>>> necessarily
>>>>>>>>>>>> represent those of Shape Blue Ltd or related companies. If you
>>>> are not
>>>>>>>>>> the
>>>>>>>>>>>> intended recipient of this email, you must neither take any
>> action
>>>>>>>>>> based
>>>>>>>>>>>> upon its contents, nor copy or show it to anyone. Please contact
>>>> the
>>>>>>>>>> sender
>>>>>>>>>>>> if you believe you have received this email in error. Shape Blue
>>>> Ltd
>>>>>>>>>> is a
>>>>>>>>>>>> company incorporated in England & Wales. ShapeBlue Services
>> India
>>>> LLP
>>>>>>>>>> is a
>>>>>>>>>>>> company incorporated in India and is operated under license from
>>>> Shape
>>>>>>>>>> Blue
>>>>>>>>>>>> Ltd. Shape Blue Brasil Consultoria Ltda is a company
>> incorporated
>>>> in
>>>>>>>>>> Brasil
>>>>>>>>>>>> and is operated under license from Shape Blue Ltd. ShapeBlue SA
>>>> Pty
>>>>>>>>>> Ltd is
>>>>>>>>>>>> a company registered by The Republic of South Africa and is
>> traded
>>>>>>>>>> under
>>>>>>>>>>>> license from Shape Blue Ltd. ShapeBlue is a registered
>> trademark.
>>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Find out more about ShapeBlue and our range of CloudStack related
>>>> services
>>>>>>>>>>
>>>>>>>>>> IaaS Cloud Design & Build<
>>>>>>>>>> http://shapeblue.com/iaas-cloud-design-and-build//>
>>>>>>>>>> CSForge – rapid IaaS deployment framework<
>>>> http://shapeblue.com/csforge/>
>>>>>>>>>> CloudStack Consulting<
>> http://shapeblue.com/cloudstack-consultancy/>
>>>>>>>>>> CloudStack Software Engineering<
>>>>>>>>>> http://shapeblue.com/cloudstack-software-engineering/>
>>>>>>>>>> CloudStack Infrastructure Support<
>>>>>>>>>> http://shapeblue.com/cloudstack-infrastructure-support/>
>>>>>>>>>> CloudStack Bootcamp Training Courses<
>>>>>>>>>> http://shapeblue.com/cloudstack-training/>
>>>>>>>>>>
>>>>>>>>>> This email and any attachments to it may be confidential and are
>>>> intended
>>>>>>>>>> solely for the use of the individual to whom it is addressed. Any
>>>> views or
>>>>>>>>>> opinions expressed are solely those of the author and do not
>>>> necessarily
>>>>>>>>>> represent those of Shape Blue Ltd or related companies. If you are
>>>> not the
>>>>>>>>>> intended recipient of this email, you must neither take any action
>>>> based
>>>>>>>>>> upon its contents, nor copy or show it to anyone. Please contact
>>>> the sender
>>>>>>>>>> if you believe you have received this email in error. Shape Blue
>>>> Ltd is a
>>>>>>>>>> company incorporated in England & Wales. ShapeBlue Services India
>>>> LLP is a
>>>>>>>>>> company incorporated in India and is operated under license from
>>>> Shape Blue
>>>>>>>>>> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated
>>>> in Brasil
>>>>>>>>>> and is operated under license from Shape Blue Ltd. ShapeBlue SA
>> Pty
>>>> Ltd is
>>>>>>>>>> a company registered by The Republic of South Africa and is traded
>>>> under
>>>>>>>>>> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>
>>>>>>> Find out more about ShapeBlue and our range of CloudStack related
>>>> services
>>>>>>>
>>>>>>> IaaS Cloud Design & Build<
>>>> http://shapeblue.com/iaas-cloud-design-and-build//>
>>>>>>> CSForge – rapid IaaS deployment framework<
>>>> http://shapeblue.com/csforge/>
>>>>>>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>>>>>>> CloudStack Software Engineering<
>>>> http://shapeblue.com/cloudstack-software-engineering/>
>>>>>>> CloudStack Infrastructure Support<
>>>> http://shapeblue.com/cloudstack-infrastructure-support/>
>>>>>>> CloudStack Bootcamp Training Courses<
>>>> http://shapeblue.com/cloudstack-training/>
>>>>>>>
>>>>>>> This email and any attachments to it may be confidential and are
>>>> intended solely for the use of the individual to whom it is addressed.
>> Any
>>>> views or opinions expressed are solely those of the author and do not
>>>> necessarily represent those of Shape Blue Ltd or related companies. If
>> you
>>>> are not the intended recipient of this email, you must neither take any
>>>> action based upon its contents, nor copy or show it to anyone. Please
>>>> contact the sender if you believe you have received this email in error.
>>>> Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue
>>>> Services India LLP is a company incorporated in India and is operated
>> under
>>>> license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a
>>>> company incorporated in Brasil and is operated under license from Shape
>>>> Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic
>> of
>>>> South Africa and is traded under license from Shape Blue Ltd. ShapeBlue
>> is
>>>> a registered trademark.
>>>>>>
>>>>>> Find out more about ShapeBlue and our range of CloudStack related
>>>> services
>>>>>>
>>>>>> IaaS Cloud Design & Build<
>>>> http://shapeblue.com/iaas-cloud-design-and-build//>
>>>>>> CSForge – rapid IaaS deployment framework<
>> http://shapeblue.com/csforge/
>>>>>
>>>>>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>>>>>> CloudStack Software Engineering<
>>>> http://shapeblue.com/cloudstack-software-engineering/>
>>>>>> CloudStack Infrastructure Support<
>>>> http://shapeblue.com/cloudstack-infrastructure-support/>
>>>>>> CloudStack Bootcamp Training Courses<
>>>> http://shapeblue.com/cloudstack-training/>
>>>>>>
>>>>>> This email and any attachments to it may be confidential and are
>>>> intended solely for the use of the individual to whom it is addressed.
>> Any
>>>> views or opinions expressed are solely those of the author and do not
>>>> necessarily represent those of Shape Blue Ltd or related companies. If
>> you
>>>> are not the intended recipient of this email, you must neither take any
>>>> action based upon its contents, nor copy or show it to anyone. Please
>>>> contact the sender if you believe you have received this email in error.
>>>> Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue
>>>> Services India LLP is a company incorporated in India and is operated
>> under
>>>> license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a
>>>> company incorporated in Brasil and is operated under license from Shape
>>>> Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic
>> of
>>>> South Africa and is traded under license from Shape Blue Ltd. ShapeBlue
>> is
>>>> a registered trademark.
>>>>
>>
>> Find out more about ShapeBlue and our range of CloudStack related services
>>
>> IaaS Cloud Design & Build<
>> http://shapeblue.com/iaas-cloud-design-and-build//>
>> CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>> CloudStack Software Engineering<
>> http://shapeblue.com/cloudstack-software-engineering/>
>> CloudStack Infrastructure Support<
>> http://shapeblue.com/cloudstack-infrastructure-support/>
>> CloudStack Bootcamp Training Courses<
>> http://shapeblue.com/cloudstack-training/>
>>
>> This email and any attachments to it may be confidential and are intended
>> solely for the use of the individual to whom it is addressed. Any views or
>> opinions expressed are solely those of the author and do not necessarily
>> represent those of Shape Blue Ltd or related companies. If you are not the
>> intended recipient of this email, you must neither take any action based
>> upon its contents, nor copy or show it to anyone. Please contact the sender
>> if you believe you have received this email in error. Shape Blue Ltd is a
>> company incorporated in England & Wales. ShapeBlue Services India LLP is a
>> company incorporated in India and is operated under license from Shape Blue
>> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil
>> and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is
>> a company registered by The Republic of South Africa and is traded under
>> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>>

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>

This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: marvin test cases + travis

Posted by Daan Hoogland <da...@gmail.com>.
If we can lets increase, but if we can't let's not allow for false negatives

Op vr 1 mei 2015 om 19:39 schreef Rajani Karuturi <ra...@apache.org>:

> -1 on increasing the time
> As a reviewer, I would like an immediate response on a pull request. By the
> time I review the code, if CI gives a +1(or -1) I can close the PR then and
> there instead of coming back again to merge.
>
> I would suggest running all the jobs under 30 min and increasing the number
> of parallel jobs as much as possible. we are running 10 jobs now. may be we
> could increase this to 15(dont know if this is possible)
>
> we should aim to run only the smoke tests and not the entire regression
> suite always.
>
> Making the jobs run on containers will speed them up. This needs some work
> on removing the sudo dependency on the jobs (which is required to install
> some additional packages and marvin).
>
> ~Rajani
>
> On Fri, May 1, 2015 at 8:25 AM, Abhinandan Prateek <
> abhinandan.prateek@shapeblue.com> wrote:
>
> > +1 for increased timeouts.
> >
> > At the moment we get less than 24 commits per day on master. Only a
> couple
> > on other branches per day.
> > We can increase the timeout to upto 70 minutes or more. Will try to
> ensure
> > that in general a single run does not take more than an hour.
> >
> > A timeout window slightly higher will ensure that we do not see timeout
> > failures.
> >
> > > On 30-Apr-2015, at 11:25 pm, Daan Hoogland <da...@gmail.com>
> > wrote:
> > >
> > > Travis is starting to indue the, 'oh,  a timeout again' - blindness in
> > me.
> > > Let's put a safe time on it.  A result should mean something and those
> > time
> > > out are like the (decreasing) abundance of Jenkins failures.
> > >
> > > So +1 for increasing the time
> > >
> > > On Thu, 30 Apr 2015 18:46 Ian Duffy <ia...@ianduffy.ie> wrote:
> > >
> > >>> Do we need to ask for an increase in run time?
> > >>
> > >> From my experience I wouldn't say its required however *it would be
> very
> > >> nice*.
> > >> At the moment what we do is create new parallel jobs and balance the
> > >> tests across them so each job is under 50mins.
> > >>
> > >> Anywho, just my 2c, see what others say/think.
> > >>
> > >> On 30 April 2015 at 17:34, David Nalley <da...@gnsa.us> wrote:
> > >>> Do we need to ask for an increase in run time?
> > >>> 50 minutes is the OSS default, but the ASF is a paying customer and
> we
> > >>> can ask for longer timeouts.
> > >>>
> > >>> --David
> > >>>
> > >>> On Thu, Apr 30, 2015 at 10:06 AM, Abhinandan Prateek
> > >>> <ab...@shapeblue.com> wrote:
> > >>>> One of the run did timeout. Will balance the runs.
> > >>>>
> > >>>>> On 30-Apr-2015, at 5:59 pm, Abhinandan Prateek <
> > >> abhinandan.prateek@shapeblue.com> wrote:
> > >>>>>
> > >>>>> Yes, thanks for checking. I was worried that now some of them may
> > >> start timing out.
> > >>>>> I have another 10 suites tested, will add them once everything
> seems
> > >> fine.
> > >>>>>
> > >>>>> -abhi
> > >>>>>
> > >>>>>
> > >>>>>> On 30-Apr-2015, at 5:32 pm, Rajani Karuturi <ra...@apache.org>
> > >> wrote:
> > >>>>>>
> > >>>>>> after correcting the test file path, its working fine
> > >>>>>>
> > >>>>>> https://travis-ci.org/karuturi/cloudstack/jobs/60681263
> > >>>>>>
> > >>>>>>
> > >>>>>>
> > >>>>>> ~Rajani
> > >>>>>>
> > >>>>>> On Thu, Apr 30, 2015 at 4:51 PM, Rajani Karuturi <
> rajani@apache.org
> > >
> > >> wrote:
> > >>>>>>
> > >>>>>>> I think its due to this commit
> > >>>>>>>
> > >>>>>>>
> > >>
> >
> https://github.com/apache/cloudstack/commit/b941480e0df0bfa3377e797126b96cf9b3fbee77
> > >>>>>>>
> > >>>>>>> Here, test file name is changed from testname to
> > >> [smoke,component]/testname
> > >>>>>>>
> > >>>>>>> But, while running each test file in the for loop, it prepends
> the
> > >> name
> > >>>>>>> with smoke and hence, it cant find the file and none of the tests
> > in
> > >> the
> > >>>>>>> file are run
> > >>>>>>>
> > >>>>>>>
> > >>>>>>>
> > >>>>>>> ~Rajani
> > >>>>>>>
> > >>>>>>> On Thu, Apr 30, 2015 at 4:37 PM, Abhinandan Prateek <
> > >>>>>>> abhinandan.prateek@shapeblue.com> wrote:
> > >>>>>>>
> > >>>>>>>> It is possible, I will check.
> > >>>>>>>>
> > >>>>>>>>> On 30-Apr-2015, at 3:43 pm, Rajani Karuturi <rajani@apache.org
> >
> > >> wrote:
> > >>>>>>>>>
> > >>>>>>>>> Hey Abhi,
> > >>>>>>>>>
> > >>>>>>>>> In the recent travis runs, its not printing the test case in
> > >> output (
> > >>>>>>>>> https://travis-ci.org/apache/cloudstack/jobs/60634577#L5443)
> > >>>>>>>>>
> > >>>>>>>>> It used to print the test case name and status (
> > >>>>>>>>> https://travis-ci.org/apache/cloudstack/jobs/59958134#L4205)
> > >>>>>>>>>
> > >>>>>>>>> Do you think it can be due to any recent changes?
> > >>>>>>>>>
> > >>>>>>>>> ~Rajani
> > >>>>>>>>>
> > >>>>>>>>> On Thu, Apr 30, 2015 at 10:32 AM, Abhinandan Prateek <
> > >>>>>>>>> abhinandan.prateek@shapeblue.com> wrote:
> > >>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>> There are more than 10 additional suites that can still be
> > >> included
> > >>>>>>>> to
> > >>>>>>>>>> the travis-CI.
> > >>>>>>>>>> Since the current set runs comfortably I will go ahead and add
> > >> more. If
> > >>>>>>>>>> the system gets overloaded, then we can balance the kind of
> test
> > >>>>>>>> suites and
> > >>>>>>>>>> amount of test suits that run comfortably on travis.
> > >>>>>>>>>>
> > >>>>>>>>>> -abhi
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>> Find out more about ShapeBlue and our range of CloudStack
> > related
> > >>>>>>>> services
> > >>>>>>>>>>
> > >>>>>>>>>> IaaS Cloud Design & Build<
> > >>>>>>>>>> http://shapeblue.com/iaas-cloud-design-and-build//>
> > >>>>>>>>>> CSForge – rapid IaaS deployment framework<
> > >>>>>>>> http://shapeblue.com/csforge/>
> > >>>>>>>>>> CloudStack Consulting<
> > >> http://shapeblue.com/cloudstack-consultancy/>
> > >>>>>>>>>> CloudStack Software Engineering<
> > >>>>>>>>>> http://shapeblue.com/cloudstack-software-engineering/>
> > >>>>>>>>>> CloudStack Infrastructure Support<
> > >>>>>>>>>> http://shapeblue.com/cloudstack-infrastructure-support/>
> > >>>>>>>>>> CloudStack Bootcamp Training Courses<
> > >>>>>>>>>> http://shapeblue.com/cloudstack-training/>
> > >>>>>>>>>>
> > >>>>>>>>>> This email and any attachments to it may be confidential and
> are
> > >>>>>>>> intended
> > >>>>>>>>>> solely for the use of the individual to whom it is addressed.
> > Any
> > >>>>>>>> views or
> > >>>>>>>>>> opinions expressed are solely those of the author and do not
> > >>>>>>>> necessarily
> > >>>>>>>>>> represent those of Shape Blue Ltd or related companies. If you
> > >> are not
> > >>>>>>>> the
> > >>>>>>>>>> intended recipient of this email, you must neither take any
> > action
> > >>>>>>>> based
> > >>>>>>>>>> upon its contents, nor copy or show it to anyone. Please
> contact
> > >> the
> > >>>>>>>> sender
> > >>>>>>>>>> if you believe you have received this email in error. Shape
> Blue
> > >> Ltd
> > >>>>>>>> is a
> > >>>>>>>>>> company incorporated in England & Wales. ShapeBlue Services
> > India
> > >> LLP
> > >>>>>>>> is a
> > >>>>>>>>>> company incorporated in India and is operated under license
> from
> > >> Shape
> > >>>>>>>> Blue
> > >>>>>>>>>> Ltd. Shape Blue Brasil Consultoria Ltda is a company
> > incorporated
> > >> in
> > >>>>>>>> Brasil
> > >>>>>>>>>> and is operated under license from Shape Blue Ltd. ShapeBlue
> SA
> > >> Pty
> > >>>>>>>> Ltd is
> > >>>>>>>>>> a company registered by The Republic of South Africa and is
> > traded
> > >>>>>>>> under
> > >>>>>>>>>> license from Shape Blue Ltd. ShapeBlue is a registered
> > trademark.
> > >>>>>>>>>>
> > >>>>>>>>
> > >>>>>>>> Find out more about ShapeBlue and our range of CloudStack
> related
> > >> services
> > >>>>>>>>
> > >>>>>>>> IaaS Cloud Design & Build<
> > >>>>>>>> http://shapeblue.com/iaas-cloud-design-and-build//>
> > >>>>>>>> CSForge – rapid IaaS deployment framework<
> > >> http://shapeblue.com/csforge/>
> > >>>>>>>> CloudStack Consulting<
> > http://shapeblue.com/cloudstack-consultancy/>
> > >>>>>>>> CloudStack Software Engineering<
> > >>>>>>>> http://shapeblue.com/cloudstack-software-engineering/>
> > >>>>>>>> CloudStack Infrastructure Support<
> > >>>>>>>> http://shapeblue.com/cloudstack-infrastructure-support/>
> > >>>>>>>> CloudStack Bootcamp Training Courses<
> > >>>>>>>> http://shapeblue.com/cloudstack-training/>
> > >>>>>>>>
> > >>>>>>>> This email and any attachments to it may be confidential and are
> > >> intended
> > >>>>>>>> solely for the use of the individual to whom it is addressed.
> Any
> > >> views or
> > >>>>>>>> opinions expressed are solely those of the author and do not
> > >> necessarily
> > >>>>>>>> represent those of Shape Blue Ltd or related companies. If you
> are
> > >> not the
> > >>>>>>>> intended recipient of this email, you must neither take any
> action
> > >> based
> > >>>>>>>> upon its contents, nor copy or show it to anyone. Please contact
> > >> the sender
> > >>>>>>>> if you believe you have received this email in error. Shape Blue
> > >> Ltd is a
> > >>>>>>>> company incorporated in England & Wales. ShapeBlue Services
> India
> > >> LLP is a
> > >>>>>>>> company incorporated in India and is operated under license from
> > >> Shape Blue
> > >>>>>>>> Ltd. Shape Blue Brasil Consultoria Ltda is a company
> incorporated
> > >> in Brasil
> > >>>>>>>> and is operated under license from Shape Blue Ltd. ShapeBlue SA
> > Pty
> > >> Ltd is
> > >>>>>>>> a company registered by The Republic of South Africa and is
> traded
> > >> under
> > >>>>>>>> license from Shape Blue Ltd. ShapeBlue is a registered
> trademark.
> > >>>>>>>>
> > >>>>>>>
> > >>>>>>>
> > >>>>>
> > >>>>> Find out more about ShapeBlue and our range of CloudStack related
> > >> services
> > >>>>>
> > >>>>> IaaS Cloud Design & Build<
> > >> http://shapeblue.com/iaas-cloud-design-and-build//>
> > >>>>> CSForge – rapid IaaS deployment framework<
> > >> http://shapeblue.com/csforge/>
> > >>>>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/
> >
> > >>>>> CloudStack Software Engineering<
> > >> http://shapeblue.com/cloudstack-software-engineering/>
> > >>>>> CloudStack Infrastructure Support<
> > >> http://shapeblue.com/cloudstack-infrastructure-support/>
> > >>>>> CloudStack Bootcamp Training Courses<
> > >> http://shapeblue.com/cloudstack-training/>
> > >>>>>
> > >>>>> This email and any attachments to it may be confidential and are
> > >> intended solely for the use of the individual to whom it is addressed.
> > Any
> > >> views or opinions expressed are solely those of the author and do not
> > >> necessarily represent those of Shape Blue Ltd or related companies. If
> > you
> > >> are not the intended recipient of this email, you must neither take
> any
> > >> action based upon its contents, nor copy or show it to anyone. Please
> > >> contact the sender if you believe you have received this email in
> error.
> > >> Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue
> > >> Services India LLP is a company incorporated in India and is operated
> > under
> > >> license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a
> > >> company incorporated in Brasil and is operated under license from
> Shape
> > >> Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic
> > of
> > >> South Africa and is traded under license from Shape Blue Ltd.
> ShapeBlue
> > is
> > >> a registered trademark.
> > >>>>
> > >>>> Find out more about ShapeBlue and our range of CloudStack related
> > >> services
> > >>>>
> > >>>> IaaS Cloud Design & Build<
> > >> http://shapeblue.com/iaas-cloud-design-and-build//>
> > >>>> CSForge – rapid IaaS deployment framework<
> > http://shapeblue.com/csforge/
> > >>>
> > >>>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> > >>>> CloudStack Software Engineering<
> > >> http://shapeblue.com/cloudstack-software-engineering/>
> > >>>> CloudStack Infrastructure Support<
> > >> http://shapeblue.com/cloudstack-infrastructure-support/>
> > >>>> CloudStack Bootcamp Training Courses<
> > >> http://shapeblue.com/cloudstack-training/>
> > >>>>
> > >>>> This email and any attachments to it may be confidential and are
> > >> intended solely for the use of the individual to whom it is addressed.
> > Any
> > >> views or opinions expressed are solely those of the author and do not
> > >> necessarily represent those of Shape Blue Ltd or related companies. If
> > you
> > >> are not the intended recipient of this email, you must neither take
> any
> > >> action based upon its contents, nor copy or show it to anyone. Please
> > >> contact the sender if you believe you have received this email in
> error.
> > >> Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue
> > >> Services India LLP is a company incorporated in India and is operated
> > under
> > >> license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a
> > >> company incorporated in Brasil and is operated under license from
> Shape
> > >> Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic
> > of
> > >> South Africa and is traded under license from Shape Blue Ltd.
> ShapeBlue
> > is
> > >> a registered trademark.
> > >>
> >
> > Find out more about ShapeBlue and our range of CloudStack related
> services
> >
> > IaaS Cloud Design & Build<
> > http://shapeblue.com/iaas-cloud-design-and-build//>
> > CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
> > CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> > CloudStack Software Engineering<
> > http://shapeblue.com/cloudstack-software-engineering/>
> > CloudStack Infrastructure Support<
> > http://shapeblue.com/cloudstack-infrastructure-support/>
> > CloudStack Bootcamp Training Courses<
> > http://shapeblue.com/cloudstack-training/>
> >
> > This email and any attachments to it may be confidential and are intended
> > solely for the use of the individual to whom it is addressed. Any views
> or
> > opinions expressed are solely those of the author and do not necessarily
> > represent those of Shape Blue Ltd or related companies. If you are not
> the
> > intended recipient of this email, you must neither take any action based
> > upon its contents, nor copy or show it to anyone. Please contact the
> sender
> > if you believe you have received this email in error. Shape Blue Ltd is a
> > company incorporated in England & Wales. ShapeBlue Services India LLP is
> a
> > company incorporated in India and is operated under license from Shape
> Blue
> > Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in
> Brasil
> > and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd
> is
> > a company registered by The Republic of South Africa and is traded under
> > license from Shape Blue Ltd. ShapeBlue is a registered trademark.
> >
>

Re: marvin test cases + travis

Posted by Abhinandan Prateek <ab...@shapeblue.com>.
We can control the number of tests that travis runs. It is possible to say run more variety of test cases on each 10th run.
This will ensure that 9 out of 10 times travis runs a small sub set of tests. We can do this as travis provides the build number in an environment variable. If we can trigger the travis automatically at certain time of day then we can use that run to run just the regression suite. In that case we can have per commit run of smoke and once a day run of regression suite.

Even with this scheme we will need to increase the timeout. So I think it is ok to increase the timeout, but to get faster results most of the time, tune travis to run only a smaller subset of tests most of the time or for each commit.

If we leave out test cases out of travis that it can run, then we will be dependant on individuals/companies to do it once in a while and that is not automation.

With better control of travis we can have it run unit tests once (recently added by Rajani as an optimisation), have it run find bug, regressions say once in n runs etc. We should look forward to a highly customisable and useful travis instead of working in past limitations.


> On 02-May-2015, at 10:22 am, Raja Pullela <ra...@citrix.com> wrote:
>
> -1 for the time...
> since these tests run independently if we can spawn more threads/vms to bring down the run time, that will be good.
> Another thing that can be looked at the run only tests in SMOKE folder.
> BTW, more tests in  "SMOKE"  should be added on a continuous basis.
>
> -----Original Message-----
> From: Rajani Karuturi [mailto:rajani@apache.org]
> Sent: Friday, May 1, 2015 11:09 PM
> To: dev@cloudstack.apache.org
> Subject: Re: marvin test cases + travis
>
> -1 on increasing the time
> As a reviewer, I would like an immediate response on a pull request. By the time I review the code, if CI gives a +1(or -1) I can close the PR then and there instead of coming back again to merge.
>
> I would suggest running all the jobs under 30 min and increasing the number of parallel jobs as much as possible. we are running 10 jobs now. may be we could increase this to 15(dont know if this is possible)
>
> we should aim to run only the smoke tests and not the entire regression suite always.
>
> Making the jobs run on containers will speed them up. This needs some work on removing the sudo dependency on the jobs (which is required to install some additional packages and marvin).
>
> ~Rajani
>
> On Fri, May 1, 2015 at 8:25 AM, Abhinandan Prateek < abhinandan.prateek@shapeblue.com> wrote:
>
>> +1 for increased timeouts.
>>
>> At the moment we get less than 24 commits per day on master. Only a
>> couple on other branches per day.
>> We can increase the timeout to upto 70 minutes or more. Will try to
>> ensure that in general a single run does not take more than an hour.
>>
>> A timeout window slightly higher will ensure that we do not see
>> timeout failures.
>>
>>> On 30-Apr-2015, at 11:25 pm, Daan Hoogland <da...@gmail.com>
>> wrote:
>>>
>>> Travis is starting to indue the, 'oh,  a timeout again' - blindness
>>> in
>> me.
>>> Let's put a safe time on it.  A result should mean something and
>>> those
>> time
>>> out are like the (decreasing) abundance of Jenkins failures.
>>>
>>> So +1 for increasing the time
>>>
>>> On Thu, 30 Apr 2015 18:46 Ian Duffy <ia...@ianduffy.ie> wrote:
>>>
>>>>> Do we need to ask for an increase in run time?
>>>>
>>>> From my experience I wouldn't say its required however *it would be
>>>> very nice*.
>>>> At the moment what we do is create new parallel jobs and balance
>>>> the tests across them so each job is under 50mins.
>>>>
>>>> Anywho, just my 2c, see what others say/think.
>>>>
>>>> On 30 April 2015 at 17:34, David Nalley <da...@gnsa.us> wrote:
>>>>> Do we need to ask for an increase in run time?
>>>>> 50 minutes is the OSS default, but the ASF is a paying customer
>>>>> and we can ask for longer timeouts.
>>>>>
>>>>> --David
>>>>>
>>>>> On Thu, Apr 30, 2015 at 10:06 AM, Abhinandan Prateek
>>>>> <ab...@shapeblue.com> wrote:
>>>>>> One of the run did timeout. Will balance the runs.
>>>>>>
>>>>>>> On 30-Apr-2015, at 5:59 pm, Abhinandan Prateek <
>>>> abhinandan.prateek@shapeblue.com> wrote:
>>>>>>>
>>>>>>> Yes, thanks for checking. I was worried that now some of them
>>>>>>> may
>>>> start timing out.
>>>>>>> I have another 10 suites tested, will add them once everything
>>>>>>> seems
>>>> fine.
>>>>>>>
>>>>>>> -abhi
>>>>>>>
>>>>>>>
>>>>>>>> On 30-Apr-2015, at 5:32 pm, Rajani Karuturi <ra...@apache.org>
>>>> wrote:
>>>>>>>>
>>>>>>>> after correcting the test file path, its working fine
>>>>>>>>
>>>>>>>> https://travis-ci.org/karuturi/cloudstack/jobs/60681263
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> ~Rajani
>>>>>>>>
>>>>>>>> On Thu, Apr 30, 2015 at 4:51 PM, Rajani Karuturi
>>>>>>>> <rajani@apache.org
>>>
>>>> wrote:
>>>>>>>>
>>>>>>>>> I think its due to this commit
>>>>>>>>>
>>>>>>>>>
>>>>
>> https://github.com/apache/cloudstack/commit/b941480e0df0bfa3377e797126
>> b96cf9b3fbee77
>>>>>>>>>
>>>>>>>>> Here, test file name is changed from testname to
>>>> [smoke,component]/testname
>>>>>>>>>
>>>>>>>>> But, while running each test file in the for loop, it prepends
>>>>>>>>> the
>>>> name
>>>>>>>>> with smoke and hence, it cant find the file and none of the
>>>>>>>>> tests
>> in
>>>> the
>>>>>>>>> file are run
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> ~Rajani
>>>>>>>>>
>>>>>>>>> On Thu, Apr 30, 2015 at 4:37 PM, Abhinandan Prateek <
>>>>>>>>> abhinandan.prateek@shapeblue.com> wrote:
>>>>>>>>>
>>>>>>>>>> It is possible, I will check.
>>>>>>>>>>
>>>>>>>>>>> On 30-Apr-2015, at 3:43 pm, Rajani Karuturi
>>>>>>>>>>> <ra...@apache.org>
>>>> wrote:
>>>>>>>>>>>
>>>>>>>>>>> Hey Abhi,
>>>>>>>>>>>
>>>>>>>>>>> In the recent travis runs, its not printing the test case in
>>>> output (
>>>>>>>>>>> https://travis-ci.org/apache/cloudstack/jobs/60634577#L5443)
>>>>>>>>>>>
>>>>>>>>>>> It used to print the test case name and status (
>>>>>>>>>>> https://travis-ci.org/apache/cloudstack/jobs/59958134#L4205)
>>>>>>>>>>>
>>>>>>>>>>> Do you think it can be due to any recent changes?
>>>>>>>>>>>
>>>>>>>>>>> ~Rajani
>>>>>>>>>>>
>>>>>>>>>>> On Thu, Apr 30, 2015 at 10:32 AM, Abhinandan Prateek <
>>>>>>>>>>> abhinandan.prateek@shapeblue.com> wrote:
>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> There are more than 10 additional suites that can still be
>>>> included
>>>>>>>>>> to
>>>>>>>>>>>> the travis-CI.
>>>>>>>>>>>> Since the current set runs comfortably I will go ahead and
>>>>>>>>>>>> add
>>>> more. If
>>>>>>>>>>>> the system gets overloaded, then we can balance the kind of
>>>>>>>>>>>> test
>>>>>>>>>> suites and
>>>>>>>>>>>> amount of test suits that run comfortably on travis.
>>>>>>>>>>>>
>>>>>>>>>>>> -abhi
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> Find out more about ShapeBlue and our range of CloudStack
>> related
>>>>>>>>>> services
>>>>>>>>>>>>
>>>>>>>>>>>> IaaS Cloud Design & Build<
>>>>>>>>>>>> http://secure-web.cisco.com/1pHXa6i2ZxbTOD2YXCa6-c3x2dmzvOC
>>>>>>>>>>>> AO7sBNrnkLXSQymtVtK2camOyotDd30Er1Nv2cLCRcXANhkRKDgTT7O62LQ
>>>>>>>>>>>> HevV4v385DJAE5OBIwid5XAuJ2LbMh28DLqFVuAVDwzsu5Or_LlLENaeL6O
>>>>>>>>>>>> I8fe9ZboxEgpUPOdEvASu9b9GLhtExooMnpBFJu9djSv/http%3A%2F%2Fs
>>>>>>>>>>>> hapeblue.com%2Fiaas-cloud-design-and-build%2F%2F>
>>>>>>>>>>>> CSForge – rapid IaaS deployment framework<
>>>>>>>>>> http://secure-web.cisco.com/1GzQXJW5Hxcq5XoMtkxCquPsSSjy4bvBt
>>>>>>>>>> 1iMU3yVs6zaCVcWYlRUjETJ_ziloxcBQXrSfIREcJO0KXaZTXoGSGuhrlGNG_
>>>>>>>>>> uU92QNZxbIZ_nY2Lln0S3r1qaYRNXA-OiQQm8kvWRQWZUI8JxVfiJ_GPmRB46
>>>>>>>>>> 2wgvvvm4h0ywEAHEVlV0b-4daKnlmPw50KUZD2/http%3A%2F%2Fshapeblue
>>>>>>>>>> .com%2Fcsforge%2F>
>>>>>>>>>>>> CloudStack Consulting<
>>>> http://secure-web.cisco.com/1GXeDjw2Umr-XP9XXMKFefUuyHaoEAFH2C24w17
>>>> S6UukIHMtPURriARhRUVilcpixurdOtbT5hmYT9fXBiq3x-6nzhy5Ys7pfxDhnjGXzM
>>>> wVtXXcmA-W2A3oEj7yQnkgFQ1RiCI75gXRMVRLAXFMu36L22FcSUA06sSzHb4ek7eND
>>>> oJaMGJwGZeYJLl9Kw4ys/http%3A%2F%2Fshapeblue.com%2Fcloudstack-consul
>>>> tancy%2F>
>>>>>>>>>>>> CloudStack Software Engineering<
>>>>>>>>>>>> http://secure-web.cisco.com/1WrrxNiZxulr07uJLK8qKuuXqQLFPC1
>>>>>>>>>>>> Pvl1LVxL_IIrKz6RXN8VGupjBCp8M1ErBixV8s3hm_f1LXy2sEzeveDuWgv
>>>>>>>>>>>> boEKYmXOTVfSeIwELgdxkafGC6uu-3iwYWoKVql7VxJ9YRfJAfDGOGlBNL_
>>>>>>>>>>>> kdBz4xTVnqAKyOBoM5lDhAmsFKCKRyCE-h_0qQly8Gag/http%3A%2F%2Fs
>>>>>>>>>>>> hapeblue.com%2Fcloudstack-software-engineering%2F>
>>>>>>>>>>>> CloudStack Infrastructure Support<
>>>>>>>>>>>> http://secure-web.cisco.com/1_jTQB3WV9YaynM6mYneDWnjX7Y4lKu
>>>>>>>>>>>> lcmsLSrmCLtUCRtvdcTtfzv_ue3g5DmgXBkjR_8Luu0HObwr794kKqnFlcc
>>>>>>>>>>>> g9v4JIAY5D_zUpmRmKnPad6ShFCtdtPB6mk9zBfoJW4nevTj7Px-Q-o5A36
>>>>>>>>>>>> mNFvMrTvYpxU_SN4F9y2cOGNZbtds1E0DMJOoZ0Hrfet/http%3A%2F%2Fs
>>>>>>>>>>>> hapeblue.com%2Fcloudstack-infrastructure-support%2F>
>>>>>>>>>>>> CloudStack Bootcamp Training Courses<
>>>>>>>>>>>> http://secure-web.cisco.com/1yyoWAza2R5RJxAKPWNvNlAozMLTe92
>>>>>>>>>>>> z8HcDFZi2AKQhkBav7eUQ1N4zW09YOu7OloxabENBu0z46u5BNqAgnwk4ht
>>>>>>>>>>>> VWz-HuKqP1jMckmREETqaN9bxh_LdWFT_SeHUeMnugn_d_r-2gU29BEFII9
>>>>>>>>>>>> uZXW7SUbcultS7y9Tbr-mraH7LCCpna9AkXwqCMdLJ6c/http%3A%2F%2Fs
>>>>>>>>>>>> hapeblue.com%2Fcloudstack-training%2F>
>>>>>>>>>>>>
>>>>>>>>>>>> This email and any attachments to it may be confidential
>>>>>>>>>>>> and are
>>>>>>>>>> intended
>>>>>>>>>>>> solely for the use of the individual to whom it is addressed.
>> Any
>>>>>>>>>> views or
>>>>>>>>>>>> opinions expressed are solely those of the author and do
>>>>>>>>>>>> not
>>>>>>>>>> necessarily
>>>>>>>>>>>> represent those of Shape Blue Ltd or related companies. If
>>>>>>>>>>>> you
>>>> are not
>>>>>>>>>> the
>>>>>>>>>>>> intended recipient of this email, you must neither take any
>> action
>>>>>>>>>> based
>>>>>>>>>>>> upon its contents, nor copy or show it to anyone. Please
>>>>>>>>>>>> contact
>>>> the
>>>>>>>>>> sender
>>>>>>>>>>>> if you believe you have received this email in error. Shape
>>>>>>>>>>>> Blue
>>>> Ltd
>>>>>>>>>> is a
>>>>>>>>>>>> company incorporated in England & Wales. ShapeBlue Services
>> India
>>>> LLP
>>>>>>>>>> is a
>>>>>>>>>>>> company incorporated in India and is operated under license
>>>>>>>>>>>> from
>>>> Shape
>>>>>>>>>> Blue
>>>>>>>>>>>> Ltd. Shape Blue Brasil Consultoria Ltda is a company
>> incorporated
>>>> in
>>>>>>>>>> Brasil
>>>>>>>>>>>> and is operated under license from Shape Blue Ltd.
>>>>>>>>>>>> ShapeBlue SA
>>>> Pty
>>>>>>>>>> Ltd is
>>>>>>>>>>>> a company registered by The Republic of South Africa and is
>> traded
>>>>>>>>>> under
>>>>>>>>>>>> license from Shape Blue Ltd. ShapeBlue is a registered
>> trademark.
>>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Find out more about ShapeBlue and our range of CloudStack
>>>>>>>>>> related
>>>> services
>>>>>>>>>>
>>>>>>>>>> IaaS Cloud Design & Build<
>>>>>>>>>> http://secure-web.cisco.com/1pHXa6i2ZxbTOD2YXCa6-c3x2dmzvOCAO
>>>>>>>>>> 7sBNrnkLXSQymtVtK2camOyotDd30Er1Nv2cLCRcXANhkRKDgTT7O62LQHevV
>>>>>>>>>> 4v385DJAE5OBIwid5XAuJ2LbMh28DLqFVuAVDwzsu5Or_LlLENaeL6OI8fe9Z
>>>>>>>>>> boxEgpUPOdEvASu9b9GLhtExooMnpBFJu9djSv/http%3A%2F%2Fshapeblue
>>>>>>>>>> .com%2Fiaas-cloud-design-and-build%2F%2F>
>>>>>>>>>> CSForge – rapid IaaS deployment framework<
>>>> http://secure-web.cisco.com/1GzQXJW5Hxcq5XoMtkxCquPsSSjy4bvBt1iMU3y
>>>> Vs6zaCVcWYlRUjETJ_ziloxcBQXrSfIREcJO0KXaZTXoGSGuhrlGNG_uU92QNZxbIZ_
>>>> nY2Lln0S3r1qaYRNXA-OiQQm8kvWRQWZUI8JxVfiJ_GPmRB462wgvvvm4h0ywEAHEVl
>>>> V0b-4daKnlmPw50KUZD2/http%3A%2F%2Fshapeblue.com%2Fcsforge%2F>
>>>>>>>>>> CloudStack Consulting<
>> http://secure-web.cisco.com/1GXeDjw2Umr-XP9XXMKFefUuyHaoEAFH2C24w17S6U
>> ukIHMtPURriARhRUVilcpixurdOtbT5hmYT9fXBiq3x-6nzhy5Ys7pfxDhnjGXzMwVtXXc
>> mA-W2A3oEj7yQnkgFQ1RiCI75gXRMVRLAXFMu36L22FcSUA06sSzHb4ek7eNDoJaMGJwGZ
>> eYJLl9Kw4ys/http%3A%2F%2Fshapeblue.com%2Fcloudstack-consultancy%2F>
>>>>>>>>>> CloudStack Software Engineering<
>>>>>>>>>> http://secure-web.cisco.com/1WrrxNiZxulr07uJLK8qKuuXqQLFPC1Pv
>>>>>>>>>> l1LVxL_IIrKz6RXN8VGupjBCp8M1ErBixV8s3hm_f1LXy2sEzeveDuWgvboEK
>>>>>>>>>> YmXOTVfSeIwELgdxkafGC6uu-3iwYWoKVql7VxJ9YRfJAfDGOGlBNL_kdBz4x
>>>>>>>>>> TVnqAKyOBoM5lDhAmsFKCKRyCE-h_0qQly8Gag/http%3A%2F%2Fshapeblue
>>>>>>>>>> .com%2Fcloudstack-software-engineering%2F>
>>>>>>>>>> CloudStack Infrastructure Support<
>>>>>>>>>> http://secure-web.cisco.com/1_jTQB3WV9YaynM6mYneDWnjX7Y4lKulc
>>>>>>>>>> msLSrmCLtUCRtvdcTtfzv_ue3g5DmgXBkjR_8Luu0HObwr794kKqnFlccg9v4
>>>>>>>>>> JIAY5D_zUpmRmKnPad6ShFCtdtPB6mk9zBfoJW4nevTj7Px-Q-o5A36mNFvMr
>>>>>>>>>> TvYpxU_SN4F9y2cOGNZbtds1E0DMJOoZ0Hrfet/http%3A%2F%2Fshapeblue
>>>>>>>>>> .com%2Fcloudstack-infrastructure-support%2F>
>>>>>>>>>> CloudStack Bootcamp Training Courses<
>>>>>>>>>> http://secure-web.cisco.com/1yyoWAza2R5RJxAKPWNvNlAozMLTe92z8
>>>>>>>>>> HcDFZi2AKQhkBav7eUQ1N4zW09YOu7OloxabENBu0z46u5BNqAgnwk4htVWz-
>>>>>>>>>> HuKqP1jMckmREETqaN9bxh_LdWFT_SeHUeMnugn_d_r-2gU29BEFII9uZXW7S
>>>>>>>>>> UbcultS7y9Tbr-mraH7LCCpna9AkXwqCMdLJ6c/http%3A%2F%2Fshapeblue
>>>>>>>>>> .com%2Fcloudstack-training%2F>
>>>>>>>>>>
>>>>>>>>>> This email and any attachments to it may be confidential and
>>>>>>>>>> are
>>>> intended
>>>>>>>>>> solely for the use of the individual to whom it is addressed.
>>>>>>>>>> Any
>>>> views or
>>>>>>>>>> opinions expressed are solely those of the author and do not
>>>> necessarily
>>>>>>>>>> represent those of Shape Blue Ltd or related companies. If
>>>>>>>>>> you are
>>>> not the
>>>>>>>>>> intended recipient of this email, you must neither take any
>>>>>>>>>> action
>>>> based
>>>>>>>>>> upon its contents, nor copy or show it to anyone. Please
>>>>>>>>>> contact
>>>> the sender
>>>>>>>>>> if you believe you have received this email in error. Shape
>>>>>>>>>> Blue
>>>> Ltd is a
>>>>>>>>>> company incorporated in England & Wales. ShapeBlue Services
>>>>>>>>>> India
>>>> LLP is a
>>>>>>>>>> company incorporated in India and is operated under license
>>>>>>>>>> from
>>>> Shape Blue
>>>>>>>>>> Ltd. Shape Blue Brasil Consultoria Ltda is a company
>>>>>>>>>> incorporated
>>>> in Brasil
>>>>>>>>>> and is operated under license from Shape Blue Ltd. ShapeBlue
>>>>>>>>>> SA
>> Pty
>>>> Ltd is
>>>>>>>>>> a company registered by The Republic of South Africa and is
>>>>>>>>>> traded
>>>> under
>>>>>>>>>> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>
>>>>>>> Find out more about ShapeBlue and our range of CloudStack
>>>>>>> related
>>>> services
>>>>>>>
>>>>>>> IaaS Cloud Design & Build<
>>>> http://secure-web.cisco.com/1pHXa6i2ZxbTOD2YXCa6-c3x2dmzvOCAO7sBNrn
>>>> kLXSQymtVtK2camOyotDd30Er1Nv2cLCRcXANhkRKDgTT7O62LQHevV4v385DJAE5OB
>>>> Iwid5XAuJ2LbMh28DLqFVuAVDwzsu5Or_LlLENaeL6OI8fe9ZboxEgpUPOdEvASu9b9
>>>> GLhtExooMnpBFJu9djSv/http%3A%2F%2Fshapeblue.com%2Fiaas-cloud-design
>>>> -and-build%2F%2F>
>>>>>>> CSForge – rapid IaaS deployment framework<
>>>> http://secure-web.cisco.com/1GzQXJW5Hxcq5XoMtkxCquPsSSjy4bvBt1iMU3y
>>>> Vs6zaCVcWYlRUjETJ_ziloxcBQXrSfIREcJO0KXaZTXoGSGuhrlGNG_uU92QNZxbIZ_
>>>> nY2Lln0S3r1qaYRNXA-OiQQm8kvWRQWZUI8JxVfiJ_GPmRB462wgvvvm4h0ywEAHEVl
>>>> V0b-4daKnlmPw50KUZD2/http%3A%2F%2Fshapeblue.com%2Fcsforge%2F>
>>>>>>> CloudStack
>>>>>>> Consulting<http://secure-web.cisco.com/1GXeDjw2Umr-XP9XXMKFefUuy
>>>>>>> HaoEAFH2C24w17S6UukIHMtPURriARhRUVilcpixurdOtbT5hmYT9fXBiq3x-6nz
>>>>>>> hy5Ys7pfxDhnjGXzMwVtXXcmA-W2A3oEj7yQnkgFQ1RiCI75gXRMVRLAXFMu36L2
>>>>>>> 2FcSUA06sSzHb4ek7eNDoJaMGJwGZeYJLl9Kw4ys/http%3A%2F%2Fshapeblue.
>>>>>>> com%2Fcloudstack-consultancy%2F> CloudStack Software
>>>>>>> Engineering<
>>>> http://secure-web.cisco.com/1WrrxNiZxulr07uJLK8qKuuXqQLFPC1Pvl1LVxL
>>>> _IIrKz6RXN8VGupjBCp8M1ErBixV8s3hm_f1LXy2sEzeveDuWgvboEKYmXOTVfSeIwE
>>>> LgdxkafGC6uu-3iwYWoKVql7VxJ9YRfJAfDGOGlBNL_kdBz4xTVnqAKyOBoM5lDhAms
>>>> FKCKRyCE-h_0qQly8Gag/http%3A%2F%2Fshapeblue.com%2Fcloudstack-softwa
>>>> re-engineering%2F>
>>>>>>> CloudStack Infrastructure Support<
>>>> http://secure-web.cisco.com/1_jTQB3WV9YaynM6mYneDWnjX7Y4lKulcmsLSrm
>>>> CLtUCRtvdcTtfzv_ue3g5DmgXBkjR_8Luu0HObwr794kKqnFlccg9v4JIAY5D_zUpmR
>>>> mKnPad6ShFCtdtPB6mk9zBfoJW4nevTj7Px-Q-o5A36mNFvMrTvYpxU_SN4F9y2cOGN
>>>> Zbtds1E0DMJOoZ0Hrfet/http%3A%2F%2Fshapeblue.com%2Fcloudstack-infras
>>>> tructure-support%2F>
>>>>>>> CloudStack Bootcamp Training Courses<
>>>> http://secure-web.cisco.com/1yyoWAza2R5RJxAKPWNvNlAozMLTe92z8HcDFZi
>>>> 2AKQhkBav7eUQ1N4zW09YOu7OloxabENBu0z46u5BNqAgnwk4htVWz-HuKqP1jMckmR
>>>> EETqaN9bxh_LdWFT_SeHUeMnugn_d_r-2gU29BEFII9uZXW7SUbcultS7y9Tbr-mraH
>>>> 7LCCpna9AkXwqCMdLJ6c/http%3A%2F%2Fshapeblue.com%2Fcloudstack-traini
>>>> ng%2F>
>>>>>>>
>>>>>>> This email and any attachments to it may be confidential and are
>>>> intended solely for the use of the individual to whom it is addressed.
>> Any
>>>> views or opinions expressed are solely those of the author and do
>>>> not necessarily represent those of Shape Blue Ltd or related
>>>> companies. If
>> you
>>>> are not the intended recipient of this email, you must neither take
>>>> any action based upon its contents, nor copy or show it to anyone.
>>>> Please contact the sender if you believe you have received this email in error.
>>>> Shape Blue Ltd is a company incorporated in England & Wales.
>>>> ShapeBlue Services India LLP is a company incorporated in India and
>>>> is operated
>> under
>>>> license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is
>>>> a company incorporated in Brasil and is operated under license from
>>>> Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The
>>>> Republic
>> of
>>>> South Africa and is traded under license from Shape Blue Ltd.
>>>> ShapeBlue
>> is
>>>> a registered trademark.
>>>>>>
>>>>>> Find out more about ShapeBlue and our range of CloudStack related
>>>> services
>>>>>>
>>>>>> IaaS Cloud Design & Build<
>>>> http://secure-web.cisco.com/1pHXa6i2ZxbTOD2YXCa6-c3x2dmzvOCAO7sBNrn
>>>> kLXSQymtVtK2camOyotDd30Er1Nv2cLCRcXANhkRKDgTT7O62LQHevV4v385DJAE5OB
>>>> Iwid5XAuJ2LbMh28DLqFVuAVDwzsu5Or_LlLENaeL6OI8fe9ZboxEgpUPOdEvASu9b9
>>>> GLhtExooMnpBFJu9djSv/http%3A%2F%2Fshapeblue.com%2Fiaas-cloud-design
>>>> -and-build%2F%2F>
>>>>>> CSForge – rapid IaaS deployment framework<
>> http://secure-web.cisco.com/1GzQXJW5Hxcq5XoMtkxCquPsSSjy4bvBt1iMU3yVs6
>> zaCVcWYlRUjETJ_ziloxcBQXrSfIREcJO0KXaZTXoGSGuhrlGNG_uU92QNZxbIZ_nY2Lln
>> 0S3r1qaYRNXA-OiQQm8kvWRQWZUI8JxVfiJ_GPmRB462wgvvvm4h0ywEAHEVlV0b-4daKn
>> lmPw50KUZD2/http%3A%2F%2Fshapeblue.com%2Fcsforge%2F
>>>>>
>>>>>> CloudStack
>>>>>> Consulting<http://secure-web.cisco.com/1GXeDjw2Umr-XP9XXMKFefUuyH
>>>>>> aoEAFH2C24w17S6UukIHMtPURriARhRUVilcpixurdOtbT5hmYT9fXBiq3x-6nzhy
>>>>>> 5Ys7pfxDhnjGXzMwVtXXcmA-W2A3oEj7yQnkgFQ1RiCI75gXRMVRLAXFMu36L22Fc
>>>>>> SUA06sSzHb4ek7eNDoJaMGJwGZeYJLl9Kw4ys/http%3A%2F%2Fshapeblue.com%
>>>>>> 2Fcloudstack-consultancy%2F>
>>>>>> CloudStack Software Engineering<
>>>> http://secure-web.cisco.com/1WrrxNiZxulr07uJLK8qKuuXqQLFPC1Pvl1LVxL
>>>> _IIrKz6RXN8VGupjBCp8M1ErBixV8s3hm_f1LXy2sEzeveDuWgvboEKYmXOTVfSeIwE
>>>> LgdxkafGC6uu-3iwYWoKVql7VxJ9YRfJAfDGOGlBNL_kdBz4xTVnqAKyOBoM5lDhAms
>>>> FKCKRyCE-h_0qQly8Gag/http%3A%2F%2Fshapeblue.com%2Fcloudstack-softwa
>>>> re-engineering%2F>
>>>>>> CloudStack Infrastructure Support<
>>>> http://secure-web.cisco.com/1_jTQB3WV9YaynM6mYneDWnjX7Y4lKulcmsLSrm
>>>> CLtUCRtvdcTtfzv_ue3g5DmgXBkjR_8Luu0HObwr794kKqnFlccg9v4JIAY5D_zUpmR
>>>> mKnPad6ShFCtdtPB6mk9zBfoJW4nevTj7Px-Q-o5A36mNFvMrTvYpxU_SN4F9y2cOGN
>>>> Zbtds1E0DMJOoZ0Hrfet/http%3A%2F%2Fshapeblue.com%2Fcloudstack-infras
>>>> tructure-support%2F>
>>>>>> CloudStack Bootcamp Training Courses<
>>>> http://secure-web.cisco.com/1yyoWAza2R5RJxAKPWNvNlAozMLTe92z8HcDFZi
>>>> 2AKQhkBav7eUQ1N4zW09YOu7OloxabENBu0z46u5BNqAgnwk4htVWz-HuKqP1jMckmR
>>>> EETqaN9bxh_LdWFT_SeHUeMnugn_d_r-2gU29BEFII9uZXW7SUbcultS7y9Tbr-mraH
>>>> 7LCCpna9AkXwqCMdLJ6c/http%3A%2F%2Fshapeblue.com%2Fcloudstack-traini
>>>> ng%2F>
>>>>>>
>>>>>> This email and any attachments to it may be confidential and are
>>>> intended solely for the use of the individual to whom it is addressed.
>> Any
>>>> views or opinions expressed are solely those of the author and do
>>>> not necessarily represent those of Shape Blue Ltd or related
>>>> companies. If
>> you
>>>> are not the intended recipient of this email, you must neither take
>>>> any action based upon its contents, nor copy or show it to anyone.
>>>> Please contact the sender if you believe you have received this email in error.
>>>> Shape Blue Ltd is a company incorporated in England & Wales.
>>>> ShapeBlue Services India LLP is a company incorporated in India and
>>>> is operated
>> under
>>>> license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is
>>>> a company incorporated in Brasil and is operated under license from
>>>> Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The
>>>> Republic
>> of
>>>> South Africa and is traded under license from Shape Blue Ltd.
>>>> ShapeBlue
>> is
>>>> a registered trademark.
>>>>
>>
>> Find out more about ShapeBlue and our range of CloudStack related
>> services
>>
>> IaaS Cloud Design & Build<
>> http://secure-web.cisco.com/1pHXa6i2ZxbTOD2YXCa6-c3x2dmzvOCAO7sBNrnkLX
>> SQymtVtK2camOyotDd30Er1Nv2cLCRcXANhkRKDgTT7O62LQHevV4v385DJAE5OBIwid5X
>> AuJ2LbMh28DLqFVuAVDwzsu5Or_LlLENaeL6OI8fe9ZboxEgpUPOdEvASu9b9GLhtExooM
>> npBFJu9djSv/http%3A%2F%2Fshapeblue.com%2Fiaas-cloud-design-and-build%2
>> F%2F> CSForge – rapid IaaS deployment
>> framework<http://secure-web.cisco.com/1GzQXJW5Hxcq5XoMtkxCquPsSSjy4bvB
>> t1iMU3yVs6zaCVcWYlRUjETJ_ziloxcBQXrSfIREcJO0KXaZTXoGSGuhrlGNG_uU92QNZx
>> bIZ_nY2Lln0S3r1qaYRNXA-OiQQm8kvWRQWZUI8JxVfiJ_GPmRB462wgvvvm4h0ywEAHEV
>> lV0b-4daKnlmPw50KUZD2/http%3A%2F%2Fshapeblue.com%2Fcsforge%2F>
>> CloudStack
>> Consulting<http://secure-web.cisco.com/1GXeDjw2Umr-XP9XXMKFefUuyHaoEAF
>> H2C24w17S6UukIHMtPURriARhRUVilcpixurdOtbT5hmYT9fXBiq3x-6nzhy5Ys7pfxDhn
>> jGXzMwVtXXcmA-W2A3oEj7yQnkgFQ1RiCI75gXRMVRLAXFMu36L22FcSUA06sSzHb4ek7e
>> NDoJaMGJwGZeYJLl9Kw4ys/http%3A%2F%2Fshapeblue.com%2Fcloudstack-consult
>> ancy%2F>
>> CloudStack Software Engineering<
>> http://secure-web.cisco.com/1WrrxNiZxulr07uJLK8qKuuXqQLFPC1Pvl1LVxL_II
>> rKz6RXN8VGupjBCp8M1ErBixV8s3hm_f1LXy2sEzeveDuWgvboEKYmXOTVfSeIwELgdxka
>> fGC6uu-3iwYWoKVql7VxJ9YRfJAfDGOGlBNL_kdBz4xTVnqAKyOBoM5lDhAmsFKCKRyCE-
>> h_0qQly8Gag/http%3A%2F%2Fshapeblue.com%2Fcloudstack-software-engineeri
>> ng%2F>
>> CloudStack Infrastructure Support<
>> http://secure-web.cisco.com/1_jTQB3WV9YaynM6mYneDWnjX7Y4lKulcmsLSrmCLt
>> UCRtvdcTtfzv_ue3g5DmgXBkjR_8Luu0HObwr794kKqnFlccg9v4JIAY5D_zUpmRmKnPad
>> 6ShFCtdtPB6mk9zBfoJW4nevTj7Px-Q-o5A36mNFvMrTvYpxU_SN4F9y2cOGNZbtds1E0D
>> MJOoZ0Hrfet/http%3A%2F%2Fshapeblue.com%2Fcloudstack-infrastructure-sup
>> port%2F>
>> CloudStack Bootcamp Training Courses<
>> http://secure-web.cisco.com/1yyoWAza2R5RJxAKPWNvNlAozMLTe92z8HcDFZi2AK
>> QhkBav7eUQ1N4zW09YOu7OloxabENBu0z46u5BNqAgnwk4htVWz-HuKqP1jMckmREETqaN
>> 9bxh_LdWFT_SeHUeMnugn_d_r-2gU29BEFII9uZXW7SUbcultS7y9Tbr-mraH7LCCpna9A
>> kXwqCMdLJ6c/http%3A%2F%2Fshapeblue.com%2Fcloudstack-training%2F>
>>
>> This email and any attachments to it may be confidential and are
>> intended solely for the use of the individual to whom it is addressed.
>> Any views or opinions expressed are solely those of the author and do
>> not necessarily represent those of Shape Blue Ltd or related
>> companies. If you are not the intended recipient of this email, you
>> must neither take any action based upon its contents, nor copy or show
>> it to anyone. Please contact the sender if you believe you have
>> received this email in error. Shape Blue Ltd is a company incorporated
>> in England & Wales. ShapeBlue Services India LLP is a company
>> incorporated in India and is operated under license from Shape Blue
>> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in
>> Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA
>> Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>

This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.

RE: marvin test cases + travis

Posted by Raja Pullela <ra...@citrix.com>.
-1 for the time... 
since these tests run independently if we can spawn more threads/vms to bring down the run time, that will be good.
Another thing that can be looked at the run only tests in SMOKE folder.   
BTW, more tests in  "SMOKE"  should be added on a continuous basis.

-----Original Message-----
From: Rajani Karuturi [mailto:rajani@apache.org] 
Sent: Friday, May 1, 2015 11:09 PM
To: dev@cloudstack.apache.org
Subject: Re: marvin test cases + travis

-1 on increasing the time
As a reviewer, I would like an immediate response on a pull request. By the time I review the code, if CI gives a +1(or -1) I can close the PR then and there instead of coming back again to merge.

I would suggest running all the jobs under 30 min and increasing the number of parallel jobs as much as possible. we are running 10 jobs now. may be we could increase this to 15(dont know if this is possible)

we should aim to run only the smoke tests and not the entire regression suite always.

Making the jobs run on containers will speed them up. This needs some work on removing the sudo dependency on the jobs (which is required to install some additional packages and marvin).

~Rajani

On Fri, May 1, 2015 at 8:25 AM, Abhinandan Prateek < abhinandan.prateek@shapeblue.com> wrote:

> +1 for increased timeouts.
>
> At the moment we get less than 24 commits per day on master. Only a 
> couple on other branches per day.
> We can increase the timeout to upto 70 minutes or more. Will try to 
> ensure that in general a single run does not take more than an hour.
>
> A timeout window slightly higher will ensure that we do not see 
> timeout failures.
>
> > On 30-Apr-2015, at 11:25 pm, Daan Hoogland <da...@gmail.com>
> wrote:
> >
> > Travis is starting to indue the, 'oh,  a timeout again' - blindness 
> > in
> me.
> > Let's put a safe time on it.  A result should mean something and 
> > those
> time
> > out are like the (decreasing) abundance of Jenkins failures.
> >
> > So +1 for increasing the time
> >
> > On Thu, 30 Apr 2015 18:46 Ian Duffy <ia...@ianduffy.ie> wrote:
> >
> >>> Do we need to ask for an increase in run time?
> >>
> >> From my experience I wouldn't say its required however *it would be 
> >> very nice*.
> >> At the moment what we do is create new parallel jobs and balance 
> >> the tests across them so each job is under 50mins.
> >>
> >> Anywho, just my 2c, see what others say/think.
> >>
> >> On 30 April 2015 at 17:34, David Nalley <da...@gnsa.us> wrote:
> >>> Do we need to ask for an increase in run time?
> >>> 50 minutes is the OSS default, but the ASF is a paying customer 
> >>> and we can ask for longer timeouts.
> >>>
> >>> --David
> >>>
> >>> On Thu, Apr 30, 2015 at 10:06 AM, Abhinandan Prateek 
> >>> <ab...@shapeblue.com> wrote:
> >>>> One of the run did timeout. Will balance the runs.
> >>>>
> >>>>> On 30-Apr-2015, at 5:59 pm, Abhinandan Prateek <
> >> abhinandan.prateek@shapeblue.com> wrote:
> >>>>>
> >>>>> Yes, thanks for checking. I was worried that now some of them 
> >>>>> may
> >> start timing out.
> >>>>> I have another 10 suites tested, will add them once everything 
> >>>>> seems
> >> fine.
> >>>>>
> >>>>> -abhi
> >>>>>
> >>>>>
> >>>>>> On 30-Apr-2015, at 5:32 pm, Rajani Karuturi <ra...@apache.org>
> >> wrote:
> >>>>>>
> >>>>>> after correcting the test file path, its working fine
> >>>>>>
> >>>>>> https://travis-ci.org/karuturi/cloudstack/jobs/60681263
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>> ~Rajani
> >>>>>>
> >>>>>> On Thu, Apr 30, 2015 at 4:51 PM, Rajani Karuturi 
> >>>>>> <rajani@apache.org
> >
> >> wrote:
> >>>>>>
> >>>>>>> I think its due to this commit
> >>>>>>>
> >>>>>>>
> >>
> https://github.com/apache/cloudstack/commit/b941480e0df0bfa3377e797126
> b96cf9b3fbee77
> >>>>>>>
> >>>>>>> Here, test file name is changed from testname to
> >> [smoke,component]/testname
> >>>>>>>
> >>>>>>> But, while running each test file in the for loop, it prepends 
> >>>>>>> the
> >> name
> >>>>>>> with smoke and hence, it cant find the file and none of the 
> >>>>>>> tests
> in
> >> the
> >>>>>>> file are run
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>> ~Rajani
> >>>>>>>
> >>>>>>> On Thu, Apr 30, 2015 at 4:37 PM, Abhinandan Prateek < 
> >>>>>>> abhinandan.prateek@shapeblue.com> wrote:
> >>>>>>>
> >>>>>>>> It is possible, I will check.
> >>>>>>>>
> >>>>>>>>> On 30-Apr-2015, at 3:43 pm, Rajani Karuturi 
> >>>>>>>>> <ra...@apache.org>
> >> wrote:
> >>>>>>>>>
> >>>>>>>>> Hey Abhi,
> >>>>>>>>>
> >>>>>>>>> In the recent travis runs, its not printing the test case in
> >> output (
> >>>>>>>>> https://travis-ci.org/apache/cloudstack/jobs/60634577#L5443)
> >>>>>>>>>
> >>>>>>>>> It used to print the test case name and status (
> >>>>>>>>> https://travis-ci.org/apache/cloudstack/jobs/59958134#L4205)
> >>>>>>>>>
> >>>>>>>>> Do you think it can be due to any recent changes?
> >>>>>>>>>
> >>>>>>>>> ~Rajani
> >>>>>>>>>
> >>>>>>>>> On Thu, Apr 30, 2015 at 10:32 AM, Abhinandan Prateek < 
> >>>>>>>>> abhinandan.prateek@shapeblue.com> wrote:
> >>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> There are more than 10 additional suites that can still be
> >> included
> >>>>>>>> to
> >>>>>>>>>> the travis-CI.
> >>>>>>>>>> Since the current set runs comfortably I will go ahead and 
> >>>>>>>>>> add
> >> more. If
> >>>>>>>>>> the system gets overloaded, then we can balance the kind of 
> >>>>>>>>>> test
> >>>>>>>> suites and
> >>>>>>>>>> amount of test suits that run comfortably on travis.
> >>>>>>>>>>
> >>>>>>>>>> -abhi
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> Find out more about ShapeBlue and our range of CloudStack
> related
> >>>>>>>> services
> >>>>>>>>>>
> >>>>>>>>>> IaaS Cloud Design & Build<
> >>>>>>>>>> http://secure-web.cisco.com/1pHXa6i2ZxbTOD2YXCa6-c3x2dmzvOC
> >>>>>>>>>> AO7sBNrnkLXSQymtVtK2camOyotDd30Er1Nv2cLCRcXANhkRKDgTT7O62LQ
> >>>>>>>>>> HevV4v385DJAE5OBIwid5XAuJ2LbMh28DLqFVuAVDwzsu5Or_LlLENaeL6O
> >>>>>>>>>> I8fe9ZboxEgpUPOdEvASu9b9GLhtExooMnpBFJu9djSv/http%3A%2F%2Fs
> >>>>>>>>>> hapeblue.com%2Fiaas-cloud-design-and-build%2F%2F>
> >>>>>>>>>> CSForge – rapid IaaS deployment framework<
> >>>>>>>> http://secure-web.cisco.com/1GzQXJW5Hxcq5XoMtkxCquPsSSjy4bvBt
> >>>>>>>> 1iMU3yVs6zaCVcWYlRUjETJ_ziloxcBQXrSfIREcJO0KXaZTXoGSGuhrlGNG_
> >>>>>>>> uU92QNZxbIZ_nY2Lln0S3r1qaYRNXA-OiQQm8kvWRQWZUI8JxVfiJ_GPmRB46
> >>>>>>>> 2wgvvvm4h0ywEAHEVlV0b-4daKnlmPw50KUZD2/http%3A%2F%2Fshapeblue
> >>>>>>>> .com%2Fcsforge%2F>
> >>>>>>>>>> CloudStack Consulting<
> >> http://secure-web.cisco.com/1GXeDjw2Umr-XP9XXMKFefUuyHaoEAFH2C24w17
> >> S6UukIHMtPURriARhRUVilcpixurdOtbT5hmYT9fXBiq3x-6nzhy5Ys7pfxDhnjGXzM
> >> wVtXXcmA-W2A3oEj7yQnkgFQ1RiCI75gXRMVRLAXFMu36L22FcSUA06sSzHb4ek7eND
> >> oJaMGJwGZeYJLl9Kw4ys/http%3A%2F%2Fshapeblue.com%2Fcloudstack-consul
> >> tancy%2F>
> >>>>>>>>>> CloudStack Software Engineering< 
> >>>>>>>>>> http://secure-web.cisco.com/1WrrxNiZxulr07uJLK8qKuuXqQLFPC1
> >>>>>>>>>> Pvl1LVxL_IIrKz6RXN8VGupjBCp8M1ErBixV8s3hm_f1LXy2sEzeveDuWgv
> >>>>>>>>>> boEKYmXOTVfSeIwELgdxkafGC6uu-3iwYWoKVql7VxJ9YRfJAfDGOGlBNL_
> >>>>>>>>>> kdBz4xTVnqAKyOBoM5lDhAmsFKCKRyCE-h_0qQly8Gag/http%3A%2F%2Fs
> >>>>>>>>>> hapeblue.com%2Fcloudstack-software-engineering%2F>
> >>>>>>>>>> CloudStack Infrastructure Support< 
> >>>>>>>>>> http://secure-web.cisco.com/1_jTQB3WV9YaynM6mYneDWnjX7Y4lKu
> >>>>>>>>>> lcmsLSrmCLtUCRtvdcTtfzv_ue3g5DmgXBkjR_8Luu0HObwr794kKqnFlcc
> >>>>>>>>>> g9v4JIAY5D_zUpmRmKnPad6ShFCtdtPB6mk9zBfoJW4nevTj7Px-Q-o5A36
> >>>>>>>>>> mNFvMrTvYpxU_SN4F9y2cOGNZbtds1E0DMJOoZ0Hrfet/http%3A%2F%2Fs
> >>>>>>>>>> hapeblue.com%2Fcloudstack-infrastructure-support%2F>
> >>>>>>>>>> CloudStack Bootcamp Training Courses< 
> >>>>>>>>>> http://secure-web.cisco.com/1yyoWAza2R5RJxAKPWNvNlAozMLTe92
> >>>>>>>>>> z8HcDFZi2AKQhkBav7eUQ1N4zW09YOu7OloxabENBu0z46u5BNqAgnwk4ht
> >>>>>>>>>> VWz-HuKqP1jMckmREETqaN9bxh_LdWFT_SeHUeMnugn_d_r-2gU29BEFII9
> >>>>>>>>>> uZXW7SUbcultS7y9Tbr-mraH7LCCpna9AkXwqCMdLJ6c/http%3A%2F%2Fs
> >>>>>>>>>> hapeblue.com%2Fcloudstack-training%2F>
> >>>>>>>>>>
> >>>>>>>>>> This email and any attachments to it may be confidential 
> >>>>>>>>>> and are
> >>>>>>>> intended
> >>>>>>>>>> solely for the use of the individual to whom it is addressed.
> Any
> >>>>>>>> views or
> >>>>>>>>>> opinions expressed are solely those of the author and do 
> >>>>>>>>>> not
> >>>>>>>> necessarily
> >>>>>>>>>> represent those of Shape Blue Ltd or related companies. If 
> >>>>>>>>>> you
> >> are not
> >>>>>>>> the
> >>>>>>>>>> intended recipient of this email, you must neither take any
> action
> >>>>>>>> based
> >>>>>>>>>> upon its contents, nor copy or show it to anyone. Please 
> >>>>>>>>>> contact
> >> the
> >>>>>>>> sender
> >>>>>>>>>> if you believe you have received this email in error. Shape 
> >>>>>>>>>> Blue
> >> Ltd
> >>>>>>>> is a
> >>>>>>>>>> company incorporated in England & Wales. ShapeBlue Services
> India
> >> LLP
> >>>>>>>> is a
> >>>>>>>>>> company incorporated in India and is operated under license 
> >>>>>>>>>> from
> >> Shape
> >>>>>>>> Blue
> >>>>>>>>>> Ltd. Shape Blue Brasil Consultoria Ltda is a company
> incorporated
> >> in
> >>>>>>>> Brasil
> >>>>>>>>>> and is operated under license from Shape Blue Ltd. 
> >>>>>>>>>> ShapeBlue SA
> >> Pty
> >>>>>>>> Ltd is
> >>>>>>>>>> a company registered by The Republic of South Africa and is
> traded
> >>>>>>>> under
> >>>>>>>>>> license from Shape Blue Ltd. ShapeBlue is a registered
> trademark.
> >>>>>>>>>>
> >>>>>>>>
> >>>>>>>> Find out more about ShapeBlue and our range of CloudStack 
> >>>>>>>> related
> >> services
> >>>>>>>>
> >>>>>>>> IaaS Cloud Design & Build<
> >>>>>>>> http://secure-web.cisco.com/1pHXa6i2ZxbTOD2YXCa6-c3x2dmzvOCAO
> >>>>>>>> 7sBNrnkLXSQymtVtK2camOyotDd30Er1Nv2cLCRcXANhkRKDgTT7O62LQHevV
> >>>>>>>> 4v385DJAE5OBIwid5XAuJ2LbMh28DLqFVuAVDwzsu5Or_LlLENaeL6OI8fe9Z
> >>>>>>>> boxEgpUPOdEvASu9b9GLhtExooMnpBFJu9djSv/http%3A%2F%2Fshapeblue
> >>>>>>>> .com%2Fiaas-cloud-design-and-build%2F%2F>
> >>>>>>>> CSForge – rapid IaaS deployment framework<
> >> http://secure-web.cisco.com/1GzQXJW5Hxcq5XoMtkxCquPsSSjy4bvBt1iMU3y
> >> Vs6zaCVcWYlRUjETJ_ziloxcBQXrSfIREcJO0KXaZTXoGSGuhrlGNG_uU92QNZxbIZ_
> >> nY2Lln0S3r1qaYRNXA-OiQQm8kvWRQWZUI8JxVfiJ_GPmRB462wgvvvm4h0ywEAHEVl
> >> V0b-4daKnlmPw50KUZD2/http%3A%2F%2Fshapeblue.com%2Fcsforge%2F>
> >>>>>>>> CloudStack Consulting<
> http://secure-web.cisco.com/1GXeDjw2Umr-XP9XXMKFefUuyHaoEAFH2C24w17S6U
> ukIHMtPURriARhRUVilcpixurdOtbT5hmYT9fXBiq3x-6nzhy5Ys7pfxDhnjGXzMwVtXXc
> mA-W2A3oEj7yQnkgFQ1RiCI75gXRMVRLAXFMu36L22FcSUA06sSzHb4ek7eNDoJaMGJwGZ
> eYJLl9Kw4ys/http%3A%2F%2Fshapeblue.com%2Fcloudstack-consultancy%2F>
> >>>>>>>> CloudStack Software Engineering< 
> >>>>>>>> http://secure-web.cisco.com/1WrrxNiZxulr07uJLK8qKuuXqQLFPC1Pv
> >>>>>>>> l1LVxL_IIrKz6RXN8VGupjBCp8M1ErBixV8s3hm_f1LXy2sEzeveDuWgvboEK
> >>>>>>>> YmXOTVfSeIwELgdxkafGC6uu-3iwYWoKVql7VxJ9YRfJAfDGOGlBNL_kdBz4x
> >>>>>>>> TVnqAKyOBoM5lDhAmsFKCKRyCE-h_0qQly8Gag/http%3A%2F%2Fshapeblue
> >>>>>>>> .com%2Fcloudstack-software-engineering%2F>
> >>>>>>>> CloudStack Infrastructure Support< 
> >>>>>>>> http://secure-web.cisco.com/1_jTQB3WV9YaynM6mYneDWnjX7Y4lKulc
> >>>>>>>> msLSrmCLtUCRtvdcTtfzv_ue3g5DmgXBkjR_8Luu0HObwr794kKqnFlccg9v4
> >>>>>>>> JIAY5D_zUpmRmKnPad6ShFCtdtPB6mk9zBfoJW4nevTj7Px-Q-o5A36mNFvMr
> >>>>>>>> TvYpxU_SN4F9y2cOGNZbtds1E0DMJOoZ0Hrfet/http%3A%2F%2Fshapeblue
> >>>>>>>> .com%2Fcloudstack-infrastructure-support%2F>
> >>>>>>>> CloudStack Bootcamp Training Courses< 
> >>>>>>>> http://secure-web.cisco.com/1yyoWAza2R5RJxAKPWNvNlAozMLTe92z8
> >>>>>>>> HcDFZi2AKQhkBav7eUQ1N4zW09YOu7OloxabENBu0z46u5BNqAgnwk4htVWz-
> >>>>>>>> HuKqP1jMckmREETqaN9bxh_LdWFT_SeHUeMnugn_d_r-2gU29BEFII9uZXW7S
> >>>>>>>> UbcultS7y9Tbr-mraH7LCCpna9AkXwqCMdLJ6c/http%3A%2F%2Fshapeblue
> >>>>>>>> .com%2Fcloudstack-training%2F>
> >>>>>>>>
> >>>>>>>> This email and any attachments to it may be confidential and 
> >>>>>>>> are
> >> intended
> >>>>>>>> solely for the use of the individual to whom it is addressed. 
> >>>>>>>> Any
> >> views or
> >>>>>>>> opinions expressed are solely those of the author and do not
> >> necessarily
> >>>>>>>> represent those of Shape Blue Ltd or related companies. If 
> >>>>>>>> you are
> >> not the
> >>>>>>>> intended recipient of this email, you must neither take any 
> >>>>>>>> action
> >> based
> >>>>>>>> upon its contents, nor copy or show it to anyone. Please 
> >>>>>>>> contact
> >> the sender
> >>>>>>>> if you believe you have received this email in error. Shape 
> >>>>>>>> Blue
> >> Ltd is a
> >>>>>>>> company incorporated in England & Wales. ShapeBlue Services 
> >>>>>>>> India
> >> LLP is a
> >>>>>>>> company incorporated in India and is operated under license 
> >>>>>>>> from
> >> Shape Blue
> >>>>>>>> Ltd. Shape Blue Brasil Consultoria Ltda is a company 
> >>>>>>>> incorporated
> >> in Brasil
> >>>>>>>> and is operated under license from Shape Blue Ltd. ShapeBlue 
> >>>>>>>> SA
> Pty
> >> Ltd is
> >>>>>>>> a company registered by The Republic of South Africa and is 
> >>>>>>>> traded
> >> under
> >>>>>>>> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
> >>>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>
> >>>>> Find out more about ShapeBlue and our range of CloudStack 
> >>>>> related
> >> services
> >>>>>
> >>>>> IaaS Cloud Design & Build<
> >> http://secure-web.cisco.com/1pHXa6i2ZxbTOD2YXCa6-c3x2dmzvOCAO7sBNrn
> >> kLXSQymtVtK2camOyotDd30Er1Nv2cLCRcXANhkRKDgTT7O62LQHevV4v385DJAE5OB
> >> Iwid5XAuJ2LbMh28DLqFVuAVDwzsu5Or_LlLENaeL6OI8fe9ZboxEgpUPOdEvASu9b9
> >> GLhtExooMnpBFJu9djSv/http%3A%2F%2Fshapeblue.com%2Fiaas-cloud-design
> >> -and-build%2F%2F>
> >>>>> CSForge – rapid IaaS deployment framework<
> >> http://secure-web.cisco.com/1GzQXJW5Hxcq5XoMtkxCquPsSSjy4bvBt1iMU3y
> >> Vs6zaCVcWYlRUjETJ_ziloxcBQXrSfIREcJO0KXaZTXoGSGuhrlGNG_uU92QNZxbIZ_
> >> nY2Lln0S3r1qaYRNXA-OiQQm8kvWRQWZUI8JxVfiJ_GPmRB462wgvvvm4h0ywEAHEVl
> >> V0b-4daKnlmPw50KUZD2/http%3A%2F%2Fshapeblue.com%2Fcsforge%2F>
> >>>>> CloudStack 
> >>>>> Consulting<http://secure-web.cisco.com/1GXeDjw2Umr-XP9XXMKFefUuy
> >>>>> HaoEAFH2C24w17S6UukIHMtPURriARhRUVilcpixurdOtbT5hmYT9fXBiq3x-6nz
> >>>>> hy5Ys7pfxDhnjGXzMwVtXXcmA-W2A3oEj7yQnkgFQ1RiCI75gXRMVRLAXFMu36L2
> >>>>> 2FcSUA06sSzHb4ek7eNDoJaMGJwGZeYJLl9Kw4ys/http%3A%2F%2Fshapeblue.
> >>>>> com%2Fcloudstack-consultancy%2F> CloudStack Software 
> >>>>> Engineering<
> >> http://secure-web.cisco.com/1WrrxNiZxulr07uJLK8qKuuXqQLFPC1Pvl1LVxL
> >> _IIrKz6RXN8VGupjBCp8M1ErBixV8s3hm_f1LXy2sEzeveDuWgvboEKYmXOTVfSeIwE
> >> LgdxkafGC6uu-3iwYWoKVql7VxJ9YRfJAfDGOGlBNL_kdBz4xTVnqAKyOBoM5lDhAms
> >> FKCKRyCE-h_0qQly8Gag/http%3A%2F%2Fshapeblue.com%2Fcloudstack-softwa
> >> re-engineering%2F>
> >>>>> CloudStack Infrastructure Support<
> >> http://secure-web.cisco.com/1_jTQB3WV9YaynM6mYneDWnjX7Y4lKulcmsLSrm
> >> CLtUCRtvdcTtfzv_ue3g5DmgXBkjR_8Luu0HObwr794kKqnFlccg9v4JIAY5D_zUpmR
> >> mKnPad6ShFCtdtPB6mk9zBfoJW4nevTj7Px-Q-o5A36mNFvMrTvYpxU_SN4F9y2cOGN
> >> Zbtds1E0DMJOoZ0Hrfet/http%3A%2F%2Fshapeblue.com%2Fcloudstack-infras
> >> tructure-support%2F>
> >>>>> CloudStack Bootcamp Training Courses<
> >> http://secure-web.cisco.com/1yyoWAza2R5RJxAKPWNvNlAozMLTe92z8HcDFZi
> >> 2AKQhkBav7eUQ1N4zW09YOu7OloxabENBu0z46u5BNqAgnwk4htVWz-HuKqP1jMckmR
> >> EETqaN9bxh_LdWFT_SeHUeMnugn_d_r-2gU29BEFII9uZXW7SUbcultS7y9Tbr-mraH
> >> 7LCCpna9AkXwqCMdLJ6c/http%3A%2F%2Fshapeblue.com%2Fcloudstack-traini
> >> ng%2F>
> >>>>>
> >>>>> This email and any attachments to it may be confidential and are
> >> intended solely for the use of the individual to whom it is addressed.
> Any
> >> views or opinions expressed are solely those of the author and do 
> >> not necessarily represent those of Shape Blue Ltd or related 
> >> companies. If
> you
> >> are not the intended recipient of this email, you must neither take 
> >> any action based upon its contents, nor copy or show it to anyone. 
> >> Please contact the sender if you believe you have received this email in error.
> >> Shape Blue Ltd is a company incorporated in England & Wales. 
> >> ShapeBlue Services India LLP is a company incorporated in India and 
> >> is operated
> under
> >> license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is 
> >> a company incorporated in Brasil and is operated under license from 
> >> Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The 
> >> Republic
> of
> >> South Africa and is traded under license from Shape Blue Ltd. 
> >> ShapeBlue
> is
> >> a registered trademark.
> >>>>
> >>>> Find out more about ShapeBlue and our range of CloudStack related
> >> services
> >>>>
> >>>> IaaS Cloud Design & Build<
> >> http://secure-web.cisco.com/1pHXa6i2ZxbTOD2YXCa6-c3x2dmzvOCAO7sBNrn
> >> kLXSQymtVtK2camOyotDd30Er1Nv2cLCRcXANhkRKDgTT7O62LQHevV4v385DJAE5OB
> >> Iwid5XAuJ2LbMh28DLqFVuAVDwzsu5Or_LlLENaeL6OI8fe9ZboxEgpUPOdEvASu9b9
> >> GLhtExooMnpBFJu9djSv/http%3A%2F%2Fshapeblue.com%2Fiaas-cloud-design
> >> -and-build%2F%2F>
> >>>> CSForge – rapid IaaS deployment framework<
> http://secure-web.cisco.com/1GzQXJW5Hxcq5XoMtkxCquPsSSjy4bvBt1iMU3yVs6
> zaCVcWYlRUjETJ_ziloxcBQXrSfIREcJO0KXaZTXoGSGuhrlGNG_uU92QNZxbIZ_nY2Lln
> 0S3r1qaYRNXA-OiQQm8kvWRQWZUI8JxVfiJ_GPmRB462wgvvvm4h0ywEAHEVlV0b-4daKn
> lmPw50KUZD2/http%3A%2F%2Fshapeblue.com%2Fcsforge%2F
> >>>
> >>>> CloudStack 
> >>>> Consulting<http://secure-web.cisco.com/1GXeDjw2Umr-XP9XXMKFefUuyH
> >>>> aoEAFH2C24w17S6UukIHMtPURriARhRUVilcpixurdOtbT5hmYT9fXBiq3x-6nzhy
> >>>> 5Ys7pfxDhnjGXzMwVtXXcmA-W2A3oEj7yQnkgFQ1RiCI75gXRMVRLAXFMu36L22Fc
> >>>> SUA06sSzHb4ek7eNDoJaMGJwGZeYJLl9Kw4ys/http%3A%2F%2Fshapeblue.com%
> >>>> 2Fcloudstack-consultancy%2F>
> >>>> CloudStack Software Engineering<
> >> http://secure-web.cisco.com/1WrrxNiZxulr07uJLK8qKuuXqQLFPC1Pvl1LVxL
> >> _IIrKz6RXN8VGupjBCp8M1ErBixV8s3hm_f1LXy2sEzeveDuWgvboEKYmXOTVfSeIwE
> >> LgdxkafGC6uu-3iwYWoKVql7VxJ9YRfJAfDGOGlBNL_kdBz4xTVnqAKyOBoM5lDhAms
> >> FKCKRyCE-h_0qQly8Gag/http%3A%2F%2Fshapeblue.com%2Fcloudstack-softwa
> >> re-engineering%2F>
> >>>> CloudStack Infrastructure Support<
> >> http://secure-web.cisco.com/1_jTQB3WV9YaynM6mYneDWnjX7Y4lKulcmsLSrm
> >> CLtUCRtvdcTtfzv_ue3g5DmgXBkjR_8Luu0HObwr794kKqnFlccg9v4JIAY5D_zUpmR
> >> mKnPad6ShFCtdtPB6mk9zBfoJW4nevTj7Px-Q-o5A36mNFvMrTvYpxU_SN4F9y2cOGN
> >> Zbtds1E0DMJOoZ0Hrfet/http%3A%2F%2Fshapeblue.com%2Fcloudstack-infras
> >> tructure-support%2F>
> >>>> CloudStack Bootcamp Training Courses<
> >> http://secure-web.cisco.com/1yyoWAza2R5RJxAKPWNvNlAozMLTe92z8HcDFZi
> >> 2AKQhkBav7eUQ1N4zW09YOu7OloxabENBu0z46u5BNqAgnwk4htVWz-HuKqP1jMckmR
> >> EETqaN9bxh_LdWFT_SeHUeMnugn_d_r-2gU29BEFII9uZXW7SUbcultS7y9Tbr-mraH
> >> 7LCCpna9AkXwqCMdLJ6c/http%3A%2F%2Fshapeblue.com%2Fcloudstack-traini
> >> ng%2F>
> >>>>
> >>>> This email and any attachments to it may be confidential and are
> >> intended solely for the use of the individual to whom it is addressed.
> Any
> >> views or opinions expressed are solely those of the author and do 
> >> not necessarily represent those of Shape Blue Ltd or related 
> >> companies. If
> you
> >> are not the intended recipient of this email, you must neither take 
> >> any action based upon its contents, nor copy or show it to anyone. 
> >> Please contact the sender if you believe you have received this email in error.
> >> Shape Blue Ltd is a company incorporated in England & Wales. 
> >> ShapeBlue Services India LLP is a company incorporated in India and 
> >> is operated
> under
> >> license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is 
> >> a company incorporated in Brasil and is operated under license from 
> >> Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The 
> >> Republic
> of
> >> South Africa and is traded under license from Shape Blue Ltd. 
> >> ShapeBlue
> is
> >> a registered trademark.
> >>
>
> Find out more about ShapeBlue and our range of CloudStack related 
> services
>
> IaaS Cloud Design & Build<
> http://secure-web.cisco.com/1pHXa6i2ZxbTOD2YXCa6-c3x2dmzvOCAO7sBNrnkLX
> SQymtVtK2camOyotDd30Er1Nv2cLCRcXANhkRKDgTT7O62LQHevV4v385DJAE5OBIwid5X
> AuJ2LbMh28DLqFVuAVDwzsu5Or_LlLENaeL6OI8fe9ZboxEgpUPOdEvASu9b9GLhtExooM
> npBFJu9djSv/http%3A%2F%2Fshapeblue.com%2Fiaas-cloud-design-and-build%2
> F%2F> CSForge – rapid IaaS deployment 
> framework<http://secure-web.cisco.com/1GzQXJW5Hxcq5XoMtkxCquPsSSjy4bvB
> t1iMU3yVs6zaCVcWYlRUjETJ_ziloxcBQXrSfIREcJO0KXaZTXoGSGuhrlGNG_uU92QNZx
> bIZ_nY2Lln0S3r1qaYRNXA-OiQQm8kvWRQWZUI8JxVfiJ_GPmRB462wgvvvm4h0ywEAHEV
> lV0b-4daKnlmPw50KUZD2/http%3A%2F%2Fshapeblue.com%2Fcsforge%2F>
> CloudStack 
> Consulting<http://secure-web.cisco.com/1GXeDjw2Umr-XP9XXMKFefUuyHaoEAF
> H2C24w17S6UukIHMtPURriARhRUVilcpixurdOtbT5hmYT9fXBiq3x-6nzhy5Ys7pfxDhn
> jGXzMwVtXXcmA-W2A3oEj7yQnkgFQ1RiCI75gXRMVRLAXFMu36L22FcSUA06sSzHb4ek7e
> NDoJaMGJwGZeYJLl9Kw4ys/http%3A%2F%2Fshapeblue.com%2Fcloudstack-consult
> ancy%2F>
> CloudStack Software Engineering<
> http://secure-web.cisco.com/1WrrxNiZxulr07uJLK8qKuuXqQLFPC1Pvl1LVxL_II
> rKz6RXN8VGupjBCp8M1ErBixV8s3hm_f1LXy2sEzeveDuWgvboEKYmXOTVfSeIwELgdxka
> fGC6uu-3iwYWoKVql7VxJ9YRfJAfDGOGlBNL_kdBz4xTVnqAKyOBoM5lDhAmsFKCKRyCE-
> h_0qQly8Gag/http%3A%2F%2Fshapeblue.com%2Fcloudstack-software-engineeri
> ng%2F>
> CloudStack Infrastructure Support<
> http://secure-web.cisco.com/1_jTQB3WV9YaynM6mYneDWnjX7Y4lKulcmsLSrmCLt
> UCRtvdcTtfzv_ue3g5DmgXBkjR_8Luu0HObwr794kKqnFlccg9v4JIAY5D_zUpmRmKnPad
> 6ShFCtdtPB6mk9zBfoJW4nevTj7Px-Q-o5A36mNFvMrTvYpxU_SN4F9y2cOGNZbtds1E0D
> MJOoZ0Hrfet/http%3A%2F%2Fshapeblue.com%2Fcloudstack-infrastructure-sup
> port%2F>
> CloudStack Bootcamp Training Courses<
> http://secure-web.cisco.com/1yyoWAza2R5RJxAKPWNvNlAozMLTe92z8HcDFZi2AK
> QhkBav7eUQ1N4zW09YOu7OloxabENBu0z46u5BNqAgnwk4htVWz-HuKqP1jMckmREETqaN
> 9bxh_LdWFT_SeHUeMnugn_d_r-2gU29BEFII9uZXW7SUbcultS7y9Tbr-mraH7LCCpna9A
> kXwqCMdLJ6c/http%3A%2F%2Fshapeblue.com%2Fcloudstack-training%2F>
>
> This email and any attachments to it may be confidential and are 
> intended solely for the use of the individual to whom it is addressed. 
> Any views or opinions expressed are solely those of the author and do 
> not necessarily represent those of Shape Blue Ltd or related 
> companies. If you are not the intended recipient of this email, you 
> must neither take any action based upon its contents, nor copy or show 
> it to anyone. Please contact the sender if you believe you have 
> received this email in error. Shape Blue Ltd is a company incorporated 
> in England & Wales. ShapeBlue Services India LLP is a company 
> incorporated in India and is operated under license from Shape Blue 
> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in 
> Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA 
> Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>

Re: marvin test cases + travis

Posted by Rajani Karuturi <ra...@apache.org>.
-1 on increasing the time
As a reviewer, I would like an immediate response on a pull request. By the
time I review the code, if CI gives a +1(or -1) I can close the PR then and
there instead of coming back again to merge.

I would suggest running all the jobs under 30 min and increasing the number
of parallel jobs as much as possible. we are running 10 jobs now. may be we
could increase this to 15(dont know if this is possible)

we should aim to run only the smoke tests and not the entire regression
suite always.

Making the jobs run on containers will speed them up. This needs some work
on removing the sudo dependency on the jobs (which is required to install
some additional packages and marvin).

~Rajani

On Fri, May 1, 2015 at 8:25 AM, Abhinandan Prateek <
abhinandan.prateek@shapeblue.com> wrote:

> +1 for increased timeouts.
>
> At the moment we get less than 24 commits per day on master. Only a couple
> on other branches per day.
> We can increase the timeout to upto 70 minutes or more. Will try to ensure
> that in general a single run does not take more than an hour.
>
> A timeout window slightly higher will ensure that we do not see timeout
> failures.
>
> > On 30-Apr-2015, at 11:25 pm, Daan Hoogland <da...@gmail.com>
> wrote:
> >
> > Travis is starting to indue the, 'oh,  a timeout again' - blindness in
> me.
> > Let's put a safe time on it.  A result should mean something and those
> time
> > out are like the (decreasing) abundance of Jenkins failures.
> >
> > So +1 for increasing the time
> >
> > On Thu, 30 Apr 2015 18:46 Ian Duffy <ia...@ianduffy.ie> wrote:
> >
> >>> Do we need to ask for an increase in run time?
> >>
> >> From my experience I wouldn't say its required however *it would be very
> >> nice*.
> >> At the moment what we do is create new parallel jobs and balance the
> >> tests across them so each job is under 50mins.
> >>
> >> Anywho, just my 2c, see what others say/think.
> >>
> >> On 30 April 2015 at 17:34, David Nalley <da...@gnsa.us> wrote:
> >>> Do we need to ask for an increase in run time?
> >>> 50 minutes is the OSS default, but the ASF is a paying customer and we
> >>> can ask for longer timeouts.
> >>>
> >>> --David
> >>>
> >>> On Thu, Apr 30, 2015 at 10:06 AM, Abhinandan Prateek
> >>> <ab...@shapeblue.com> wrote:
> >>>> One of the run did timeout. Will balance the runs.
> >>>>
> >>>>> On 30-Apr-2015, at 5:59 pm, Abhinandan Prateek <
> >> abhinandan.prateek@shapeblue.com> wrote:
> >>>>>
> >>>>> Yes, thanks for checking. I was worried that now some of them may
> >> start timing out.
> >>>>> I have another 10 suites tested, will add them once everything seems
> >> fine.
> >>>>>
> >>>>> -abhi
> >>>>>
> >>>>>
> >>>>>> On 30-Apr-2015, at 5:32 pm, Rajani Karuturi <ra...@apache.org>
> >> wrote:
> >>>>>>
> >>>>>> after correcting the test file path, its working fine
> >>>>>>
> >>>>>> https://travis-ci.org/karuturi/cloudstack/jobs/60681263
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>> ~Rajani
> >>>>>>
> >>>>>> On Thu, Apr 30, 2015 at 4:51 PM, Rajani Karuturi <rajani@apache.org
> >
> >> wrote:
> >>>>>>
> >>>>>>> I think its due to this commit
> >>>>>>>
> >>>>>>>
> >>
> https://github.com/apache/cloudstack/commit/b941480e0df0bfa3377e797126b96cf9b3fbee77
> >>>>>>>
> >>>>>>> Here, test file name is changed from testname to
> >> [smoke,component]/testname
> >>>>>>>
> >>>>>>> But, while running each test file in the for loop, it prepends the
> >> name
> >>>>>>> with smoke and hence, it cant find the file and none of the tests
> in
> >> the
> >>>>>>> file are run
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>> ~Rajani
> >>>>>>>
> >>>>>>> On Thu, Apr 30, 2015 at 4:37 PM, Abhinandan Prateek <
> >>>>>>> abhinandan.prateek@shapeblue.com> wrote:
> >>>>>>>
> >>>>>>>> It is possible, I will check.
> >>>>>>>>
> >>>>>>>>> On 30-Apr-2015, at 3:43 pm, Rajani Karuturi <ra...@apache.org>
> >> wrote:
> >>>>>>>>>
> >>>>>>>>> Hey Abhi,
> >>>>>>>>>
> >>>>>>>>> In the recent travis runs, its not printing the test case in
> >> output (
> >>>>>>>>> https://travis-ci.org/apache/cloudstack/jobs/60634577#L5443)
> >>>>>>>>>
> >>>>>>>>> It used to print the test case name and status (
> >>>>>>>>> https://travis-ci.org/apache/cloudstack/jobs/59958134#L4205)
> >>>>>>>>>
> >>>>>>>>> Do you think it can be due to any recent changes?
> >>>>>>>>>
> >>>>>>>>> ~Rajani
> >>>>>>>>>
> >>>>>>>>> On Thu, Apr 30, 2015 at 10:32 AM, Abhinandan Prateek <
> >>>>>>>>> abhinandan.prateek@shapeblue.com> wrote:
> >>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> There are more than 10 additional suites that can still be
> >> included
> >>>>>>>> to
> >>>>>>>>>> the travis-CI.
> >>>>>>>>>> Since the current set runs comfortably I will go ahead and add
> >> more. If
> >>>>>>>>>> the system gets overloaded, then we can balance the kind of test
> >>>>>>>> suites and
> >>>>>>>>>> amount of test suits that run comfortably on travis.
> >>>>>>>>>>
> >>>>>>>>>> -abhi
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> Find out more about ShapeBlue and our range of CloudStack
> related
> >>>>>>>> services
> >>>>>>>>>>
> >>>>>>>>>> IaaS Cloud Design & Build<
> >>>>>>>>>> http://shapeblue.com/iaas-cloud-design-and-build//>
> >>>>>>>>>> CSForge – rapid IaaS deployment framework<
> >>>>>>>> http://shapeblue.com/csforge/>
> >>>>>>>>>> CloudStack Consulting<
> >> http://shapeblue.com/cloudstack-consultancy/>
> >>>>>>>>>> CloudStack Software Engineering<
> >>>>>>>>>> http://shapeblue.com/cloudstack-software-engineering/>
> >>>>>>>>>> CloudStack Infrastructure Support<
> >>>>>>>>>> http://shapeblue.com/cloudstack-infrastructure-support/>
> >>>>>>>>>> CloudStack Bootcamp Training Courses<
> >>>>>>>>>> http://shapeblue.com/cloudstack-training/>
> >>>>>>>>>>
> >>>>>>>>>> This email and any attachments to it may be confidential and are
> >>>>>>>> intended
> >>>>>>>>>> solely for the use of the individual to whom it is addressed.
> Any
> >>>>>>>> views or
> >>>>>>>>>> opinions expressed are solely those of the author and do not
> >>>>>>>> necessarily
> >>>>>>>>>> represent those of Shape Blue Ltd or related companies. If you
> >> are not
> >>>>>>>> the
> >>>>>>>>>> intended recipient of this email, you must neither take any
> action
> >>>>>>>> based
> >>>>>>>>>> upon its contents, nor copy or show it to anyone. Please contact
> >> the
> >>>>>>>> sender
> >>>>>>>>>> if you believe you have received this email in error. Shape Blue
> >> Ltd
> >>>>>>>> is a
> >>>>>>>>>> company incorporated in England & Wales. ShapeBlue Services
> India
> >> LLP
> >>>>>>>> is a
> >>>>>>>>>> company incorporated in India and is operated under license from
> >> Shape
> >>>>>>>> Blue
> >>>>>>>>>> Ltd. Shape Blue Brasil Consultoria Ltda is a company
> incorporated
> >> in
> >>>>>>>> Brasil
> >>>>>>>>>> and is operated under license from Shape Blue Ltd. ShapeBlue SA
> >> Pty
> >>>>>>>> Ltd is
> >>>>>>>>>> a company registered by The Republic of South Africa and is
> traded
> >>>>>>>> under
> >>>>>>>>>> license from Shape Blue Ltd. ShapeBlue is a registered
> trademark.
> >>>>>>>>>>
> >>>>>>>>
> >>>>>>>> Find out more about ShapeBlue and our range of CloudStack related
> >> services
> >>>>>>>>
> >>>>>>>> IaaS Cloud Design & Build<
> >>>>>>>> http://shapeblue.com/iaas-cloud-design-and-build//>
> >>>>>>>> CSForge – rapid IaaS deployment framework<
> >> http://shapeblue.com/csforge/>
> >>>>>>>> CloudStack Consulting<
> http://shapeblue.com/cloudstack-consultancy/>
> >>>>>>>> CloudStack Software Engineering<
> >>>>>>>> http://shapeblue.com/cloudstack-software-engineering/>
> >>>>>>>> CloudStack Infrastructure Support<
> >>>>>>>> http://shapeblue.com/cloudstack-infrastructure-support/>
> >>>>>>>> CloudStack Bootcamp Training Courses<
> >>>>>>>> http://shapeblue.com/cloudstack-training/>
> >>>>>>>>
> >>>>>>>> This email and any attachments to it may be confidential and are
> >> intended
> >>>>>>>> solely for the use of the individual to whom it is addressed. Any
> >> views or
> >>>>>>>> opinions expressed are solely those of the author and do not
> >> necessarily
> >>>>>>>> represent those of Shape Blue Ltd or related companies. If you are
> >> not the
> >>>>>>>> intended recipient of this email, you must neither take any action
> >> based
> >>>>>>>> upon its contents, nor copy or show it to anyone. Please contact
> >> the sender
> >>>>>>>> if you believe you have received this email in error. Shape Blue
> >> Ltd is a
> >>>>>>>> company incorporated in England & Wales. ShapeBlue Services India
> >> LLP is a
> >>>>>>>> company incorporated in India and is operated under license from
> >> Shape Blue
> >>>>>>>> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated
> >> in Brasil
> >>>>>>>> and is operated under license from Shape Blue Ltd. ShapeBlue SA
> Pty
> >> Ltd is
> >>>>>>>> a company registered by The Republic of South Africa and is traded
> >> under
> >>>>>>>> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
> >>>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>
> >>>>> Find out more about ShapeBlue and our range of CloudStack related
> >> services
> >>>>>
> >>>>> IaaS Cloud Design & Build<
> >> http://shapeblue.com/iaas-cloud-design-and-build//>
> >>>>> CSForge – rapid IaaS deployment framework<
> >> http://shapeblue.com/csforge/>
> >>>>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> >>>>> CloudStack Software Engineering<
> >> http://shapeblue.com/cloudstack-software-engineering/>
> >>>>> CloudStack Infrastructure Support<
> >> http://shapeblue.com/cloudstack-infrastructure-support/>
> >>>>> CloudStack Bootcamp Training Courses<
> >> http://shapeblue.com/cloudstack-training/>
> >>>>>
> >>>>> This email and any attachments to it may be confidential and are
> >> intended solely for the use of the individual to whom it is addressed.
> Any
> >> views or opinions expressed are solely those of the author and do not
> >> necessarily represent those of Shape Blue Ltd or related companies. If
> you
> >> are not the intended recipient of this email, you must neither take any
> >> action based upon its contents, nor copy or show it to anyone. Please
> >> contact the sender if you believe you have received this email in error.
> >> Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue
> >> Services India LLP is a company incorporated in India and is operated
> under
> >> license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a
> >> company incorporated in Brasil and is operated under license from Shape
> >> Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic
> of
> >> South Africa and is traded under license from Shape Blue Ltd. ShapeBlue
> is
> >> a registered trademark.
> >>>>
> >>>> Find out more about ShapeBlue and our range of CloudStack related
> >> services
> >>>>
> >>>> IaaS Cloud Design & Build<
> >> http://shapeblue.com/iaas-cloud-design-and-build//>
> >>>> CSForge – rapid IaaS deployment framework<
> http://shapeblue.com/csforge/
> >>>
> >>>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> >>>> CloudStack Software Engineering<
> >> http://shapeblue.com/cloudstack-software-engineering/>
> >>>> CloudStack Infrastructure Support<
> >> http://shapeblue.com/cloudstack-infrastructure-support/>
> >>>> CloudStack Bootcamp Training Courses<
> >> http://shapeblue.com/cloudstack-training/>
> >>>>
> >>>> This email and any attachments to it may be confidential and are
> >> intended solely for the use of the individual to whom it is addressed.
> Any
> >> views or opinions expressed are solely those of the author and do not
> >> necessarily represent those of Shape Blue Ltd or related companies. If
> you
> >> are not the intended recipient of this email, you must neither take any
> >> action based upon its contents, nor copy or show it to anyone. Please
> >> contact the sender if you believe you have received this email in error.
> >> Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue
> >> Services India LLP is a company incorporated in India and is operated
> under
> >> license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a
> >> company incorporated in Brasil and is operated under license from Shape
> >> Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic
> of
> >> South Africa and is traded under license from Shape Blue Ltd. ShapeBlue
> is
> >> a registered trademark.
> >>
>
> Find out more about ShapeBlue and our range of CloudStack related services
>
> IaaS Cloud Design & Build<
> http://shapeblue.com/iaas-cloud-design-and-build//>
> CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> CloudStack Software Engineering<
> http://shapeblue.com/cloudstack-software-engineering/>
> CloudStack Infrastructure Support<
> http://shapeblue.com/cloudstack-infrastructure-support/>
> CloudStack Bootcamp Training Courses<
> http://shapeblue.com/cloudstack-training/>
>
> This email and any attachments to it may be confidential and are intended
> solely for the use of the individual to whom it is addressed. Any views or
> opinions expressed are solely those of the author and do not necessarily
> represent those of Shape Blue Ltd or related companies. If you are not the
> intended recipient of this email, you must neither take any action based
> upon its contents, nor copy or show it to anyone. Please contact the sender
> if you believe you have received this email in error. Shape Blue Ltd is a
> company incorporated in England & Wales. ShapeBlue Services India LLP is a
> company incorporated in India and is operated under license from Shape Blue
> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil
> and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is
> a company registered by The Republic of South Africa and is traded under
> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>