You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@cloudstack.apache.org by Bharat Kumar <bh...@citrix.com> on 2015/07/23 10:50:02 UTC

[Proposal] Continuos Integration Testing on ACS master.

Hi All,

Currently we do sanity checks on master using Travis, But travis runs only simulator tests (AFAIK). I think it will be better if
we can run both BVTs and regression tests on real hardware. I am woking on implementing this.

Functional spec and design details.
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Test+bed+orchestrator+and+test+runner+to+enable+continuos+integration

Please read the FS and give your comments or suggestions.

Thanks,
Bharat.

Re: [Proposal] Continuos Integration Testing on ACS master.

Posted by Bharat Kumar <bh...@citrix.com>.
Hi Kishan,

I am thinking we will use Citrix hardware until we find something in the acs lab. We will publish the results to acs by mails. However until we find something publicly accessible people can only see the list of tests that failed,
for providing more info we will need some place to host the logs and other related info of the test runs.

long term plan is to move everything into acs infra.

Thanks,
Bharat.

On 23-Jul-2015, at 4:19 pm, Kishan Kavala <Ki...@citrix.com> wrote:

> Bharat,
> I hope this will go a long way in improving product quality. How are you going to handle the handle the hardware requirement? What is the plan to publish the results to ML?
> 
> -----Original Message-----
> From: Daan Hoogland [mailto:daan.hoogland@gmail.com] 
> Sent: 23 July 2015 03:46 PM
> To: dev
> Subject: Re: [Proposal] Continuos Integration Testing on ACS master.
> 
> Good work Bharat, Keep in mind that many people work on this in many ways and many attempts have failed due to nothing but lack of consensus. I have only glanced but will take my time with it soon.
> 
> On Thu, Jul 23, 2015 at 10:50 AM, Bharat Kumar <bh...@citrix.com> wrote:
>> Hi All,
>> 
>> Currently we do sanity checks on master using Travis, But travis runs 
>> only simulator tests (AFAIK). I think it will be better if we can run both BVTs and regression tests on real hardware. I am woking on implementing this.
>> 
>> Functional spec and design details.
>> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Test+bed+orches
>> trator+and+test+runner+to+enable+continuos+integration
>> 
>> Please read the FS and give your comments or suggestions.
>> 
>> Thanks,
>> Bharat.
> 
> 
> 
> --
> Daan

RE: [Proposal] Continuos Integration Testing on ACS master.

Posted by Kishan Kavala <Ki...@citrix.com>.
Bharat,
 I hope this will go a long way in improving product quality. How are you going to handle the handle the hardware requirement? What is the plan to publish the results to ML?

-----Original Message-----
From: Daan Hoogland [mailto:daan.hoogland@gmail.com] 
Sent: 23 July 2015 03:46 PM
To: dev
Subject: Re: [Proposal] Continuos Integration Testing on ACS master.

Good work Bharat, Keep in mind that many people work on this in many ways and many attempts have failed due to nothing but lack of consensus. I have only glanced but will take my time with it soon.

On Thu, Jul 23, 2015 at 10:50 AM, Bharat Kumar <bh...@citrix.com> wrote:
> Hi All,
>
> Currently we do sanity checks on master using Travis, But travis runs 
> only simulator tests (AFAIK). I think it will be better if we can run both BVTs and regression tests on real hardware. I am woking on implementing this.
>
> Functional spec and design details.
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Test+bed+orches
> trator+and+test+runner+to+enable+continuos+integration
>
> Please read the FS and give your comments or suggestions.
>
> Thanks,
> Bharat.



--
Daan

Re: [Proposal] Continuos Integration Testing on ACS master.

Posted by Daan Hoogland <da...@gmail.com>.
Good work Bharat, Keep in mind that many people work on this in many
ways and many attempts have failed due to nothing but lack of
consensus. I have only glanced but will take my time with it soon.

On Thu, Jul 23, 2015 at 10:50 AM, Bharat Kumar <bh...@citrix.com> wrote:
> Hi All,
>
> Currently we do sanity checks on master using Travis, But travis runs only simulator tests (AFAIK). I think it will be better if
> we can run both BVTs and regression tests on real hardware. I am woking on implementing this.
>
> Functional spec and design details.
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Test+bed+orchestrator+and+test+runner+to+enable+continuos+integration
>
> Please read the FS and give your comments or suggestions.
>
> Thanks,
> Bharat.



-- 
Daan