You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@openwhisk.apache.org by Michael Marth <mm...@adobe.com.INVALID> on 2018/06/18 14:47:57 UTC
Re: How to best run non-local tests in ASF (was: Performance tests
for OpenWhisk)
A quick update on this:
Carlos (and others) has been working on the mechanics of getting distributed tests to run on hardware that is managed by Infra. For this purpose we should have a couple of Infra-managed VMs that are dedicated to OpenWhisk. Bertrand has gotten me in touch with the ASF fundraising people to figure out the mechanics of how to transfer a donation directed at this purpose.
Will keep you posted as there's progress.
On 09.04.18, 11:50, "Bertrand Delacretaz" <bd...@apache.org> wrote:
On Sun, Apr 8, 2018 at 3:36 AM, Carlos Santana <cs...@gmail.com> wrote:
> ...Michael could you direct the inquiries on the infra list?...
I think it makes sense to keep this thread here for now and dig deeper
on the (type of) solution that Luciano has been explaining.
Note that http://apache.org/foundation/thanks.html now includes a
"targeted sponsors" section where companies can be recognized as
sponsors by donating cloud services, among other options. That might
be an additional incentive for someone to donate computing resources
for this purpose.
I'm happy to make connections with the ASF's VP of Fundraising if
needed to facilitate things.
-Bertrand
Re: How to best run non-local tests in ASF (was: Performance tests for
OpenWhisk)
Posted by Vincent S Hou <sh...@us.ibm.com>.
Great thanks to Adobe Inc for the donation to OpenWhisk.
I just touched based with Carlos about how we setup and Jenkins environment for OpenWhisk. I will pick up the Jenkins work for OpenWhisk.
For anyone, who is interested in the Jenkins Pipeline for OpenWhisk. Welcome to help.
Thank you.
Best wishes.
Vincent Hou (侯胜博)
Advisory Software Engineer, OpenWhisk Contributor, Open Technology, IBM Cloud
Notes ID: Vincent S Hou/Raleigh/IBM, E-mail: shou@us.ibm.com,
Phone: +1(919)254-7182
Address: 4205 S Miami Blvd (Cornwallis Drive), Durham, NC 27703, United States
-----Rodric Rabbah <ro...@gmail.com> wrote: -----
To: dev@openwhisk.apache.org
From: Rodric Rabbah <ro...@gmail.com>
Date: 11/07/2018 02:31PM
Subject: Re: How to best run non-local tests in ASF (was: Performance tests for OpenWhisk)
Thank you Adobe Inc and the Adobe team for the donation and making it possible to have infra for the project! And thanks Carlos for also pushing this forward.
-r
> On Nov 7, 2018, at 2:25 PM, Carlos Santana <cs...@gmail.com> wrote:
>
> We got the 3 VMs Woot !!
> it only took 6 months
>
> The INFRA ticket [1] that I opened back in June I was able to close today.
> I ran a quick test from a Jenkins job to check the 3 VMs, I added the
> information in our Wiki page [2]
>
> On behave of the Apache OpenWhisk (Incubating) community I want to thank
> Adobe Inc. for the donation of $1,000 (one thousand) US dollars to the ASF
> to allow us get these VMs dedicated to the project and be able to run
> Playground CICD tests.
>
> [1] https://issues.apache.org/jira/browse/INFRA-16668
> [2]
> https://cwiki.apache.org/confluence/display/OPENWHISK/Jenkins+VMs+for+Playgrounds
Re: How to best run non-local tests in ASF (was: Performance tests
for OpenWhisk)
Posted by Rodric Rabbah <ro...@gmail.com>.
Thank you Adobe Inc and the Adobe team for the donation and making it possible to have infra for the project! And thanks Carlos for also pushing this forward.
-r
> On Nov 7, 2018, at 2:25 PM, Carlos Santana <cs...@gmail.com> wrote:
>
> We got the 3 VMs Woot !!
> it only took 6 months
>
> The INFRA ticket [1] that I opened back in June I was able to close today.
> I ran a quick test from a Jenkins job to check the 3 VMs, I added the
> information in our Wiki page [2]
>
> On behave of the Apache OpenWhisk (Incubating) community I want to thank
> Adobe Inc. for the donation of $1,000 (one thousand) US dollars to the ASF
> to allow us get these VMs dedicated to the project and be able to run
> Playground CICD tests.
>
> [1] https://issues.apache.org/jira/browse/INFRA-16668
> [2]
> https://cwiki.apache.org/confluence/display/OPENWHISK/Jenkins+VMs+for+Playgrounds
Re: How to best run non-local tests in ASF (was: Performance tests
for OpenWhisk)
Posted by Carlos Santana <cs...@gmail.com>.
We got the 3 VMs Woot !!
it only took 6 months
The INFRA ticket [1] that I opened back in June I was able to close today.
I ran a quick test from a Jenkins job to check the 3 VMs, I added the
information in our Wiki page [2]
On behave of the Apache OpenWhisk (Incubating) community I want to thank
Adobe Inc. for the donation of $1,000 (one thousand) US dollars to the ASF
to allow us get these VMs dedicated to the project and be able to run
Playground CICD tests.
[1] https://issues.apache.org/jira/browse/INFRA-16668
[2]
https://cwiki.apache.org/confluence/display/OPENWHISK/Jenkins+VMs+for+Playgrounds
On Tue, Jun 19, 2018 at 8:32 PM Carlos Santana <cs...@gmail.com> wrote:
> Thanks Michael for securing some funding to get us started with this.
>
> With the recent work from Chettam in refactoring our gradle testing tasks,
> and using Travis stages to build in parallel and over come the 50 minute
> limit we used to hit,
> By adding an additional stage we should be able to run all the tests that
> are present in the core repo. But this would not get us to be able to test
> the deployment scripts and run the tests using a distributed environment,
> in Travis we only have 1 VM.
>
> So we are requesting as a start for INFRA to setup 3 VMs in Apache
> Jenkins, this should allow us to setup an OpenWhisk where we can have 1
> node for control plane, and 2 nodes for invokers.
>
> This way we should be able to test:
> - distributed deployment
> - running all tests against a distributed environment
> - HA/Balancing testing (i.e. shooting 1 invoker and the other invoker
> should handle the load)
>
>
> I opened the INFRA ticket today with the specs [1]
> [1] https://issues.apache.org/jira/browse/INFRA-16668
>
> -- Carlos
>
>
> On Mon, Jun 18, 2018 at 10:48 AM Michael Marth <mm...@adobe.com.invalid>
> wrote:
>
>> A quick update on this:
>>
>> Carlos (and others) has been working on the mechanics of getting
>> distributed tests to run on hardware that is managed by Infra. For this
>> purpose we should have a couple of Infra-managed VMs that are dedicated to
>> OpenWhisk. Bertrand has gotten me in touch with the ASF fundraising people
>> to figure out the mechanics of how to transfer a donation directed at this
>> purpose.
>> Will keep you posted as there's progress.
>>
>>
>>
>> On 09.04.18, 11:50, "Bertrand Delacretaz" <bd...@apache.org>
>> wrote:
>>
>> On Sun, Apr 8, 2018 at 3:36 AM, Carlos Santana <cs...@gmail.com>
>> wrote:
>> > ...Michael could you direct the inquiries on the infra list?...
>>
>> I think it makes sense to keep this thread here for now and dig deeper
>> on the (type of) solution that Luciano has been explaining.
>>
>> Note that http://apache.org/foundation/thanks.html now includes a
>> "targeted sponsors" section where companies can be recognized as
>> sponsors by donating cloud services, among other options. That might
>> be an additional incentive for someone to donate computing resources
>> for this purpose.
>>
>> I'm happy to make connections with the ASF's VP of Fundraising if
>> needed to facilitate things.
>>
>> -Bertrand
>>
>>
>>
Re: How to best run non-local tests in ASF (was: Performance tests
for OpenWhisk)
Posted by Carlos Santana <cs...@gmail.com>.
Thanks Michael for securing some funding to get us started with this.
With the recent work from Chettam in refactoring our gradle testing tasks,
and using Travis stages to build in parallel and over come the 50 minute
limit we used to hit,
By adding an additional stage we should be able to run all the tests that
are present in the core repo. But this would not get us to be able to test
the deployment scripts and run the tests using a distributed environment,
in Travis we only have 1 VM.
So we are requesting as a start for INFRA to setup 3 VMs in Apache Jenkins,
this should allow us to setup an OpenWhisk where we can have 1 node for
control plane, and 2 nodes for invokers.
This way we should be able to test:
- distributed deployment
- running all tests against a distributed environment
- HA/Balancing testing (i.e. shooting 1 invoker and the other invoker
should handle the load)
I opened the INFRA ticket today with the specs [1]
[1] https://issues.apache.org/jira/browse/INFRA-16668
-- Carlos
On Mon, Jun 18, 2018 at 10:48 AM Michael Marth <mm...@adobe.com.invalid>
wrote:
> A quick update on this:
>
> Carlos (and others) has been working on the mechanics of getting
> distributed tests to run on hardware that is managed by Infra. For this
> purpose we should have a couple of Infra-managed VMs that are dedicated to
> OpenWhisk. Bertrand has gotten me in touch with the ASF fundraising people
> to figure out the mechanics of how to transfer a donation directed at this
> purpose.
> Will keep you posted as there's progress.
>
>
>
> On 09.04.18, 11:50, "Bertrand Delacretaz" <bd...@apache.org> wrote:
>
> On Sun, Apr 8, 2018 at 3:36 AM, Carlos Santana <cs...@gmail.com>
> wrote:
> > ...Michael could you direct the inquiries on the infra list?...
>
> I think it makes sense to keep this thread here for now and dig deeper
> on the (type of) solution that Luciano has been explaining.
>
> Note that http://apache.org/foundation/thanks.html now includes a
> "targeted sponsors" section where companies can be recognized as
> sponsors by donating cloud services, among other options. That might
> be an additional incentive for someone to donate computing resources
> for this purpose.
>
> I'm happy to make connections with the ASF's VP of Fundraising if
> needed to facilitate things.
>
> -Bertrand
>
>
>