You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@stratos.apache.org by Lakmal Warusawithana <la...@wso2.com> on 2014/01/12 11:43:01 UTC
[Discuss] Mockup IaaS for Stratos development
Hi devs,
Initially this idea is came from Sanjiva, to minimize the barriers to
contribution to Stratos. After chat I had with Sanjiva, I have thought
about what scenarios do we need to cover from this. Here is some points I
like to discuss. For a time being will call it "Stratos Dev IaaS" :)
- get rid of complexity of the current IaaS setup which required in
Stratos. for a example even setting up OpenStack in single node, required
lot of resources, well as some deeper networking knowledge.
- this should easy to setup.
- should run with low resource. For achieve this, I am thinking of
directly create LXC as Cartridges.
- when developer need to do testing on some smart deployments policies,
it required, multi regions, zones ..etc IaaS environments which is very
hard to set it up or its very costly. So with this, we should create
mockups regions, zones ..etc.
- support mockup private IP and public IP
- support mockup multi network interfaces
- support mockup persistence volume for instances
- support API, which can call from jclouds
We can complete above features one by one but we should have proper design
to start up. I can take the ownership of developing this, since I have done
similar kind of IaaS in some times back [1]. But until mid feb I have full
my calendar with multiple engagement, but will try to kickoff this.
Thoughts , help appreciate on this.
[1]http://wso2.com/projects/ozone/
thanks
--
Lakmal Warusawithana
Software Architect; WSO2 Inc.
Mobile : +94714289692
Blog : http://lakmalsview.blogspot.com/
Re: [Discuss] Mockup IaaS for Stratos development
Posted by Nirmal Fernando <ni...@gmail.com>.
+1 for the idea.
On Mon, Jan 13, 2014 at 4:55 AM, Sanjiva Weerawarana <sa...@wso2.com>wrote:
> Pradeep lets chat a bit .. yes we should implement a jClouds wrapper for
> sure. The runtime bits are quite straightforward IMO .. we use different
> ports and bring up LXCs and have them communicate to the LB. Basically
> we're doing the work that the LXC agent does in a machine underneath
> OpenStack right now.
>
> If you have time to start on this that'll be great - shouldn't take too
> long to get to 80% aka working state!
>
> Sanjiva.
>
>
> On Mon, Jan 13, 2014 at 12:43 AM, Pradeep Fernando <pr...@gmail.com>wrote:
>
>> Hi,
>>
>> I was discussing this with the team on friday and was going to send a
>> mail. Never knew you had this in your mind. :)
>>
>> Since our IAAS abstraction is Jclouds, we should consider the possibitily
>> of implementing the mock IAAS on top jclouds.
>>
>> Right now we test autoscaling and other fundamental stuff using EC2. It
>> is quite painful and waste of money. I couldnt figure out how to mockup the
>> runtime bits, like cartridge serving a request, but we can figure out those
>> bits..
>>
>> --Pradeep
>>
>>
>>
>>
>> On Sun, Jan 12, 2014 at 5:04 PM, Lakmal Warusawithana <la...@wso2.com>wrote:
>>
>>> Thanks Chris, will see how we can use jclouds mocks into this.
>>>
>>>
>>> On Sun, Jan 12, 2014 at 4:29 PM, chris snow <ch...@gmail.com> wrote:
>>>
>>>> This would be awesome.
>>>>
>>>> If I remember correctly, jclouds has some mocks already - I had a brief
>>>> look into this before, but haven't had time to thoroughly investigate.
>>>> On 12 Jan 2014 10:43, "Lakmal Warusawithana" <la...@wso2.com> wrote:
>>>>
>>>>> Hi devs,
>>>>>
>>>>> Initially this idea is came from Sanjiva, to minimize the barriers to
>>>>> contribution to Stratos. After chat I had with Sanjiva, I have thought
>>>>> about what scenarios do we need to cover from this. Here is some points I
>>>>> like to discuss. For a time being will call it "Stratos Dev IaaS" :)
>>>>>
>>>>> - get rid of complexity of the current IaaS setup which required
>>>>> in Stratos. for a example even setting up OpenStack in single node,
>>>>> required lot of resources, well as some deeper networking knowledge.
>>>>> - this should easy to setup.
>>>>> - should run with low resource. For achieve this, I am thinking of
>>>>> directly create LXC as Cartridges.
>>>>> - when developer need to do testing on some smart deployments
>>>>> policies, it required, multi regions, zones ..etc IaaS environments which
>>>>> is very hard to set it up or its very costly. So with this, we should
>>>>> create mockups regions, zones ..etc.
>>>>> - support mockup private IP and public IP
>>>>> - support mockup multi network interfaces
>>>>> - support mockup persistence volume for instances
>>>>> - support API, which can call from jclouds
>>>>>
>>>>>
>>>>> We can complete above features one by one but we should have proper
>>>>> design to start up. I can take the ownership of developing this, since I
>>>>> have done similar kind of IaaS in some times back [1]. But until mid feb I
>>>>> have full my calendar with multiple engagement, but will try to kickoff
>>>>> this. Thoughts , help appreciate on this.
>>>>>
>>>>> [1]http://wso2.com/projects/ozone/
>>>>>
>>>>>
>>>>> thanks
>>>>> --
>>>>> Lakmal Warusawithana
>>>>> Software Architect; WSO2 Inc.
>>>>> Mobile : +94714289692
>>>>> Blog : http://lakmalsview.blogspot.com/
>>>>>
>>>>>
>>>
>>>
>>> --
>>> Lakmal Warusawithana
>>> Software Architect; WSO2 Inc.
>>> Mobile : +94714289692
>>> Blog : http://lakmalsview.blogspot.com/
>>>
>>>
>>
>>
>> --
>> Pradeep Fernando.
>> http://pradeepfernando.blogspot.com/
>>
>
>
>
> --
> Sanjiva Weerawarana, Ph.D.
> Founder, Chairman & CEO; WSO2, Inc.; http://wso2.com/
> email: sanjiva@wso2.com; office: +1 650 745 4499 x5700; cell: +94 77 787
> 6880 | +1 650 265 8311
> blog: http://sanjiva.weerawarana.org/
> Lean . Enterprise . Middleware
>
--
Best Regards,
Nirmal
Nirmal Fernando.
PPMC Member & Committer of Apache Stratos,
Senior Software Engineer, WSO2 Inc.
Blog: http://nirmalfdo.blogspot.com/
Re: [Discuss] Mockup IaaS for Stratos development
Posted by Imesh Gunaratne <im...@apache.org>.
Indeed, this is an awesome thought! +1
I think we should be able to write the LXC wrapper using the compute API
[1]. I will also look into this and add more details.
[1] http://jclouds.apache.org/documentation/userguide/compute/
Thanks
On Sun, Jan 12, 2014 at 11:33 PM, Lahiru Sandaruwan <la...@wso2.com>wrote:
> Hi all,
>
> I see two important aspects in this thread.
>
> 1. Light weight development environment with light weight IaaS
> 2. Complete integration test with mocked external services(This does not
> require an IaaS)
>
> +1 for a LXC based environment for #1.
>
> We have already started #2 for Autoscaler, may be we can extended it to
> other products as well.
>
> Thanks.
>
>
> On Mon, Jan 13, 2014 at 9:53 AM, Pradeep Fernando <pr...@gmail.com>wrote:
>
>>
>> Hi,
>>
>> On Mon, Jan 13, 2014 at 4:55 AM, Sanjiva Weerawarana <sa...@wso2.com>wrote:
>>
>>> Pradeep lets chat a bit ..
>>>
>>
>> Sure..
>>
>>
>>> yes we should implement a jClouds wrapper for sure. The runtime bits are
>>> quite straightforward IMO .. we use different ports and bring up LXCs and
>>> have them communicate to the LB. Basically we're doing the work that the
>>> LXC agent does in a machine underneath OpenStack right now.
>>>
>> To be honest i didnt think with LXC stuff in mind. I was thinking
>> mocking the environment with pure java based mechanisms. (service
>> calls/java reflection/etc). - my comfort zone i guess. So looks good and
>> seems to be an interesting task. Will collaborate with Lakmal on this.
>>
>> --Pradeep
>>
>>
>>> If you have time to start on this that'll be great - shouldn't take too
>>> long to get to 80% aka working state!
>>>
>>> Sanjiva.
>>>
>>>
>>> On Mon, Jan 13, 2014 at 12:43 AM, Pradeep Fernando <pr...@gmail.com>wrote:
>>>
>>>> Hi,
>>>>
>>>> I was discussing this with the team on friday and was going to send a
>>>> mail. Never knew you had this in your mind. :)
>>>>
>>>> Since our IAAS abstraction is Jclouds, we should consider the
>>>> possibitily of implementing the mock IAAS on top jclouds.
>>>>
>>>> Right now we test autoscaling and other fundamental stuff using EC2. It
>>>> is quite painful and waste of money. I couldnt figure out how to mockup the
>>>> runtime bits, like cartridge serving a request, but we can figure out those
>>>> bits..
>>>>
>>>> --Pradeep
>>>>
>>>>
>>>>
>>>>
>>>> On Sun, Jan 12, 2014 at 5:04 PM, Lakmal Warusawithana <la...@wso2.com>wrote:
>>>>
>>>>> Thanks Chris, will see how we can use jclouds mocks into this.
>>>>>
>>>>>
>>>>> On Sun, Jan 12, 2014 at 4:29 PM, chris snow <ch...@gmail.com>wrote:
>>>>>
>>>>>> This would be awesome.
>>>>>>
>>>>>> If I remember correctly, jclouds has some mocks already - I had a
>>>>>> brief look into this before, but haven't had time to thoroughly investigate.
>>>>>> On 12 Jan 2014 10:43, "Lakmal Warusawithana" <la...@wso2.com> wrote:
>>>>>>
>>>>>>> Hi devs,
>>>>>>>
>>>>>>> Initially this idea is came from Sanjiva, to minimize the barriers
>>>>>>> to contribution to Stratos. After chat I had with Sanjiva, I have thought
>>>>>>> about what scenarios do we need to cover from this. Here is some points I
>>>>>>> like to discuss. For a time being will call it "Stratos Dev IaaS" :)
>>>>>>>
>>>>>>> - get rid of complexity of the current IaaS setup which required
>>>>>>> in Stratos. for a example even setting up OpenStack in single node,
>>>>>>> required lot of resources, well as some deeper networking knowledge.
>>>>>>> - this should easy to setup.
>>>>>>> - should run with low resource. For achieve this, I am thinking
>>>>>>> of directly create LXC as Cartridges.
>>>>>>> - when developer need to do testing on some smart deployments
>>>>>>> policies, it required, multi regions, zones ..etc IaaS environments which
>>>>>>> is very hard to set it up or its very costly. So with this, we should
>>>>>>> create mockups regions, zones ..etc.
>>>>>>> - support mockup private IP and public IP
>>>>>>> - support mockup multi network interfaces
>>>>>>> - support mockup persistence volume for instances
>>>>>>> - support API, which can call from jclouds
>>>>>>>
>>>>>>>
>>>>>>> We can complete above features one by one but we should have proper
>>>>>>> design to start up. I can take the ownership of developing this, since I
>>>>>>> have done similar kind of IaaS in some times back [1]. But until mid feb I
>>>>>>> have full my calendar with multiple engagement, but will try to kickoff
>>>>>>> this. Thoughts , help appreciate on this.
>>>>>>>
>>>>>>> [1]http://wso2.com/projects/ozone/
>>>>>>>
>>>>>>>
>>>>>>> thanks
>>>>>>> --
>>>>>>> Lakmal Warusawithana
>>>>>>> Software Architect; WSO2 Inc.
>>>>>>> Mobile : +94714289692
>>>>>>> Blog : http://lakmalsview.blogspot.com/
>>>>>>>
>>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Lakmal Warusawithana
>>>>> Software Architect; WSO2 Inc.
>>>>> Mobile : +94714289692
>>>>> Blog : http://lakmalsview.blogspot.com/
>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> Pradeep Fernando.
>>>> http://pradeepfernando.blogspot.com/
>>>>
>>>
>>>
>>>
>>> --
>>> Sanjiva Weerawarana, Ph.D.
>>> Founder, Chairman & CEO; WSO2, Inc.; http://wso2.com/
>>> email: sanjiva@wso2.com; office: +1 650 745 4499 x5700; cell: +94 77
>>> 787 6880 | +1 650 265 8311
>>> blog: http://sanjiva.weerawarana.org/
>>> Lean . Enterprise . Middleware
>>>
>>
>>
>>
>> --
>> Pradeep Fernando.
>> http://pradeepfernando.blogspot.com/
>>
>
>
>
> --
> --
> Lahiru Sandaruwan
> Software Engineer,
> Platform Technologies,
> WSO2 Inc., http://wso2.com
> lean.enterprise.middleware
>
> email: lahirus@wso2.com cell: (+94) 773 325 954
> blog: http://lahiruwrites.blogspot.com/
> twitter: http://twitter.com/lahirus
> linked-in: http://lk.linkedin.com/pub/lahiru-sandaruwan/16/153/146
>
>
Re: [Discuss] Mockup IaaS for Stratos development
Posted by Lahiru Sandaruwan <la...@wso2.com>.
Hi all,
I see two important aspects in this thread.
1. Light weight development environment with light weight IaaS
2. Complete integration test with mocked external services(This does not
require an IaaS)
+1 for a LXC based environment for #1.
We have already started #2 for Autoscaler, may be we can extended it to
other products as well.
Thanks.
On Mon, Jan 13, 2014 at 9:53 AM, Pradeep Fernando <pr...@gmail.com>wrote:
>
> Hi,
>
> On Mon, Jan 13, 2014 at 4:55 AM, Sanjiva Weerawarana <sa...@wso2.com>wrote:
>
>> Pradeep lets chat a bit ..
>>
>
> Sure..
>
>
>> yes we should implement a jClouds wrapper for sure. The runtime bits are
>> quite straightforward IMO .. we use different ports and bring up LXCs and
>> have them communicate to the LB. Basically we're doing the work that the
>> LXC agent does in a machine underneath OpenStack right now.
>>
> To be honest i didnt think with LXC stuff in mind. I was thinking mocking
> the environment with pure java based mechanisms. (service calls/java
> reflection/etc). - my comfort zone i guess. So looks good and seems to be
> an interesting task. Will collaborate with Lakmal on this.
>
> --Pradeep
>
>
>> If you have time to start on this that'll be great - shouldn't take too
>> long to get to 80% aka working state!
>>
>> Sanjiva.
>>
>>
>> On Mon, Jan 13, 2014 at 12:43 AM, Pradeep Fernando <pr...@gmail.com>wrote:
>>
>>> Hi,
>>>
>>> I was discussing this with the team on friday and was going to send a
>>> mail. Never knew you had this in your mind. :)
>>>
>>> Since our IAAS abstraction is Jclouds, we should consider the
>>> possibitily of implementing the mock IAAS on top jclouds.
>>>
>>> Right now we test autoscaling and other fundamental stuff using EC2. It
>>> is quite painful and waste of money. I couldnt figure out how to mockup the
>>> runtime bits, like cartridge serving a request, but we can figure out those
>>> bits..
>>>
>>> --Pradeep
>>>
>>>
>>>
>>>
>>> On Sun, Jan 12, 2014 at 5:04 PM, Lakmal Warusawithana <la...@wso2.com>wrote:
>>>
>>>> Thanks Chris, will see how we can use jclouds mocks into this.
>>>>
>>>>
>>>> On Sun, Jan 12, 2014 at 4:29 PM, chris snow <ch...@gmail.com>wrote:
>>>>
>>>>> This would be awesome.
>>>>>
>>>>> If I remember correctly, jclouds has some mocks already - I had a
>>>>> brief look into this before, but haven't had time to thoroughly investigate.
>>>>> On 12 Jan 2014 10:43, "Lakmal Warusawithana" <la...@wso2.com> wrote:
>>>>>
>>>>>> Hi devs,
>>>>>>
>>>>>> Initially this idea is came from Sanjiva, to minimize the barriers to
>>>>>> contribution to Stratos. After chat I had with Sanjiva, I have thought
>>>>>> about what scenarios do we need to cover from this. Here is some points I
>>>>>> like to discuss. For a time being will call it "Stratos Dev IaaS" :)
>>>>>>
>>>>>> - get rid of complexity of the current IaaS setup which required
>>>>>> in Stratos. for a example even setting up OpenStack in single node,
>>>>>> required lot of resources, well as some deeper networking knowledge.
>>>>>> - this should easy to setup.
>>>>>> - should run with low resource. For achieve this, I am thinking
>>>>>> of directly create LXC as Cartridges.
>>>>>> - when developer need to do testing on some smart deployments
>>>>>> policies, it required, multi regions, zones ..etc IaaS environments which
>>>>>> is very hard to set it up or its very costly. So with this, we should
>>>>>> create mockups regions, zones ..etc.
>>>>>> - support mockup private IP and public IP
>>>>>> - support mockup multi network interfaces
>>>>>> - support mockup persistence volume for instances
>>>>>> - support API, which can call from jclouds
>>>>>>
>>>>>>
>>>>>> We can complete above features one by one but we should have proper
>>>>>> design to start up. I can take the ownership of developing this, since I
>>>>>> have done similar kind of IaaS in some times back [1]. But until mid feb I
>>>>>> have full my calendar with multiple engagement, but will try to kickoff
>>>>>> this. Thoughts , help appreciate on this.
>>>>>>
>>>>>> [1]http://wso2.com/projects/ozone/
>>>>>>
>>>>>>
>>>>>> thanks
>>>>>> --
>>>>>> Lakmal Warusawithana
>>>>>> Software Architect; WSO2 Inc.
>>>>>> Mobile : +94714289692
>>>>>> Blog : http://lakmalsview.blogspot.com/
>>>>>>
>>>>>>
>>>>
>>>>
>>>> --
>>>> Lakmal Warusawithana
>>>> Software Architect; WSO2 Inc.
>>>> Mobile : +94714289692
>>>> Blog : http://lakmalsview.blogspot.com/
>>>>
>>>>
>>>
>>>
>>> --
>>> Pradeep Fernando.
>>> http://pradeepfernando.blogspot.com/
>>>
>>
>>
>>
>> --
>> Sanjiva Weerawarana, Ph.D.
>> Founder, Chairman & CEO; WSO2, Inc.; http://wso2.com/
>> email: sanjiva@wso2.com; office: +1 650 745 4499 x5700; cell: +94 77 787
>> 6880 | +1 650 265 8311
>> blog: http://sanjiva.weerawarana.org/
>> Lean . Enterprise . Middleware
>>
>
>
>
> --
> Pradeep Fernando.
> http://pradeepfernando.blogspot.com/
>
--
--
Lahiru Sandaruwan
Software Engineer,
Platform Technologies,
WSO2 Inc., http://wso2.com
lean.enterprise.middleware
email: lahirus@wso2.com cell: (+94) 773 325 954
blog: http://lahiruwrites.blogspot.com/
twitter: http://twitter.com/lahirus
linked-in: http://lk.linkedin.com/pub/lahiru-sandaruwan/16/153/146
Re: [Discuss] Mockup IaaS for Stratos development
Posted by damitha kumarage <da...@gmail.com>.
If we are to have a complete unit/integrated testing environment of the
Stratos code base then getting the whole test suite run indedependant of
underlying IaaS environments like Openstack, EC2 and wholly depend on a
mock IaaS environment is great ease for developers. Perhaps like Pradeep
said no need to depend on lxc either.
Damitha
On Mon, Jan 13, 2014 at 9:53 AM, Pradeep Fernando <pr...@gmail.com>wrote:
>
> Hi,
>
> On Mon, Jan 13, 2014 at 4:55 AM, Sanjiva Weerawarana <sa...@wso2.com>wrote:
>
>> Pradeep lets chat a bit ..
>>
>
> Sure..
>
>
>> yes we should implement a jClouds wrapper for sure. The runtime bits are
>> quite straightforward IMO .. we use different ports and bring up LXCs and
>> have them communicate to the LB. Basically we're doing the work that the
>> LXC agent does in a machine underneath OpenStack right now.
>>
> To be honest i didnt think with LXC stuff in mind. I was thinking mocking
> the environment with pure java based mechanisms. (service calls/java
> reflection/etc). - my comfort zone i guess. So looks good and seems to be
> an interesting task. Will collaborate with Lakmal on this.
>
> --Pradeep
>
>
>> If you have time to start on this that'll be great - shouldn't take too
>> long to get to 80% aka working state!
>>
>> Sanjiva.
>>
>>
>> On Mon, Jan 13, 2014 at 12:43 AM, Pradeep Fernando <pr...@gmail.com>wrote:
>>
>>> Hi,
>>>
>>> I was discussing this with the team on friday and was going to send a
>>> mail. Never knew you had this in your mind. :)
>>>
>>> Since our IAAS abstraction is Jclouds, we should consider the
>>> possibitily of implementing the mock IAAS on top jclouds.
>>>
>>> Right now we test autoscaling and other fundamental stuff using EC2. It
>>> is quite painful and waste of money. I couldnt figure out how to mockup the
>>> runtime bits, like cartridge serving a request, but we can figure out those
>>> bits..
>>>
>>> --Pradeep
>>>
>>>
>>>
>>>
>>> On Sun, Jan 12, 2014 at 5:04 PM, Lakmal Warusawithana <la...@wso2.com>wrote:
>>>
>>>> Thanks Chris, will see how we can use jclouds mocks into this.
>>>>
>>>>
>>>> On Sun, Jan 12, 2014 at 4:29 PM, chris snow <ch...@gmail.com>wrote:
>>>>
>>>>> This would be awesome.
>>>>>
>>>>> If I remember correctly, jclouds has some mocks already - I had a
>>>>> brief look into this before, but haven't had time to thoroughly investigate.
>>>>> On 12 Jan 2014 10:43, "Lakmal Warusawithana" <la...@wso2.com> wrote:
>>>>>
>>>>>> Hi devs,
>>>>>>
>>>>>> Initially this idea is came from Sanjiva, to minimize the barriers to
>>>>>> contribution to Stratos. After chat I had with Sanjiva, I have thought
>>>>>> about what scenarios do we need to cover from this. Here is some points I
>>>>>> like to discuss. For a time being will call it "Stratos Dev IaaS" :)
>>>>>>
>>>>>> - get rid of complexity of the current IaaS setup which required
>>>>>> in Stratos. for a example even setting up OpenStack in single node,
>>>>>> required lot of resources, well as some deeper networking knowledge.
>>>>>> - this should easy to setup.
>>>>>> - should run with low resource. For achieve this, I am thinking
>>>>>> of directly create LXC as Cartridges.
>>>>>> - when developer need to do testing on some smart deployments
>>>>>> policies, it required, multi regions, zones ..etc IaaS environments which
>>>>>> is very hard to set it up or its very costly. So with this, we should
>>>>>> create mockups regions, zones ..etc.
>>>>>> - support mockup private IP and public IP
>>>>>> - support mockup multi network interfaces
>>>>>> - support mockup persistence volume for instances
>>>>>> - support API, which can call from jclouds
>>>>>>
>>>>>>
>>>>>> We can complete above features one by one but we should have proper
>>>>>> design to start up. I can take the ownership of developing this, since I
>>>>>> have done similar kind of IaaS in some times back [1]. But until mid feb I
>>>>>> have full my calendar with multiple engagement, but will try to kickoff
>>>>>> this. Thoughts , help appreciate on this.
>>>>>>
>>>>>> [1]http://wso2.com/projects/ozone/
>>>>>>
>>>>>>
>>>>>> thanks
>>>>>> --
>>>>>> Lakmal Warusawithana
>>>>>> Software Architect; WSO2 Inc.
>>>>>> Mobile : +94714289692
>>>>>> Blog : http://lakmalsview.blogspot.com/
>>>>>>
>>>>>>
>>>>
>>>>
>>>> --
>>>> Lakmal Warusawithana
>>>> Software Architect; WSO2 Inc.
>>>> Mobile : +94714289692
>>>> Blog : http://lakmalsview.blogspot.com/
>>>>
>>>>
>>>
>>>
>>> --
>>> Pradeep Fernando.
>>> http://pradeepfernando.blogspot.com/
>>>
>>
>>
>>
>> --
>> Sanjiva Weerawarana, Ph.D.
>> Founder, Chairman & CEO; WSO2, Inc.; http://wso2.com/
>> email: sanjiva@wso2.com; office: +1 650 745 4499 x5700; cell: +94 77 787
>> 6880 | +1 650 265 8311
>> blog: http://sanjiva.weerawarana.org/
>> Lean . Enterprise . Middleware
>>
>
>
>
> --
> Pradeep Fernando.
> http://pradeepfernando.blogspot.com/
>
--
__________________________________________________________________
Damitha Kumarage
http://people.apache.org/
__________________________________________________________________
Re: [Discuss] Mockup IaaS for Stratos development
Posted by Pradeep Fernando <pr...@gmail.com>.
Hi,
On Mon, Jan 13, 2014 at 4:55 AM, Sanjiva Weerawarana <sa...@wso2.com>wrote:
> Pradeep lets chat a bit ..
>
Sure..
> yes we should implement a jClouds wrapper for sure. The runtime bits are
> quite straightforward IMO .. we use different ports and bring up LXCs and
> have them communicate to the LB. Basically we're doing the work that the
> LXC agent does in a machine underneath OpenStack right now.
>
To be honest i didnt think with LXC stuff in mind. I was thinking mocking
the environment with pure java based mechanisms. (service calls/java
reflection/etc). - my comfort zone i guess. So looks good and seems to be
an interesting task. Will collaborate with Lakmal on this.
--Pradeep
> If you have time to start on this that'll be great - shouldn't take too
> long to get to 80% aka working state!
>
> Sanjiva.
>
>
> On Mon, Jan 13, 2014 at 12:43 AM, Pradeep Fernando <pr...@gmail.com>wrote:
>
>> Hi,
>>
>> I was discussing this with the team on friday and was going to send a
>> mail. Never knew you had this in your mind. :)
>>
>> Since our IAAS abstraction is Jclouds, we should consider the possibitily
>> of implementing the mock IAAS on top jclouds.
>>
>> Right now we test autoscaling and other fundamental stuff using EC2. It
>> is quite painful and waste of money. I couldnt figure out how to mockup the
>> runtime bits, like cartridge serving a request, but we can figure out those
>> bits..
>>
>> --Pradeep
>>
>>
>>
>>
>> On Sun, Jan 12, 2014 at 5:04 PM, Lakmal Warusawithana <la...@wso2.com>wrote:
>>
>>> Thanks Chris, will see how we can use jclouds mocks into this.
>>>
>>>
>>> On Sun, Jan 12, 2014 at 4:29 PM, chris snow <ch...@gmail.com> wrote:
>>>
>>>> This would be awesome.
>>>>
>>>> If I remember correctly, jclouds has some mocks already - I had a brief
>>>> look into this before, but haven't had time to thoroughly investigate.
>>>> On 12 Jan 2014 10:43, "Lakmal Warusawithana" <la...@wso2.com> wrote:
>>>>
>>>>> Hi devs,
>>>>>
>>>>> Initially this idea is came from Sanjiva, to minimize the barriers to
>>>>> contribution to Stratos. After chat I had with Sanjiva, I have thought
>>>>> about what scenarios do we need to cover from this. Here is some points I
>>>>> like to discuss. For a time being will call it "Stratos Dev IaaS" :)
>>>>>
>>>>> - get rid of complexity of the current IaaS setup which required
>>>>> in Stratos. for a example even setting up OpenStack in single node,
>>>>> required lot of resources, well as some deeper networking knowledge.
>>>>> - this should easy to setup.
>>>>> - should run with low resource. For achieve this, I am thinking of
>>>>> directly create LXC as Cartridges.
>>>>> - when developer need to do testing on some smart deployments
>>>>> policies, it required, multi regions, zones ..etc IaaS environments which
>>>>> is very hard to set it up or its very costly. So with this, we should
>>>>> create mockups regions, zones ..etc.
>>>>> - support mockup private IP and public IP
>>>>> - support mockup multi network interfaces
>>>>> - support mockup persistence volume for instances
>>>>> - support API, which can call from jclouds
>>>>>
>>>>>
>>>>> We can complete above features one by one but we should have proper
>>>>> design to start up. I can take the ownership of developing this, since I
>>>>> have done similar kind of IaaS in some times back [1]. But until mid feb I
>>>>> have full my calendar with multiple engagement, but will try to kickoff
>>>>> this. Thoughts , help appreciate on this.
>>>>>
>>>>> [1]http://wso2.com/projects/ozone/
>>>>>
>>>>>
>>>>> thanks
>>>>> --
>>>>> Lakmal Warusawithana
>>>>> Software Architect; WSO2 Inc.
>>>>> Mobile : +94714289692
>>>>> Blog : http://lakmalsview.blogspot.com/
>>>>>
>>>>>
>>>
>>>
>>> --
>>> Lakmal Warusawithana
>>> Software Architect; WSO2 Inc.
>>> Mobile : +94714289692
>>> Blog : http://lakmalsview.blogspot.com/
>>>
>>>
>>
>>
>> --
>> Pradeep Fernando.
>> http://pradeepfernando.blogspot.com/
>>
>
>
>
> --
> Sanjiva Weerawarana, Ph.D.
> Founder, Chairman & CEO; WSO2, Inc.; http://wso2.com/
> email: sanjiva@wso2.com; office: +1 650 745 4499 x5700; cell: +94 77 787
> 6880 | +1 650 265 8311
> blog: http://sanjiva.weerawarana.org/
> Lean . Enterprise . Middleware
>
--
Pradeep Fernando.
http://pradeepfernando.blogspot.com/
Re: [Discuss] Mockup IaaS for Stratos development
Posted by Sanjiva Weerawarana <sa...@wso2.com>.
Pradeep lets chat a bit .. yes we should implement a jClouds wrapper for
sure. The runtime bits are quite straightforward IMO .. we use different
ports and bring up LXCs and have them communicate to the LB. Basically
we're doing the work that the LXC agent does in a machine underneath
OpenStack right now.
If you have time to start on this that'll be great - shouldn't take too
long to get to 80% aka working state!
Sanjiva.
On Mon, Jan 13, 2014 at 12:43 AM, Pradeep Fernando <pr...@gmail.com>wrote:
> Hi,
>
> I was discussing this with the team on friday and was going to send a
> mail. Never knew you had this in your mind. :)
>
> Since our IAAS abstraction is Jclouds, we should consider the possibitily
> of implementing the mock IAAS on top jclouds.
>
> Right now we test autoscaling and other fundamental stuff using EC2. It is
> quite painful and waste of money. I couldnt figure out how to mockup the
> runtime bits, like cartridge serving a request, but we can figure out those
> bits..
>
> --Pradeep
>
>
>
>
> On Sun, Jan 12, 2014 at 5:04 PM, Lakmal Warusawithana <la...@wso2.com>wrote:
>
>> Thanks Chris, will see how we can use jclouds mocks into this.
>>
>>
>> On Sun, Jan 12, 2014 at 4:29 PM, chris snow <ch...@gmail.com> wrote:
>>
>>> This would be awesome.
>>>
>>> If I remember correctly, jclouds has some mocks already - I had a brief
>>> look into this before, but haven't had time to thoroughly investigate.
>>> On 12 Jan 2014 10:43, "Lakmal Warusawithana" <la...@wso2.com> wrote:
>>>
>>>> Hi devs,
>>>>
>>>> Initially this idea is came from Sanjiva, to minimize the barriers to
>>>> contribution to Stratos. After chat I had with Sanjiva, I have thought
>>>> about what scenarios do we need to cover from this. Here is some points I
>>>> like to discuss. For a time being will call it "Stratos Dev IaaS" :)
>>>>
>>>> - get rid of complexity of the current IaaS setup which required in
>>>> Stratos. for a example even setting up OpenStack in single node, required
>>>> lot of resources, well as some deeper networking knowledge.
>>>> - this should easy to setup.
>>>> - should run with low resource. For achieve this, I am thinking of
>>>> directly create LXC as Cartridges.
>>>> - when developer need to do testing on some smart deployments
>>>> policies, it required, multi regions, zones ..etc IaaS environments which
>>>> is very hard to set it up or its very costly. So with this, we should
>>>> create mockups regions, zones ..etc.
>>>> - support mockup private IP and public IP
>>>> - support mockup multi network interfaces
>>>> - support mockup persistence volume for instances
>>>> - support API, which can call from jclouds
>>>>
>>>>
>>>> We can complete above features one by one but we should have proper
>>>> design to start up. I can take the ownership of developing this, since I
>>>> have done similar kind of IaaS in some times back [1]. But until mid feb I
>>>> have full my calendar with multiple engagement, but will try to kickoff
>>>> this. Thoughts , help appreciate on this.
>>>>
>>>> [1]http://wso2.com/projects/ozone/
>>>>
>>>>
>>>> thanks
>>>> --
>>>> Lakmal Warusawithana
>>>> Software Architect; WSO2 Inc.
>>>> Mobile : +94714289692
>>>> Blog : http://lakmalsview.blogspot.com/
>>>>
>>>>
>>
>>
>> --
>> Lakmal Warusawithana
>> Software Architect; WSO2 Inc.
>> Mobile : +94714289692
>> Blog : http://lakmalsview.blogspot.com/
>>
>>
>
>
> --
> Pradeep Fernando.
> http://pradeepfernando.blogspot.com/
>
--
Sanjiva Weerawarana, Ph.D.
Founder, Chairman & CEO; WSO2, Inc.; http://wso2.com/
email: sanjiva@wso2.com; office: +1 650 745 4499 x5700; cell: +94 77 787
6880 | +1 650 265 8311
blog: http://sanjiva.weerawarana.org/
Lean . Enterprise . Middleware
Re: [Discuss] Mockup IaaS for Stratos development
Posted by Pradeep Fernando <pr...@gmail.com>.
Hi,
I was discussing this with the team on friday and was going to send a mail.
Never knew you had this in your mind. :)
Since our IAAS abstraction is Jclouds, we should consider the possibitily
of implementing the mock IAAS on top jclouds.
Right now we test autoscaling and other fundamental stuff using EC2. It is
quite painful and waste of money. I couldnt figure out how to mockup the
runtime bits, like cartridge serving a request, but we can figure out those
bits..
--Pradeep
On Sun, Jan 12, 2014 at 5:04 PM, Lakmal Warusawithana <la...@wso2.com>wrote:
> Thanks Chris, will see how we can use jclouds mocks into this.
>
>
> On Sun, Jan 12, 2014 at 4:29 PM, chris snow <ch...@gmail.com> wrote:
>
>> This would be awesome.
>>
>> If I remember correctly, jclouds has some mocks already - I had a brief
>> look into this before, but haven't had time to thoroughly investigate.
>> On 12 Jan 2014 10:43, "Lakmal Warusawithana" <la...@wso2.com> wrote:
>>
>>> Hi devs,
>>>
>>> Initially this idea is came from Sanjiva, to minimize the barriers to
>>> contribution to Stratos. After chat I had with Sanjiva, I have thought
>>> about what scenarios do we need to cover from this. Here is some points I
>>> like to discuss. For a time being will call it "Stratos Dev IaaS" :)
>>>
>>> - get rid of complexity of the current IaaS setup which required in
>>> Stratos. for a example even setting up OpenStack in single node, required
>>> lot of resources, well as some deeper networking knowledge.
>>> - this should easy to setup.
>>> - should run with low resource. For achieve this, I am thinking of
>>> directly create LXC as Cartridges.
>>> - when developer need to do testing on some smart deployments
>>> policies, it required, multi regions, zones ..etc IaaS environments which
>>> is very hard to set it up or its very costly. So with this, we should
>>> create mockups regions, zones ..etc.
>>> - support mockup private IP and public IP
>>> - support mockup multi network interfaces
>>> - support mockup persistence volume for instances
>>> - support API, which can call from jclouds
>>>
>>>
>>> We can complete above features one by one but we should have proper
>>> design to start up. I can take the ownership of developing this, since I
>>> have done similar kind of IaaS in some times back [1]. But until mid feb I
>>> have full my calendar with multiple engagement, but will try to kickoff
>>> this. Thoughts , help appreciate on this.
>>>
>>> [1]http://wso2.com/projects/ozone/
>>>
>>>
>>> thanks
>>> --
>>> Lakmal Warusawithana
>>> Software Architect; WSO2 Inc.
>>> Mobile : +94714289692
>>> Blog : http://lakmalsview.blogspot.com/
>>>
>>>
>
>
> --
> Lakmal Warusawithana
> Software Architect; WSO2 Inc.
> Mobile : +94714289692
> Blog : http://lakmalsview.blogspot.com/
>
>
--
Pradeep Fernando.
http://pradeepfernando.blogspot.com/
Re: [Discuss] Mockup IaaS for Stratos development
Posted by Lakmal Warusawithana <la...@wso2.com>.
Thanks Chris, will see how we can use jclouds mocks into this.
On Sun, Jan 12, 2014 at 4:29 PM, chris snow <ch...@gmail.com> wrote:
> This would be awesome.
>
> If I remember correctly, jclouds has some mocks already - I had a brief
> look into this before, but haven't had time to thoroughly investigate.
> On 12 Jan 2014 10:43, "Lakmal Warusawithana" <la...@wso2.com> wrote:
>
>> Hi devs,
>>
>> Initially this idea is came from Sanjiva, to minimize the barriers to
>> contribution to Stratos. After chat I had with Sanjiva, I have thought
>> about what scenarios do we need to cover from this. Here is some points I
>> like to discuss. For a time being will call it "Stratos Dev IaaS" :)
>>
>> - get rid of complexity of the current IaaS setup which required in
>> Stratos. for a example even setting up OpenStack in single node, required
>> lot of resources, well as some deeper networking knowledge.
>> - this should easy to setup.
>> - should run with low resource. For achieve this, I am thinking of
>> directly create LXC as Cartridges.
>> - when developer need to do testing on some smart deployments
>> policies, it required, multi regions, zones ..etc IaaS environments which
>> is very hard to set it up or its very costly. So with this, we should
>> create mockups regions, zones ..etc.
>> - support mockup private IP and public IP
>> - support mockup multi network interfaces
>> - support mockup persistence volume for instances
>> - support API, which can call from jclouds
>>
>>
>> We can complete above features one by one but we should have proper
>> design to start up. I can take the ownership of developing this, since I
>> have done similar kind of IaaS in some times back [1]. But until mid feb I
>> have full my calendar with multiple engagement, but will try to kickoff
>> this. Thoughts , help appreciate on this.
>>
>> [1]http://wso2.com/projects/ozone/
>>
>>
>> thanks
>> --
>> Lakmal Warusawithana
>> Software Architect; WSO2 Inc.
>> Mobile : +94714289692
>> Blog : http://lakmalsview.blogspot.com/
>>
>>
--
Lakmal Warusawithana
Software Architect; WSO2 Inc.
Mobile : +94714289692
Blog : http://lakmalsview.blogspot.com/
Re: [Discuss] Mockup IaaS for Stratos development
Posted by chris snow <ch...@gmail.com>.
This would be awesome.
If I remember correctly, jclouds has some mocks already - I had a brief
look into this before, but haven't had time to thoroughly investigate.
On 12 Jan 2014 10:43, "Lakmal Warusawithana" <la...@wso2.com> wrote:
> Hi devs,
>
> Initially this idea is came from Sanjiva, to minimize the barriers to
> contribution to Stratos. After chat I had with Sanjiva, I have thought
> about what scenarios do we need to cover from this. Here is some points I
> like to discuss. For a time being will call it "Stratos Dev IaaS" :)
>
> - get rid of complexity of the current IaaS setup which required in
> Stratos. for a example even setting up OpenStack in single node, required
> lot of resources, well as some deeper networking knowledge.
> - this should easy to setup.
> - should run with low resource. For achieve this, I am thinking of
> directly create LXC as Cartridges.
> - when developer need to do testing on some smart deployments
> policies, it required, multi regions, zones ..etc IaaS environments which
> is very hard to set it up or its very costly. So with this, we should
> create mockups regions, zones ..etc.
> - support mockup private IP and public IP
> - support mockup multi network interfaces
> - support mockup persistence volume for instances
> - support API, which can call from jclouds
>
>
> We can complete above features one by one but we should have proper design
> to start up. I can take the ownership of developing this, since I have done
> similar kind of IaaS in some times back [1]. But until mid feb I have full
> my calendar with multiple engagement, but will try to kickoff this.
> Thoughts , help appreciate on this.
>
> [1]http://wso2.com/projects/ozone/
>
>
> thanks
> --
> Lakmal Warusawithana
> Software Architect; WSO2 Inc.
> Mobile : +94714289692
> Blog : http://lakmalsview.blogspot.com/
>
>
Re: [Discuss] Mockup IaaS for Stratos development
Posted by Lahiru Sandaruwan <la...@wso2.com>.
Hi Nirmal,
On Wed, Jan 22, 2014 at 7:19 PM, Nirmal Fernando <ni...@gmail.com>wrote:
> Hi All,
>
> While reading this again, following question popped out. If the proposed
> IaaS is to easily test the basic flow of Stratos core components (IaaS
> independent tasks) this would certainly worth to have, but if the intention
> is to test IaaS specific stuff (eg: attaching volumes, handling multiple
> networks) can we come to any conclusion after testing with this mock IaaS?
>
To test the flow without IaaS specific stuff, we should have a strong
integration test suit as i mentioned earlier as well.
IMO testing basic flow should be the intention of mock IaaS. Then a
developer can run end to end flow in his/her machine itself when
developing. This will help testing cartridge agent, puppet based stuff etc.
Third level of testing is the real testing in a real IaaS. There we can
test attaching volumes, long running tests, and load testing.
Thanks.
>
> On Sun, Jan 12, 2014 at 4:13 PM, Lakmal Warusawithana <la...@wso2.com>wrote:
>
>> Hi devs,
>>
>> Initially this idea is came from Sanjiva, to minimize the barriers to
>> contribution to Stratos. After chat I had with Sanjiva, I have thought
>> about what scenarios do we need to cover from this. Here is some points I
>> like to discuss. For a time being will call it "Stratos Dev IaaS" :)
>>
>> - get rid of complexity of the current IaaS setup which required in
>> Stratos. for a example even setting up OpenStack in single node, required
>> lot of resources, well as some deeper networking knowledge.
>> - this should easy to setup.
>> - should run with low resource. For achieve this, I am thinking of
>> directly create LXC as Cartridges.
>> - when developer need to do testing on some smart deployments
>> policies, it required, multi regions, zones ..etc IaaS environments which
>> is very hard to set it up or its very costly. So with this, we should
>> create mockups regions, zones ..etc.
>> - support mockup private IP and public IP
>> - support mockup multi network interfaces
>> - support mockup persistence volume for instances
>> - support API, which can call from jclouds
>>
>>
>> We can complete above features one by one but we should have proper
>> design to start up. I can take the ownership of developing this, since I
>> have done similar kind of IaaS in some times back [1]. But until mid feb I
>> have full my calendar with multiple engagement, but will try to kickoff
>> this. Thoughts , help appreciate on this.
>>
>> [1]http://wso2.com/projects/ozone/
>>
>>
>> thanks
>> --
>> Lakmal Warusawithana
>> Software Architect; WSO2 Inc.
>> Mobile : +94714289692
>> Blog : http://lakmalsview.blogspot.com/
>>
>>
>
>
> --
> Best Regards,
> Nirmal
>
> Nirmal Fernando.
> PPMC Member & Committer of Apache Stratos,
> Senior Software Engineer, WSO2 Inc.
>
> Blog: http://nirmalfdo.blogspot.com/
>
--
--
Lahiru Sandaruwan
Software Engineer,
Platform Technologies,
WSO2 Inc., http://wso2.com
lean.enterprise.middleware
email: lahirus@wso2.com cell: (+94) 773 325 954
blog: http://lahiruwrites.blogspot.com/
twitter: http://twitter.com/lahirus
linked-in: http://lk.linkedin.com/pub/lahiru-sandaruwan/16/153/146
Re: [Discuss] Mockup IaaS for Stratos development
Posted by Nirmal Fernando <ni...@gmail.com>.
Hi All,
While reading this again, following question popped out. If the proposed
IaaS is to easily test the basic flow of Stratos core components (IaaS
independent tasks) this would certainly worth to have, but if the intention
is to test IaaS specific stuff (eg: attaching volumes, handling multiple
networks) can we come to any conclusion after testing with this mock IaaS?
On Sun, Jan 12, 2014 at 4:13 PM, Lakmal Warusawithana <la...@wso2.com>wrote:
> Hi devs,
>
> Initially this idea is came from Sanjiva, to minimize the barriers to
> contribution to Stratos. After chat I had with Sanjiva, I have thought
> about what scenarios do we need to cover from this. Here is some points I
> like to discuss. For a time being will call it "Stratos Dev IaaS" :)
>
> - get rid of complexity of the current IaaS setup which required in
> Stratos. for a example even setting up OpenStack in single node, required
> lot of resources, well as some deeper networking knowledge.
> - this should easy to setup.
> - should run with low resource. For achieve this, I am thinking of
> directly create LXC as Cartridges.
> - when developer need to do testing on some smart deployments
> policies, it required, multi regions, zones ..etc IaaS environments which
> is very hard to set it up or its very costly. So with this, we should
> create mockups regions, zones ..etc.
> - support mockup private IP and public IP
> - support mockup multi network interfaces
> - support mockup persistence volume for instances
> - support API, which can call from jclouds
>
>
> We can complete above features one by one but we should have proper design
> to start up. I can take the ownership of developing this, since I have done
> similar kind of IaaS in some times back [1]. But until mid feb I have full
> my calendar with multiple engagement, but will try to kickoff this.
> Thoughts , help appreciate on this.
>
> [1]http://wso2.com/projects/ozone/
>
>
> thanks
> --
> Lakmal Warusawithana
> Software Architect; WSO2 Inc.
> Mobile : +94714289692
> Blog : http://lakmalsview.blogspot.com/
>
>
--
Best Regards,
Nirmal
Nirmal Fernando.
PPMC Member & Committer of Apache Stratos,
Senior Software Engineer, WSO2 Inc.
Blog: http://nirmalfdo.blogspot.com/