You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users-cn@cloudstack.apache.org by Edison Su <Ed...@citrix.com> on 2012/07/07 04:37:42 UTC

[RFC] DevCloud, an all-in-one-box CloudStack development environment

Hi All,
   I created an all-in-one-box CloudStack development environment, name it as DevCloud. It's ready to download from http://download.cloud.com/templates/devcloud/DevCloud.ova and the document is put at http://wiki.cloudstack.org/display/comm/DevCloud. 
   If you are a CloudStack developer whose daily tasks are directly related to hypervisor, or are interested in CloudStack but don't want to setup a CloudStack environment by yourself, welcome to have a try. 
   Comments are welcome!
   Note: the image is about 1.5G, the downloading may take a while.

Re: About server hardware

Posted by sebastien goasguen <ru...@gmail.com>.
Hi,

That will work. How well ? not sure. I/O experts should comment on how to
tune it.
The faster the disks on your host the better, and you will want to make
sure your guest VMs have virtio.

Your notation confused me a bit.
RAM: +/- 4GB could mean a variation of 4 GB. Maybe writing RAM: ~4GB is
better.

-sebastien


On Mon, Jul 9, 2012 at 9:28 AM, Jewel Nuruddin <je...@yahoo.com>wrote:

> Hi,
>
> Thank you very much, actually I have the following scenario for hypervisor
> .
> HDD: 500 GB
> RAM: 32GB
> CPU 8 Core @2.9GHz
>
> and each guest vm is
> HDD: 50GB
> RAM: +/- 4 GB
> CPU 1 Core +/-@ 2.0 GHz
> Maximum 8 guest VM
>
> in my server two eth each  gigabit
>
> I want to run some mysql and membase service which have huge disk I/O
> So is the server configuration is OK or do i need SAS HDD or something
> else?
>
> Thanks
> Jewel
>
> --- On *Mon, 7/9/12, sebastien goasguen <ru...@gmail.com>* wrote:
>
>
> From: sebastien goasguen <ru...@gmail.com>
> Subject: Re: About server hardware
> To: cloudstack-users@incubator.apache.org
> Cc: "jewel.nuruddin@yahoo.com" <je...@yahoo.com>
> Date: Monday, July 9, 2012, 10:12 PM
>
> Hi Jewel,
>
> I agree with Abhi, you would need to describe your use case in more
> details.
> Specifying the amount of resources needed for each VM and the hypervisor
> used.
>
> If you cannot overcommit memory and want 1GB per VM, then you need at
> least 8 GB RAM plus extra for hypervisor/host kernel. If you *can*
> over commit then you may choose to use less RAM on the host (<8GB ofr
> 1GB guests).
>
> Same thing with the number of cores, you could have only 4 or 6 cores
> but run 8 VMs.
>
> This is really a guest VM performance issue, as well as workload
> profile. Hypervisor experts should be able to help with different
> scenarios and identify a rule of thumb.
>
> -Sebastien
>
>
> On Mon, Jul 9, 2012 at 8:48 AM, Abhinandan Prateek
> <Ab...@citrix.com>>
> wrote:
> > Hi Jewel,
> >    If you list down the requirements for the guest VM in terms of CPU,
> RAM and storage adding that to Xenserver overhead you can get the
> requirements for the hardware you need.
> > For Xenserver overhead, simple rule of thumb is to allow 512 MB for the
> XenServer total (Hypervisor plus the control domain) if there is less than
> 5 GB of memory in the server, and allow 1 GB of memory if there>   Also you
> need to decide if you want HA, in that case you will need some redundant
> hardware.
> > -abhi
> >
> >>-----Original Message-----
> >>From: Jewel Nuruddin [mailto:jewel.nuruddin@yahoo.com<ht...@yahoo.com>
> ]
> >>Sent: Monday, July 09, 2012 4:27 PM
> >>To: cloudstack-dev@incubator.apache.org<ht...@incubator.apache.org>;
> cloudstack-
> >>users@incubator.apache.org<ht...@incubator.apache.org>
> >>Cc: cloudstack-users@incubator.apache.org<ht...@incubator.apache.org>
> >>Subject: About server hardware
> >>
> >>Hi All,
> >>
> >>Need one comments about server hardware.
> >>In one hypervisor I want to run 8 guest vm, what will be the main
> hardware I
> >>have to take care properly!
> >>can any one have any thought?
> >>
> >>Thanks
> >>Jewel
>
>
>
> --
> ---
> Sebastien Goasguen
> Open Source Cloud Evangelist, Cloudstack
> http://sites.google.com/site/runseb/
>
>


-- 
---
Sebastien Goasguen
Open Source Cloud Evangelist, Cloudstack
http://sites.google.com/site/runseb/

Re: About server hardware

Posted by Jewel Nuruddin <je...@yahoo.com>.
Hi,

Thank you very much, actually I have the following scenario for hypervisor.
HDD: 500 GB
RAM: 32GB 
CPU 8 Core @2.9GHz

and each guest vm is
HDD: 50GB
RAM: +/- 4 GB
CPU 1 Core +/-@ 2.0 GHz
Maximum 8 guest VM

in my server two eth each  gigabit 

I want to run some mysql and membase service which have huge disk I/O
So is the server configuration is OK or do i need SAS HDD or something else?

Thanks
Jewel 

--- On Mon, 7/9/12, sebastien goasguen <ru...@gmail.com> wrote:

From: sebastien goasguen <ru...@gmail.com>
Subject: Re: About server hardware
To: cloudstack-users@incubator.apache.org
Cc: "jewel.nuruddin@yahoo.com" <je...@yahoo.com>
Date: Monday, July 9, 2012, 10:12 PM

Hi Jewel,

I agree with Abhi, you would need to describe your use case in more details.
Specifying the amount of resources needed for each VM and the hypervisor used.

If you cannot overcommit memory and want 1GB per VM, then you need at
least 8 GB RAM plus extra for hypervisor/host kernel. If you *can*
over commit then you may choose to use less RAM on the host (<8GB ofr
1GB guests).

Same thing with the number of cores, you could have only 4 or 6 cores
but run 8 VMs.

This is really a guest VM performance issue, as well as workload
profile. Hypervisor experts should be able to help with different
scenarios and identify a rule of thumb.

-Sebastien


On Mon, Jul 9, 2012 at 8:48 AM, Abhinandan Prateek
<Ab...@citrix.com> wrote:
> Hi Jewel,
>    If you list down the requirements for the guest VM in terms of CPU, RAM and storage adding that to Xenserver overhead you can get the requirements for the hardware you need.
> For Xenserver overhead, simple rule of thumb is to allow 512 MB for the XenServer total (Hypervisor plus the control domain) if there is less than 5 GB of memory in the server, and allow 1 GB of memory if there>   Also you need to decide if you want HA, in that case you will need some redundant hardware.
> -abhi
>
>>-----Original Message-----
>>From: Jewel Nuruddin [mailto:jewel.nuruddin@yahoo.com]
>>Sent: Monday, July 09, 2012 4:27 PM
>>To: cloudstack-dev@incubator.apache.org; cloudstack-
>>users@incubator.apache.org
>>Cc: cloudstack-users@incubator.apache.org
>>Subject: About server hardware
>>
>>Hi All,
>>
>>Need one comments about server hardware.
>>In one hypervisor I want to run 8 guest vm, what will be the main hardware I
>>have to take care properly!
>>can any one have any thought?
>>
>>Thanks
>>Jewel



-- 
---
Sebastien Goasguen
Open Source Cloud Evangelist, Cloudstack
http://sites.google.com/site/runseb/

Re: About server hardware

Posted by sebastien goasguen <ru...@gmail.com>.
Hi Jewel,

I agree with Abhi, you would need to describe your use case in more details.
Specifying the amount of resources needed for each VM and the hypervisor used.

If you cannot overcommit memory and want 1GB per VM, then you need at
least 8 GB RAM plus extra for hypervisor/host kernel. If you *can*
over commit then you may choose to use less RAM on the host (<8GB ofr
1GB guests).

Same thing with the number of cores, you could have only 4 or 6 cores
but run 8 VMs.

This is really a guest VM performance issue, as well as workload
profile. Hypervisor experts should be able to help with different
scenarios and identify a rule of thumb.

-Sebastien


On Mon, Jul 9, 2012 at 8:48 AM, Abhinandan Prateek
<Ab...@citrix.com> wrote:
> Hi Jewel,
>    If you list down the requirements for the guest VM in terms of CPU, RAM and storage adding that to Xenserver overhead you can get the requirements for the hardware you need.
> For Xenserver overhead, simple rule of thumb is to allow 512 MB for the XenServer total (Hypervisor plus the control domain) if there is less than 5 GB of memory in the server, and allow 1 GB of memory if there>   Also you need to decide if you want HA, in that case you will need some redundant hardware.
> -abhi
>
>>-----Original Message-----
>>From: Jewel Nuruddin [mailto:jewel.nuruddin@yahoo.com]
>>Sent: Monday, July 09, 2012 4:27 PM
>>To: cloudstack-dev@incubator.apache.org; cloudstack-
>>users@incubator.apache.org
>>Cc: cloudstack-users@incubator.apache.org
>>Subject: About server hardware
>>
>>Hi All,
>>
>>Need one comments about server hardware.
>>In one hypervisor I want to run 8 guest vm, what will be the main hardware I
>>have to take care properly!
>>can any one have any thought?
>>
>>Thanks
>>Jewel



-- 
---
Sebastien Goasguen
Open Source Cloud Evangelist, Cloudstack
http://sites.google.com/site/runseb/

RE: About server hardware

Posted by Jewel Nuruddin <je...@yahoo.com>.
Hi Abhi,

Thank you very much, actually I have the following scenario for hypervisor.
HDD: 500 GB
RAM: 32GB 
CPU 8 Core @2.9GHz

and each guest vm is
HDD: 50GB
RAM: +/- 4 GB
CPU 1 Core +/-@ 2.0 GHz
Maximum 8 guest VM

in my server two eth each  gigabit 

I want to run some mysql and membase service which have huge disk I/O
So is the server configuration is OK or do i need SAS HDD or something else?

Thanks
Jewel 

--- On Mon, 7/9/12, Abhinandan Prateek <Ab...@citrix.com> wrote:

From: Abhinandan Prateek <Ab...@citrix.com>
Subject: RE: About server hardware
To: "cloudstack-users@incubator.apache.org" <cl...@incubator.apache.org>, "jewel.nuruddin@yahoo.com" <je...@yahoo.com>
Date: Monday, July 9, 2012, 9:48 PM

Hi Jewel,
   If you list down the requirements for the guest VM in terms of CPU, RAM and storage adding that to Xenserver overhead you can get the requirements for the hardware you need.
For Xenserver overhead, simple rule of thumb is to allow 512 MB for the XenServer total (Hypervisor plus the control domain) if there is less than 5 GB of memory in the server, and allow 1 GB of memory if there is more than 5 GB in the server. 
  Also you need to decide if you want HA, in that case you will need some redundant hardware.
-abhi

>-----Original Message-----
>From: Jewel Nuruddin [mailto:jewel.nuruddin@yahoo.com]
>Sent: Monday, July 09, 2012 4:27 PM
>To: cloudstack-dev@incubator.apache.org; cloudstack-
>users@incubator.apache.org
>Cc: cloudstack-users@incubator.apache.org
>Subject: About server hardware
>
>Hi All,
>
>Need one comments about server hardware.
>In one hypervisor I want to run 8 guest vm, what will be the main hardware I
>have to take care properly!
>can any one have any thought?
>
>Thanks
>Jewel

RE: About server hardware

Posted by Abhinandan Prateek <Ab...@citrix.com>.
Hi Jewel,
   If you list down the requirements for the guest VM in terms of CPU, RAM and storage adding that to Xenserver overhead you can get the requirements for the hardware you need.
For Xenserver overhead, simple rule of thumb is to allow 512 MB for the XenServer total (Hypervisor plus the control domain) if there is less than 5 GB of memory in the server, and allow 1 GB of memory if there is more than 5 GB in the server. 
  Also you need to decide if you want HA, in that case you will need some redundant hardware.
-abhi

>-----Original Message-----
>From: Jewel Nuruddin [mailto:jewel.nuruddin@yahoo.com]
>Sent: Monday, July 09, 2012 4:27 PM
>To: cloudstack-dev@incubator.apache.org; cloudstack-
>users@incubator.apache.org
>Cc: cloudstack-users@incubator.apache.org
>Subject: About server hardware
>
>Hi All,
>
>Need one comments about server hardware.
>In one hypervisor I want to run 8 guest vm, what will be the main hardware I
>have to take care properly!
>can any one have any thought?
>
>Thanks
>Jewel

RE: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Edison Su <Ed...@citrix.com>.

> -----Original Message-----
> From: tomoe@midokura.jp [mailto:tomoe@midokura.jp] On Behalf Of Tomoe
> Sugihara
> Sent: Thursday, July 12, 2012 10:29 AM
> To: cloudstack-dev@incubator.apache.org
> Cc: cloudstack-users@incubator.apache.org
> Subject: Re: [RFC] DevCloud, an all-in-one-box CloudStack development
> environment
> 
> Hi Edison,
> 
> I have been playing around with DevCloud and I wanted to share
> my findings here:
> 
> 1. Needs more memory for guests
> 
>  I'd been getting InsufficientServerCapacityException when I tried
> launching a VM after rdeploy*, rdebug and adding a basic ZONE.
> 
>  I found that a router VM will be spun up upon launching a VM
> with CentOS template and total number of VM will be 4 (SSVM, CPVM,
> Router VM, new instance). Total mem on the host(DevCloud) in the DB is
> below 400MB(IIRC), and that's not enough for 4 VMs.
> 
> 
> 2. OOM kills server
> 
>    Often times, inside management server, OOM killer kills management
> java process. You may want to allocate more memory for the mgmt server
> and/or add some swap.


Yah, the default memory allocated to DevCloud is very small, only around 400M is available to VMs.
There are many ways to mitigate the issue:
1. decrease the ram requirement for VM: right now, by default, each VM needs 100M, this can be smaller.
2. Increase the memory used by DevCloud, the default 1G total memory, is just the memory that allow you to create one user vm, for the simplest test purpose.
3. If #2 is available, then increase the memory used by dom0, that will fix the OOM issue. By default, the dom0 uses 512M, which is not enough for a java mgt server...

All of the above items are configurable, for developer, better to increase the memory for devcloud, such as, 2G memory: 1G memory for dom0, 1G memory for VMs(around 6 user Vms can be created). Of cause, the more memory, the better.

> 
> 3. DNS nat doesn't work on Ubuntu precise(4.1.1878361~Ubuntu~precise)
> 
> By default, the DNS server nat setting with 10.0.2.3 didn't work and
> that
> made it slow to ssh into DevCloud.
> 
> I found an workaround by running the following command:
> 
>  VBoxManage modifyvm DevCloud --natdnshostresolver1 on

I only tested it on Mac/Fedora, the default 10.0.2.3 DNS works for me. I'll document your finding.
Thanks for your feedback. 

> 
> 
> Thanks,
> Tomoe
> 
> 
> On Wed, Jul 11, 2012 at 9:02 AM, Edison Su <Ed...@citrix.com> wrote:
> >
> >
> >> -----Original Message-----
> >> From: tomoe@midokura.jp [mailto:tomoe@midokura.jp] On Behalf Of
> Tomoe
> >> Sugihara
> >> Sent: Tuesday, July 10, 2012 4:40 PM
> >> To: cloudstack-users@incubator.apache.org
> >> Cc: cloudstack-dev@incubator.apache.org
> >> Subject: Re: [RFC] DevCloud, an all-in-one-box CloudStack
> development
> >> environment
> >>
> >> On Wed, Jul 11, 2012 at 2:33 AM, Edison Su <Ed...@citrix.com>
> wrote:
> >> >
> >> >
> >> >> -----Original Message-----
> >> >> From: tomoe@midokura.jp [mailto:tomoe@midokura.jp] On Behalf Of
> >> Tomoe
> >> >> Sugihara
> >> >> Sent: Tuesday, July 10, 2012 1:22 AM
> >> >> To: cloudstack-dev@incubator.apache.org
> >> >> Cc: cloudstack-users@incubator.apache.org
> >> >> Subject: Re: [RFC] DevCloud, an all-in-one-box CloudStack
> >> development
> >> >> environment
> >> >>
> >> >> On Tue, Jul 10, 2012 at 3:32 AM, Edison Su <Ed...@citrix.com>
> >> wrote:
> >> >>
> >> >> > >
> >> >> > > Not rdeploydb, but successfully ran "rdebug".
> >> >> > > However, I still can't find ListTemplate even in
> /var/log/cloud/
> >> >> >
> >> >> > Better to fix rdeploydb at first, right now, your system is in
> a
> >> good
> >> >> shape.
> >> >> > If you had taken a snapshot for devcloud after importing the
> >> >> devcloud.ova into virtualbox, then you can revert back to the
> >> initial
> >> >> state.
> >> >> > Then we can test the preinstalled cloudstack mgt server works
> for
> >> you
> >> >> or not, by go to http://localhost:8080/client, then enable the
> zone,
> >> >> wait for a few minutes, ssvm will come up, and the tiny user vm
> will
> >> be
> >> >> available.
> >> >> > Anyway, I'll write up the whole setup/configuration/how-to-use,
> >> step-
> >> >> by-step illustrated.
> >> >>
> >> >>
> >> >> Thanks for the writeup. That's very helpful.
> >> >> I started from scratch and was able to see the tiny Linux
> template
> >> is
> >> >> normal.
> >> >>
> >> >> Now, another problem is that I can't seem to launch a VM; I'm
> >> getting
> >> >> this error:
> >> >> ---------------------------
> >> >>   [sshexec]      [java] INFO  [api.commands.DeployVMCmd]
> >> >> (Job-Executor-13:job-13)
> >> >> com.cloud.exception.InsufficientServerCapacityException: Unable
> to
> >> >> create a deployment for VM[User|ccc]Scope=interface
> >> >> com.cloud.dc.DataCenter; id=1
> >> >> --------------------------
> >> >
> >> > Which service offering are you using to create the VM? Need to use
> >> tinyServiceOffering.
> >>
> >> I'm using "tinyOffering" in "Compute offering" menu in launching VM
> >> wizard.
> >> I can't find "tinyServiceOffering" anywhere. Am I missing something?
> >>
> >> >> I also tried launching a VM with vanilla DevCloud(without doing
> any
> >> >> ant commands),
> >> >>  and I was ableto launch it. However, the launched tty Linux gets
> ip
> >> >> address 10.0.0.15,
> >> >>  which is the same address as devcloud and then web GUI became
> >> >> inaccessible.
> >> >
> >> > That's weird, normally DevCloud will get 10.0.2.15 itself, user vm
> >> will get other ip address.
> >> > Which VirtualBox are you using? On which platform?
> >>
> >> I'm using virtualbox-4.1 (4.1.18-78361~Ubuntu~precise) on Ubuntu
> 12.04.
> >> This happens consistently, at least I hit 3 times in a row.
> > I added a fix into master, that disable virtualbox DHCP server for
> the VMs created by CloudStack.
> > Right now, you can manually execute the following scripts inside
> devcloud:
> >
> > apt-get install ebtables
> > iptables -A POSTROUTING -t mangle -p udp --dport bootpc -j CHECKSUM -
> -checksum-fill
> > mac=`ifconfig xenbr0 |grep HWaddr |awk '{print $5}'`
> > ebtables -I FORWARD -d ! $mac -i eth0 -p IPV4 --ip-prot udp --ip-
> dport 67:68 -j DROP
> > iptables-save > /etc/iptables.save
> > /etc/init.d/ebtables save
> >
> > And add
> > pre-up iptables-save < /etc/iptables.save
> > pre-up /etc/init.d/ebtables load
> >
> > at the end of /etc/network/interfaces, then stop/start your user vm,
> see what happened.
> >
> > the commit number is fb59fc5c8a5114ca0c7da8c602a806dc77735c2e, if you
> want take a look at the fix.
> >
> >
> >>
> >> >> As a side note, it should be useful to add a port forward setting
> >> for
> >> >> 8787 in VirtualBox
> >> >> so we can remote debug easily.
> >> >
> >> >
> >> > Will do, and also 8250.
> >>
> >> Can I ask what 8250 is for?
> >
> > To add external hypervisor host(the actual physical host) into
> CloudStack mgt server running inside DevCloud, if ssvm/cpvm created on
> external host, 8250 will be used by the java agent inside ssvm/cpvm to
> connect to mgt server.
> >
> >>
> >> Thanks,
> >> Tomoe

RE: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Edison Su <Ed...@citrix.com>.

> -----Original Message-----
> From: tomoe@midokura.jp [mailto:tomoe@midokura.jp] On Behalf Of Tomoe
> Sugihara
> Sent: Thursday, July 12, 2012 10:29 AM
> To: cloudstack-dev@incubator.apache.org
> Cc: cloudstack-users@incubator.apache.org
> Subject: Re: [RFC] DevCloud, an all-in-one-box CloudStack development
> environment
> 
> Hi Edison,
> 
> I have been playing around with DevCloud and I wanted to share
> my findings here:
> 
> 1. Needs more memory for guests
> 
>  I'd been getting InsufficientServerCapacityException when I tried
> launching a VM after rdeploy*, rdebug and adding a basic ZONE.
> 
>  I found that a router VM will be spun up upon launching a VM
> with CentOS template and total number of VM will be 4 (SSVM, CPVM,
> Router VM, new instance). Total mem on the host(DevCloud) in the DB is
> below 400MB(IIRC), and that's not enough for 4 VMs.
> 
> 
> 2. OOM kills server
> 
>    Often times, inside management server, OOM killer kills management
> java process. You may want to allocate more memory for the mgmt server
> and/or add some swap.


Yah, the default memory allocated to DevCloud is very small, only around 400M is available to VMs.
There are many ways to mitigate the issue:
1. decrease the ram requirement for VM: right now, by default, each VM needs 100M, this can be smaller.
2. Increase the memory used by DevCloud, the default 1G total memory, is just the memory that allow you to create one user vm, for the simplest test purpose.
3. If #2 is available, then increase the memory used by dom0, that will fix the OOM issue. By default, the dom0 uses 512M, which is not enough for a java mgt server...

All of the above items are configurable, for developer, better to increase the memory for devcloud, such as, 2G memory: 1G memory for dom0, 1G memory for VMs(around 6 user Vms can be created). Of cause, the more memory, the better.

> 
> 3. DNS nat doesn't work on Ubuntu precise(4.1.1878361~Ubuntu~precise)
> 
> By default, the DNS server nat setting with 10.0.2.3 didn't work and
> that
> made it slow to ssh into DevCloud.
> 
> I found an workaround by running the following command:
> 
>  VBoxManage modifyvm DevCloud --natdnshostresolver1 on

I only tested it on Mac/Fedora, the default 10.0.2.3 DNS works for me. I'll document your finding.
Thanks for your feedback. 

> 
> 
> Thanks,
> Tomoe
> 
> 
> On Wed, Jul 11, 2012 at 9:02 AM, Edison Su <Ed...@citrix.com> wrote:
> >
> >
> >> -----Original Message-----
> >> From: tomoe@midokura.jp [mailto:tomoe@midokura.jp] On Behalf Of
> Tomoe
> >> Sugihara
> >> Sent: Tuesday, July 10, 2012 4:40 PM
> >> To: cloudstack-users@incubator.apache.org
> >> Cc: cloudstack-dev@incubator.apache.org
> >> Subject: Re: [RFC] DevCloud, an all-in-one-box CloudStack
> development
> >> environment
> >>
> >> On Wed, Jul 11, 2012 at 2:33 AM, Edison Su <Ed...@citrix.com>
> wrote:
> >> >
> >> >
> >> >> -----Original Message-----
> >> >> From: tomoe@midokura.jp [mailto:tomoe@midokura.jp] On Behalf Of
> >> Tomoe
> >> >> Sugihara
> >> >> Sent: Tuesday, July 10, 2012 1:22 AM
> >> >> To: cloudstack-dev@incubator.apache.org
> >> >> Cc: cloudstack-users@incubator.apache.org
> >> >> Subject: Re: [RFC] DevCloud, an all-in-one-box CloudStack
> >> development
> >> >> environment
> >> >>
> >> >> On Tue, Jul 10, 2012 at 3:32 AM, Edison Su <Ed...@citrix.com>
> >> wrote:
> >> >>
> >> >> > >
> >> >> > > Not rdeploydb, but successfully ran "rdebug".
> >> >> > > However, I still can't find ListTemplate even in
> /var/log/cloud/
> >> >> >
> >> >> > Better to fix rdeploydb at first, right now, your system is in
> a
> >> good
> >> >> shape.
> >> >> > If you had taken a snapshot for devcloud after importing the
> >> >> devcloud.ova into virtualbox, then you can revert back to the
> >> initial
> >> >> state.
> >> >> > Then we can test the preinstalled cloudstack mgt server works
> for
> >> you
> >> >> or not, by go to http://localhost:8080/client, then enable the
> zone,
> >> >> wait for a few minutes, ssvm will come up, and the tiny user vm
> will
> >> be
> >> >> available.
> >> >> > Anyway, I'll write up the whole setup/configuration/how-to-use,
> >> step-
> >> >> by-step illustrated.
> >> >>
> >> >>
> >> >> Thanks for the writeup. That's very helpful.
> >> >> I started from scratch and was able to see the tiny Linux
> template
> >> is
> >> >> normal.
> >> >>
> >> >> Now, another problem is that I can't seem to launch a VM; I'm
> >> getting
> >> >> this error:
> >> >> ---------------------------
> >> >>   [sshexec]      [java] INFO  [api.commands.DeployVMCmd]
> >> >> (Job-Executor-13:job-13)
> >> >> com.cloud.exception.InsufficientServerCapacityException: Unable
> to
> >> >> create a deployment for VM[User|ccc]Scope=interface
> >> >> com.cloud.dc.DataCenter; id=1
> >> >> --------------------------
> >> >
> >> > Which service offering are you using to create the VM? Need to use
> >> tinyServiceOffering.
> >>
> >> I'm using "tinyOffering" in "Compute offering" menu in launching VM
> >> wizard.
> >> I can't find "tinyServiceOffering" anywhere. Am I missing something?
> >>
> >> >> I also tried launching a VM with vanilla DevCloud(without doing
> any
> >> >> ant commands),
> >> >>  and I was ableto launch it. However, the launched tty Linux gets
> ip
> >> >> address 10.0.0.15,
> >> >>  which is the same address as devcloud and then web GUI became
> >> >> inaccessible.
> >> >
> >> > That's weird, normally DevCloud will get 10.0.2.15 itself, user vm
> >> will get other ip address.
> >> > Which VirtualBox are you using? On which platform?
> >>
> >> I'm using virtualbox-4.1 (4.1.18-78361~Ubuntu~precise) on Ubuntu
> 12.04.
> >> This happens consistently, at least I hit 3 times in a row.
> > I added a fix into master, that disable virtualbox DHCP server for
> the VMs created by CloudStack.
> > Right now, you can manually execute the following scripts inside
> devcloud:
> >
> > apt-get install ebtables
> > iptables -A POSTROUTING -t mangle -p udp --dport bootpc -j CHECKSUM -
> -checksum-fill
> > mac=`ifconfig xenbr0 |grep HWaddr |awk '{print $5}'`
> > ebtables -I FORWARD -d ! $mac -i eth0 -p IPV4 --ip-prot udp --ip-
> dport 67:68 -j DROP
> > iptables-save > /etc/iptables.save
> > /etc/init.d/ebtables save
> >
> > And add
> > pre-up iptables-save < /etc/iptables.save
> > pre-up /etc/init.d/ebtables load
> >
> > at the end of /etc/network/interfaces, then stop/start your user vm,
> see what happened.
> >
> > the commit number is fb59fc5c8a5114ca0c7da8c602a806dc77735c2e, if you
> want take a look at the fix.
> >
> >
> >>
> >> >> As a side note, it should be useful to add a port forward setting
> >> for
> >> >> 8787 in VirtualBox
> >> >> so we can remote debug easily.
> >> >
> >> >
> >> > Will do, and also 8250.
> >>
> >> Can I ask what 8250 is for?
> >
> > To add external hypervisor host(the actual physical host) into
> CloudStack mgt server running inside DevCloud, if ssvm/cpvm created on
> external host, 8250 will be used by the java agent inside ssvm/cpvm to
> connect to mgt server.
> >
> >>
> >> Thanks,
> >> Tomoe

Re: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Tomoe Sugihara <to...@midokura.com>.
Hi Edison,

I have been playing around with DevCloud and I wanted to share
my findings here:

1. Needs more memory for guests

 I'd been getting InsufficientServerCapacityException when I tried
launching a VM after rdeploy*, rdebug and adding a basic ZONE.

 I found that a router VM will be spun up upon launching a VM
with CentOS template and total number of VM will be 4 (SSVM, CPVM,
Router VM, new instance). Total mem on the host(DevCloud) in the DB is
below 400MB(IIRC), and that's not enough for 4 VMs.


2. OOM kills server

   Often times, inside management server, OOM killer kills management
java process. You may want to allocate more memory for the mgmt server
and/or add some swap.

3. DNS nat doesn't work on Ubuntu precise(4.1.1878361~Ubuntu~precise)

By default, the DNS server nat setting with 10.0.2.3 didn't work and that
made it slow to ssh into DevCloud.

I found an workaround by running the following command:

 VBoxManage modifyvm DevCloud --natdnshostresolver1 on


Thanks,
Tomoe


On Wed, Jul 11, 2012 at 9:02 AM, Edison Su <Ed...@citrix.com> wrote:
>
>
>> -----Original Message-----
>> From: tomoe@midokura.jp [mailto:tomoe@midokura.jp] On Behalf Of Tomoe
>> Sugihara
>> Sent: Tuesday, July 10, 2012 4:40 PM
>> To: cloudstack-users@incubator.apache.org
>> Cc: cloudstack-dev@incubator.apache.org
>> Subject: Re: [RFC] DevCloud, an all-in-one-box CloudStack development
>> environment
>>
>> On Wed, Jul 11, 2012 at 2:33 AM, Edison Su <Ed...@citrix.com> wrote:
>> >
>> >
>> >> -----Original Message-----
>> >> From: tomoe@midokura.jp [mailto:tomoe@midokura.jp] On Behalf Of
>> Tomoe
>> >> Sugihara
>> >> Sent: Tuesday, July 10, 2012 1:22 AM
>> >> To: cloudstack-dev@incubator.apache.org
>> >> Cc: cloudstack-users@incubator.apache.org
>> >> Subject: Re: [RFC] DevCloud, an all-in-one-box CloudStack
>> development
>> >> environment
>> >>
>> >> On Tue, Jul 10, 2012 at 3:32 AM, Edison Su <Ed...@citrix.com>
>> wrote:
>> >>
>> >> > >
>> >> > > Not rdeploydb, but successfully ran "rdebug".
>> >> > > However, I still can't find ListTemplate even in /var/log/cloud/
>> >> >
>> >> > Better to fix rdeploydb at first, right now, your system is in a
>> good
>> >> shape.
>> >> > If you had taken a snapshot for devcloud after importing the
>> >> devcloud.ova into virtualbox, then you can revert back to the
>> initial
>> >> state.
>> >> > Then we can test the preinstalled cloudstack mgt server works for
>> you
>> >> or not, by go to http://localhost:8080/client, then enable the zone,
>> >> wait for a few minutes, ssvm will come up, and the tiny user vm will
>> be
>> >> available.
>> >> > Anyway, I'll write up the whole setup/configuration/how-to-use,
>> step-
>> >> by-step illustrated.
>> >>
>> >>
>> >> Thanks for the writeup. That's very helpful.
>> >> I started from scratch and was able to see the tiny Linux template
>> is
>> >> normal.
>> >>
>> >> Now, another problem is that I can't seem to launch a VM; I'm
>> getting
>> >> this error:
>> >> ---------------------------
>> >>   [sshexec]      [java] INFO  [api.commands.DeployVMCmd]
>> >> (Job-Executor-13:job-13)
>> >> com.cloud.exception.InsufficientServerCapacityException: Unable to
>> >> create a deployment for VM[User|ccc]Scope=interface
>> >> com.cloud.dc.DataCenter; id=1
>> >> --------------------------
>> >
>> > Which service offering are you using to create the VM? Need to use
>> tinyServiceOffering.
>>
>> I'm using "tinyOffering" in "Compute offering" menu in launching VM
>> wizard.
>> I can't find "tinyServiceOffering" anywhere. Am I missing something?
>>
>> >> I also tried launching a VM with vanilla DevCloud(without doing any
>> >> ant commands),
>> >>  and I was ableto launch it. However, the launched tty Linux gets ip
>> >> address 10.0.0.15,
>> >>  which is the same address as devcloud and then web GUI became
>> >> inaccessible.
>> >
>> > That's weird, normally DevCloud will get 10.0.2.15 itself, user vm
>> will get other ip address.
>> > Which VirtualBox are you using? On which platform?
>>
>> I'm using virtualbox-4.1 (4.1.18-78361~Ubuntu~precise) on Ubuntu 12.04.
>> This happens consistently, at least I hit 3 times in a row.
> I added a fix into master, that disable virtualbox DHCP server for the VMs created by CloudStack.
> Right now, you can manually execute the following scripts inside devcloud:
>
> apt-get install ebtables
> iptables -A POSTROUTING -t mangle -p udp --dport bootpc -j CHECKSUM --checksum-fill
> mac=`ifconfig xenbr0 |grep HWaddr |awk '{print $5}'`
> ebtables -I FORWARD -d ! $mac -i eth0 -p IPV4 --ip-prot udp --ip-dport 67:68 -j DROP
> iptables-save > /etc/iptables.save
> /etc/init.d/ebtables save
>
> And add
> pre-up iptables-save < /etc/iptables.save
> pre-up /etc/init.d/ebtables load
>
> at the end of /etc/network/interfaces, then stop/start your user vm, see what happened.
>
> the commit number is fb59fc5c8a5114ca0c7da8c602a806dc77735c2e, if you want take a look at the fix.
>
>
>>
>> >> As a side note, it should be useful to add a port forward setting
>> for
>> >> 8787 in VirtualBox
>> >> so we can remote debug easily.
>> >
>> >
>> > Will do, and also 8250.
>>
>> Can I ask what 8250 is for?
>
> To add external hypervisor host(the actual physical host) into CloudStack mgt server running inside DevCloud, if ssvm/cpvm created on external host, 8250 will be used by the java agent inside ssvm/cpvm to connect to mgt server.
>
>>
>> Thanks,
>> Tomoe

Re: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Tomoe Sugihara <to...@midokura.com>.
Hi Edison,

I have been playing around with DevCloud and I wanted to share
my findings here:

1. Needs more memory for guests

 I'd been getting InsufficientServerCapacityException when I tried
launching a VM after rdeploy*, rdebug and adding a basic ZONE.

 I found that a router VM will be spun up upon launching a VM
with CentOS template and total number of VM will be 4 (SSVM, CPVM,
Router VM, new instance). Total mem on the host(DevCloud) in the DB is
below 400MB(IIRC), and that's not enough for 4 VMs.


2. OOM kills server

   Often times, inside management server, OOM killer kills management
java process. You may want to allocate more memory for the mgmt server
and/or add some swap.

3. DNS nat doesn't work on Ubuntu precise(4.1.1878361~Ubuntu~precise)

By default, the DNS server nat setting with 10.0.2.3 didn't work and that
made it slow to ssh into DevCloud.

I found an workaround by running the following command:

 VBoxManage modifyvm DevCloud --natdnshostresolver1 on


Thanks,
Tomoe


On Wed, Jul 11, 2012 at 9:02 AM, Edison Su <Ed...@citrix.com> wrote:
>
>
>> -----Original Message-----
>> From: tomoe@midokura.jp [mailto:tomoe@midokura.jp] On Behalf Of Tomoe
>> Sugihara
>> Sent: Tuesday, July 10, 2012 4:40 PM
>> To: cloudstack-users@incubator.apache.org
>> Cc: cloudstack-dev@incubator.apache.org
>> Subject: Re: [RFC] DevCloud, an all-in-one-box CloudStack development
>> environment
>>
>> On Wed, Jul 11, 2012 at 2:33 AM, Edison Su <Ed...@citrix.com> wrote:
>> >
>> >
>> >> -----Original Message-----
>> >> From: tomoe@midokura.jp [mailto:tomoe@midokura.jp] On Behalf Of
>> Tomoe
>> >> Sugihara
>> >> Sent: Tuesday, July 10, 2012 1:22 AM
>> >> To: cloudstack-dev@incubator.apache.org
>> >> Cc: cloudstack-users@incubator.apache.org
>> >> Subject: Re: [RFC] DevCloud, an all-in-one-box CloudStack
>> development
>> >> environment
>> >>
>> >> On Tue, Jul 10, 2012 at 3:32 AM, Edison Su <Ed...@citrix.com>
>> wrote:
>> >>
>> >> > >
>> >> > > Not rdeploydb, but successfully ran "rdebug".
>> >> > > However, I still can't find ListTemplate even in /var/log/cloud/
>> >> >
>> >> > Better to fix rdeploydb at first, right now, your system is in a
>> good
>> >> shape.
>> >> > If you had taken a snapshot for devcloud after importing the
>> >> devcloud.ova into virtualbox, then you can revert back to the
>> initial
>> >> state.
>> >> > Then we can test the preinstalled cloudstack mgt server works for
>> you
>> >> or not, by go to http://localhost:8080/client, then enable the zone,
>> >> wait for a few minutes, ssvm will come up, and the tiny user vm will
>> be
>> >> available.
>> >> > Anyway, I'll write up the whole setup/configuration/how-to-use,
>> step-
>> >> by-step illustrated.
>> >>
>> >>
>> >> Thanks for the writeup. That's very helpful.
>> >> I started from scratch and was able to see the tiny Linux template
>> is
>> >> normal.
>> >>
>> >> Now, another problem is that I can't seem to launch a VM; I'm
>> getting
>> >> this error:
>> >> ---------------------------
>> >>   [sshexec]      [java] INFO  [api.commands.DeployVMCmd]
>> >> (Job-Executor-13:job-13)
>> >> com.cloud.exception.InsufficientServerCapacityException: Unable to
>> >> create a deployment for VM[User|ccc]Scope=interface
>> >> com.cloud.dc.DataCenter; id=1
>> >> --------------------------
>> >
>> > Which service offering are you using to create the VM? Need to use
>> tinyServiceOffering.
>>
>> I'm using "tinyOffering" in "Compute offering" menu in launching VM
>> wizard.
>> I can't find "tinyServiceOffering" anywhere. Am I missing something?
>>
>> >> I also tried launching a VM with vanilla DevCloud(without doing any
>> >> ant commands),
>> >>  and I was ableto launch it. However, the launched tty Linux gets ip
>> >> address 10.0.0.15,
>> >>  which is the same address as devcloud and then web GUI became
>> >> inaccessible.
>> >
>> > That's weird, normally DevCloud will get 10.0.2.15 itself, user vm
>> will get other ip address.
>> > Which VirtualBox are you using? On which platform?
>>
>> I'm using virtualbox-4.1 (4.1.18-78361~Ubuntu~precise) on Ubuntu 12.04.
>> This happens consistently, at least I hit 3 times in a row.
> I added a fix into master, that disable virtualbox DHCP server for the VMs created by CloudStack.
> Right now, you can manually execute the following scripts inside devcloud:
>
> apt-get install ebtables
> iptables -A POSTROUTING -t mangle -p udp --dport bootpc -j CHECKSUM --checksum-fill
> mac=`ifconfig xenbr0 |grep HWaddr |awk '{print $5}'`
> ebtables -I FORWARD -d ! $mac -i eth0 -p IPV4 --ip-prot udp --ip-dport 67:68 -j DROP
> iptables-save > /etc/iptables.save
> /etc/init.d/ebtables save
>
> And add
> pre-up iptables-save < /etc/iptables.save
> pre-up /etc/init.d/ebtables load
>
> at the end of /etc/network/interfaces, then stop/start your user vm, see what happened.
>
> the commit number is fb59fc5c8a5114ca0c7da8c602a806dc77735c2e, if you want take a look at the fix.
>
>
>>
>> >> As a side note, it should be useful to add a port forward setting
>> for
>> >> 8787 in VirtualBox
>> >> so we can remote debug easily.
>> >
>> >
>> > Will do, and also 8250.
>>
>> Can I ask what 8250 is for?
>
> To add external hypervisor host(the actual physical host) into CloudStack mgt server running inside DevCloud, if ssvm/cpvm created on external host, 8250 will be used by the java agent inside ssvm/cpvm to connect to mgt server.
>
>>
>> Thanks,
>> Tomoe

RE: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Edison Su <Ed...@citrix.com>.

> -----Original Message-----
> From: tomoe@midokura.jp [mailto:tomoe@midokura.jp] On Behalf Of Tomoe
> Sugihara
> Sent: Tuesday, July 10, 2012 4:40 PM
> To: cloudstack-users@incubator.apache.org
> Cc: cloudstack-dev@incubator.apache.org
> Subject: Re: [RFC] DevCloud, an all-in-one-box CloudStack development
> environment
> 
> On Wed, Jul 11, 2012 at 2:33 AM, Edison Su <Ed...@citrix.com> wrote:
> >
> >
> >> -----Original Message-----
> >> From: tomoe@midokura.jp [mailto:tomoe@midokura.jp] On Behalf Of
> Tomoe
> >> Sugihara
> >> Sent: Tuesday, July 10, 2012 1:22 AM
> >> To: cloudstack-dev@incubator.apache.org
> >> Cc: cloudstack-users@incubator.apache.org
> >> Subject: Re: [RFC] DevCloud, an all-in-one-box CloudStack
> development
> >> environment
> >>
> >> On Tue, Jul 10, 2012 at 3:32 AM, Edison Su <Ed...@citrix.com>
> wrote:
> >>
> >> > >
> >> > > Not rdeploydb, but successfully ran "rdebug".
> >> > > However, I still can't find ListTemplate even in /var/log/cloud/
> >> >
> >> > Better to fix rdeploydb at first, right now, your system is in a
> good
> >> shape.
> >> > If you had taken a snapshot for devcloud after importing the
> >> devcloud.ova into virtualbox, then you can revert back to the
> initial
> >> state.
> >> > Then we can test the preinstalled cloudstack mgt server works for
> you
> >> or not, by go to http://localhost:8080/client, then enable the zone,
> >> wait for a few minutes, ssvm will come up, and the tiny user vm will
> be
> >> available.
> >> > Anyway, I'll write up the whole setup/configuration/how-to-use,
> step-
> >> by-step illustrated.
> >>
> >>
> >> Thanks for the writeup. That's very helpful.
> >> I started from scratch and was able to see the tiny Linux template
> is
> >> normal.
> >>
> >> Now, another problem is that I can't seem to launch a VM; I'm
> getting
> >> this error:
> >> ---------------------------
> >>   [sshexec]      [java] INFO  [api.commands.DeployVMCmd]
> >> (Job-Executor-13:job-13)
> >> com.cloud.exception.InsufficientServerCapacityException: Unable to
> >> create a deployment for VM[User|ccc]Scope=interface
> >> com.cloud.dc.DataCenter; id=1
> >> --------------------------
> >
> > Which service offering are you using to create the VM? Need to use
> tinyServiceOffering.
> 
> I'm using "tinyOffering" in "Compute offering" menu in launching VM
> wizard.
> I can't find "tinyServiceOffering" anywhere. Am I missing something?
> 
> >> I also tried launching a VM with vanilla DevCloud(without doing any
> >> ant commands),
> >>  and I was ableto launch it. However, the launched tty Linux gets ip
> >> address 10.0.0.15,
> >>  which is the same address as devcloud and then web GUI became
> >> inaccessible.
> >
> > That's weird, normally DevCloud will get 10.0.2.15 itself, user vm
> will get other ip address.
> > Which VirtualBox are you using? On which platform?
> 
> I'm using virtualbox-4.1 (4.1.18-78361~Ubuntu~precise) on Ubuntu 12.04.
> This happens consistently, at least I hit 3 times in a row.
I added a fix into master, that disable virtualbox DHCP server for the VMs created by CloudStack.
Right now, you can manually execute the following scripts inside devcloud:

apt-get install ebtables
iptables -A POSTROUTING -t mangle -p udp --dport bootpc -j CHECKSUM --checksum-fill
mac=`ifconfig xenbr0 |grep HWaddr |awk '{print $5}'`
ebtables -I FORWARD -d ! $mac -i eth0 -p IPV4 --ip-prot udp --ip-dport 67:68 -j DROP
iptables-save > /etc/iptables.save
/etc/init.d/ebtables save

And add 
pre-up iptables-save < /etc/iptables.save
pre-up /etc/init.d/ebtables load

at the end of /etc/network/interfaces, then stop/start your user vm, see what happened.

the commit number is fb59fc5c8a5114ca0c7da8c602a806dc77735c2e, if you want take a look at the fix.


> 
> >> As a side note, it should be useful to add a port forward setting
> for
> >> 8787 in VirtualBox
> >> so we can remote debug easily.
> >
> >
> > Will do, and also 8250.
> 
> Can I ask what 8250 is for?

To add external hypervisor host(the actual physical host) into CloudStack mgt server running inside DevCloud, if ssvm/cpvm created on external host, 8250 will be used by the java agent inside ssvm/cpvm to connect to mgt server.

> 
> Thanks,
> Tomoe

RE: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Edison Su <Ed...@citrix.com>.

> -----Original Message-----
> From: tomoe@midokura.jp [mailto:tomoe@midokura.jp] On Behalf Of Tomoe
> Sugihara
> Sent: Tuesday, July 10, 2012 4:40 PM
> To: cloudstack-users@incubator.apache.org
> Cc: cloudstack-dev@incubator.apache.org
> Subject: Re: [RFC] DevCloud, an all-in-one-box CloudStack development
> environment
> 
> On Wed, Jul 11, 2012 at 2:33 AM, Edison Su <Ed...@citrix.com> wrote:
> >
> >
> >> -----Original Message-----
> >> From: tomoe@midokura.jp [mailto:tomoe@midokura.jp] On Behalf Of
> Tomoe
> >> Sugihara
> >> Sent: Tuesday, July 10, 2012 1:22 AM
> >> To: cloudstack-dev@incubator.apache.org
> >> Cc: cloudstack-users@incubator.apache.org
> >> Subject: Re: [RFC] DevCloud, an all-in-one-box CloudStack
> development
> >> environment
> >>
> >> On Tue, Jul 10, 2012 at 3:32 AM, Edison Su <Ed...@citrix.com>
> wrote:
> >>
> >> > >
> >> > > Not rdeploydb, but successfully ran "rdebug".
> >> > > However, I still can't find ListTemplate even in /var/log/cloud/
> >> >
> >> > Better to fix rdeploydb at first, right now, your system is in a
> good
> >> shape.
> >> > If you had taken a snapshot for devcloud after importing the
> >> devcloud.ova into virtualbox, then you can revert back to the
> initial
> >> state.
> >> > Then we can test the preinstalled cloudstack mgt server works for
> you
> >> or not, by go to http://localhost:8080/client, then enable the zone,
> >> wait for a few minutes, ssvm will come up, and the tiny user vm will
> be
> >> available.
> >> > Anyway, I'll write up the whole setup/configuration/how-to-use,
> step-
> >> by-step illustrated.
> >>
> >>
> >> Thanks for the writeup. That's very helpful.
> >> I started from scratch and was able to see the tiny Linux template
> is
> >> normal.
> >>
> >> Now, another problem is that I can't seem to launch a VM; I'm
> getting
> >> this error:
> >> ---------------------------
> >>   [sshexec]      [java] INFO  [api.commands.DeployVMCmd]
> >> (Job-Executor-13:job-13)
> >> com.cloud.exception.InsufficientServerCapacityException: Unable to
> >> create a deployment for VM[User|ccc]Scope=interface
> >> com.cloud.dc.DataCenter; id=1
> >> --------------------------
> >
> > Which service offering are you using to create the VM? Need to use
> tinyServiceOffering.
> 
> I'm using "tinyOffering" in "Compute offering" menu in launching VM
> wizard.
> I can't find "tinyServiceOffering" anywhere. Am I missing something?
> 
> >> I also tried launching a VM with vanilla DevCloud(without doing any
> >> ant commands),
> >>  and I was ableto launch it. However, the launched tty Linux gets ip
> >> address 10.0.0.15,
> >>  which is the same address as devcloud and then web GUI became
> >> inaccessible.
> >
> > That's weird, normally DevCloud will get 10.0.2.15 itself, user vm
> will get other ip address.
> > Which VirtualBox are you using? On which platform?
> 
> I'm using virtualbox-4.1 (4.1.18-78361~Ubuntu~precise) on Ubuntu 12.04.
> This happens consistently, at least I hit 3 times in a row.
I added a fix into master, that disable virtualbox DHCP server for the VMs created by CloudStack.
Right now, you can manually execute the following scripts inside devcloud:

apt-get install ebtables
iptables -A POSTROUTING -t mangle -p udp --dport bootpc -j CHECKSUM --checksum-fill
mac=`ifconfig xenbr0 |grep HWaddr |awk '{print $5}'`
ebtables -I FORWARD -d ! $mac -i eth0 -p IPV4 --ip-prot udp --ip-dport 67:68 -j DROP
iptables-save > /etc/iptables.save
/etc/init.d/ebtables save

And add 
pre-up iptables-save < /etc/iptables.save
pre-up /etc/init.d/ebtables load

at the end of /etc/network/interfaces, then stop/start your user vm, see what happened.

the commit number is fb59fc5c8a5114ca0c7da8c602a806dc77735c2e, if you want take a look at the fix.


> 
> >> As a side note, it should be useful to add a port forward setting
> for
> >> 8787 in VirtualBox
> >> so we can remote debug easily.
> >
> >
> > Will do, and also 8250.
> 
> Can I ask what 8250 is for?

To add external hypervisor host(the actual physical host) into CloudStack mgt server running inside DevCloud, if ssvm/cpvm created on external host, 8250 will be used by the java agent inside ssvm/cpvm to connect to mgt server.

> 
> Thanks,
> Tomoe

Re: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Tomoe Sugihara <to...@midokura.com>.
On Wed, Jul 11, 2012 at 2:33 AM, Edison Su <Ed...@citrix.com> wrote:
>
>
>> -----Original Message-----
>> From: tomoe@midokura.jp [mailto:tomoe@midokura.jp] On Behalf Of Tomoe
>> Sugihara
>> Sent: Tuesday, July 10, 2012 1:22 AM
>> To: cloudstack-dev@incubator.apache.org
>> Cc: cloudstack-users@incubator.apache.org
>> Subject: Re: [RFC] DevCloud, an all-in-one-box CloudStack development
>> environment
>>
>> On Tue, Jul 10, 2012 at 3:32 AM, Edison Su <Ed...@citrix.com> wrote:
>>
>> > >
>> > > Not rdeploydb, but successfully ran "rdebug".
>> > > However, I still can't find ListTemplate even in /var/log/cloud/
>> >
>> > Better to fix rdeploydb at first, right now, your system is in a good
>> shape.
>> > If you had taken a snapshot for devcloud after importing the
>> devcloud.ova into virtualbox, then you can revert back to the initial
>> state.
>> > Then we can test the preinstalled cloudstack mgt server works for you
>> or not, by go to http://localhost:8080/client, then enable the zone,
>> wait for a few minutes, ssvm will come up, and the tiny user vm will be
>> available.
>> > Anyway, I'll write up the whole setup/configuration/how-to-use, step-
>> by-step illustrated.
>>
>>
>> Thanks for the writeup. That's very helpful.
>> I started from scratch and was able to see the tiny Linux template is
>> normal.
>>
>> Now, another problem is that I can't seem to launch a VM; I'm getting
>> this error:
>> ---------------------------
>>   [sshexec]      [java] INFO  [api.commands.DeployVMCmd]
>> (Job-Executor-13:job-13)
>> com.cloud.exception.InsufficientServerCapacityException: Unable to
>> create a deployment for VM[User|ccc]Scope=interface
>> com.cloud.dc.DataCenter; id=1
>> --------------------------
>
> Which service offering are you using to create the VM? Need to use tinyServiceOffering.

I'm using "tinyOffering" in "Compute offering" menu in launching VM wizard.
I can't find "tinyServiceOffering" anywhere. Am I missing something?

>> I also tried launching a VM with vanilla DevCloud(without doing any
>> ant commands),
>>  and I was ableto launch it. However, the launched tty Linux gets ip
>> address 10.0.0.15,
>>  which is the same address as devcloud and then web GUI became
>> inaccessible.
>
> That's weird, normally DevCloud will get 10.0.2.15 itself, user vm will get other ip address.
> Which VirtualBox are you using? On which platform?

I'm using virtualbox-4.1 (4.1.18-78361~Ubuntu~precise) on Ubuntu 12.04.
This happens consistently, at least I hit 3 times in a row.

>> As a side note, it should be useful to add a port forward setting for
>> 8787 in VirtualBox
>> so we can remote debug easily.
>
>
> Will do, and also 8250.

Can I ask what 8250 is for?

Thanks,
Tomoe

Re: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Tomoe Sugihara <to...@midokura.com>.
On Wed, Jul 11, 2012 at 2:33 AM, Edison Su <Ed...@citrix.com> wrote:
>
>
>> -----Original Message-----
>> From: tomoe@midokura.jp [mailto:tomoe@midokura.jp] On Behalf Of Tomoe
>> Sugihara
>> Sent: Tuesday, July 10, 2012 1:22 AM
>> To: cloudstack-dev@incubator.apache.org
>> Cc: cloudstack-users@incubator.apache.org
>> Subject: Re: [RFC] DevCloud, an all-in-one-box CloudStack development
>> environment
>>
>> On Tue, Jul 10, 2012 at 3:32 AM, Edison Su <Ed...@citrix.com> wrote:
>>
>> > >
>> > > Not rdeploydb, but successfully ran "rdebug".
>> > > However, I still can't find ListTemplate even in /var/log/cloud/
>> >
>> > Better to fix rdeploydb at first, right now, your system is in a good
>> shape.
>> > If you had taken a snapshot for devcloud after importing the
>> devcloud.ova into virtualbox, then you can revert back to the initial
>> state.
>> > Then we can test the preinstalled cloudstack mgt server works for you
>> or not, by go to http://localhost:8080/client, then enable the zone,
>> wait for a few minutes, ssvm will come up, and the tiny user vm will be
>> available.
>> > Anyway, I'll write up the whole setup/configuration/how-to-use, step-
>> by-step illustrated.
>>
>>
>> Thanks for the writeup. That's very helpful.
>> I started from scratch and was able to see the tiny Linux template is
>> normal.
>>
>> Now, another problem is that I can't seem to launch a VM; I'm getting
>> this error:
>> ---------------------------
>>   [sshexec]      [java] INFO  [api.commands.DeployVMCmd]
>> (Job-Executor-13:job-13)
>> com.cloud.exception.InsufficientServerCapacityException: Unable to
>> create a deployment for VM[User|ccc]Scope=interface
>> com.cloud.dc.DataCenter; id=1
>> --------------------------
>
> Which service offering are you using to create the VM? Need to use tinyServiceOffering.

I'm using "tinyOffering" in "Compute offering" menu in launching VM wizard.
I can't find "tinyServiceOffering" anywhere. Am I missing something?

>> I also tried launching a VM with vanilla DevCloud(without doing any
>> ant commands),
>>  and I was ableto launch it. However, the launched tty Linux gets ip
>> address 10.0.0.15,
>>  which is the same address as devcloud and then web GUI became
>> inaccessible.
>
> That's weird, normally DevCloud will get 10.0.2.15 itself, user vm will get other ip address.
> Which VirtualBox are you using? On which platform?

I'm using virtualbox-4.1 (4.1.18-78361~Ubuntu~precise) on Ubuntu 12.04.
This happens consistently, at least I hit 3 times in a row.

>> As a side note, it should be useful to add a port forward setting for
>> 8787 in VirtualBox
>> so we can remote debug easily.
>
>
> Will do, and also 8250.

Can I ask what 8250 is for?

Thanks,
Tomoe

RE: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Edison Su <Ed...@citrix.com>.

> -----Original Message-----
> From: tomoe@midokura.jp [mailto:tomoe@midokura.jp] On Behalf Of Tomoe
> Sugihara
> Sent: Tuesday, July 10, 2012 1:22 AM
> To: cloudstack-dev@incubator.apache.org
> Cc: cloudstack-users@incubator.apache.org
> Subject: Re: [RFC] DevCloud, an all-in-one-box CloudStack development
> environment
> 
> On Tue, Jul 10, 2012 at 3:32 AM, Edison Su <Ed...@citrix.com> wrote:
> 
> > >
> > > Not rdeploydb, but successfully ran "rdebug".
> > > However, I still can't find ListTemplate even in /var/log/cloud/
> >
> > Better to fix rdeploydb at first, right now, your system is in a good
> shape.
> > If you had taken a snapshot for devcloud after importing the
> devcloud.ova into virtualbox, then you can revert back to the initial
> state.
> > Then we can test the preinstalled cloudstack mgt server works for you
> or not, by go to http://localhost:8080/client, then enable the zone,
> wait for a few minutes, ssvm will come up, and the tiny user vm will be
> available.
> > Anyway, I'll write up the whole setup/configuration/how-to-use, step-
> by-step illustrated.
> 
> 
> Thanks for the writeup. That's very helpful.
> I started from scratch and was able to see the tiny Linux template is
> normal.
> 
> Now, another problem is that I can't seem to launch a VM; I'm getting
> this error:
> ---------------------------
>   [sshexec]      [java] INFO  [api.commands.DeployVMCmd]
> (Job-Executor-13:job-13)
> com.cloud.exception.InsufficientServerCapacityException: Unable to
> create a deployment for VM[User|ccc]Scope=interface
> com.cloud.dc.DataCenter; id=1
> --------------------------

Which service offering are you using to create the VM? Need to use tinyServiceOffering.

> 
> I also tried launching a VM with vanilla DevCloud(without doing any
> ant commands),
>  and I was ableto launch it. However, the launched tty Linux gets ip
> address 10.0.0.15,
>  which is the same address as devcloud and then web GUI became
> inaccessible.

That's weird, normally DevCloud will get 10.0.2.15 itself, user vm will get other ip address.
Which VirtualBox are you using? On which platform?

> 
> As a side note, it should be useful to add a port forward setting for
> 8787 in VirtualBox
> so we can remote debug easily.


Will do, and also 8250.

> 
> Thanks,
> Tomoe

RE: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Edison Su <Ed...@citrix.com>.

> -----Original Message-----
> From: tomoe@midokura.jp [mailto:tomoe@midokura.jp] On Behalf Of Tomoe
> Sugihara
> Sent: Tuesday, July 10, 2012 1:22 AM
> To: cloudstack-dev@incubator.apache.org
> Cc: cloudstack-users@incubator.apache.org
> Subject: Re: [RFC] DevCloud, an all-in-one-box CloudStack development
> environment
> 
> On Tue, Jul 10, 2012 at 3:32 AM, Edison Su <Ed...@citrix.com> wrote:
> 
> > >
> > > Not rdeploydb, but successfully ran "rdebug".
> > > However, I still can't find ListTemplate even in /var/log/cloud/
> >
> > Better to fix rdeploydb at first, right now, your system is in a good
> shape.
> > If you had taken a snapshot for devcloud after importing the
> devcloud.ova into virtualbox, then you can revert back to the initial
> state.
> > Then we can test the preinstalled cloudstack mgt server works for you
> or not, by go to http://localhost:8080/client, then enable the zone,
> wait for a few minutes, ssvm will come up, and the tiny user vm will be
> available.
> > Anyway, I'll write up the whole setup/configuration/how-to-use, step-
> by-step illustrated.
> 
> 
> Thanks for the writeup. That's very helpful.
> I started from scratch and was able to see the tiny Linux template is
> normal.
> 
> Now, another problem is that I can't seem to launch a VM; I'm getting
> this error:
> ---------------------------
>   [sshexec]      [java] INFO  [api.commands.DeployVMCmd]
> (Job-Executor-13:job-13)
> com.cloud.exception.InsufficientServerCapacityException: Unable to
> create a deployment for VM[User|ccc]Scope=interface
> com.cloud.dc.DataCenter; id=1
> --------------------------

Which service offering are you using to create the VM? Need to use tinyServiceOffering.

> 
> I also tried launching a VM with vanilla DevCloud(without doing any
> ant commands),
>  and I was ableto launch it. However, the launched tty Linux gets ip
> address 10.0.0.15,
>  which is the same address as devcloud and then web GUI became
> inaccessible.

That's weird, normally DevCloud will get 10.0.2.15 itself, user vm will get other ip address.
Which VirtualBox are you using? On which platform?

> 
> As a side note, it should be useful to add a port forward setting for
> 8787 in VirtualBox
> so we can remote debug easily.


Will do, and also 8250.

> 
> Thanks,
> Tomoe

Re: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Tomoe Sugihara <to...@midokura.com>.
On Tue, Jul 10, 2012 at 3:32 AM, Edison Su <Ed...@citrix.com> wrote:

> >
> > Not rdeploydb, but successfully ran "rdebug".
> > However, I still can't find ListTemplate even in /var/log/cloud/
>
> Better to fix rdeploydb at first, right now, your system is in a good shape.
> If you had taken a snapshot for devcloud after importing the devcloud.ova into virtualbox, then you can revert back to the initial state.
> Then we can test the preinstalled cloudstack mgt server works for you or not, by go to http://localhost:8080/client, then enable the zone, wait for a few minutes, ssvm will come up, and the tiny user vm will be available.
> Anyway, I'll write up the whole setup/configuration/how-to-use, step-by-step illustrated.


Thanks for the writeup. That's very helpful.
I started from scratch and was able to see the tiny Linux template is normal.

Now, another problem is that I can't seem to launch a VM; I'm getting
this error:
---------------------------
  [sshexec]      [java] INFO  [api.commands.DeployVMCmd]
(Job-Executor-13:job-13)
com.cloud.exception.InsufficientServerCapacityException: Unable to
create a deployment for VM[User|ccc]Scope=interface
com.cloud.dc.DataCenter; id=1
--------------------------

I also tried launching a VM with vanilla DevCloud(without doing any
ant commands),
 and I was ableto launch it. However, the launched tty Linux gets ip
address 10.0.0.15,
 which is the same address as devcloud and then web GUI became inaccessible.

As a side note, it should be useful to add a port forward setting for
8787 in VirtualBox
so we can remote debug easily.

Thanks,
Tomoe

Re: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Tomoe Sugihara <to...@midokura.com>.
On Tue, Jul 10, 2012 at 3:32 AM, Edison Su <Ed...@citrix.com> wrote:

> >
> > Not rdeploydb, but successfully ran "rdebug".
> > However, I still can't find ListTemplate even in /var/log/cloud/
>
> Better to fix rdeploydb at first, right now, your system is in a good shape.
> If you had taken a snapshot for devcloud after importing the devcloud.ova into virtualbox, then you can revert back to the initial state.
> Then we can test the preinstalled cloudstack mgt server works for you or not, by go to http://localhost:8080/client, then enable the zone, wait for a few minutes, ssvm will come up, and the tiny user vm will be available.
> Anyway, I'll write up the whole setup/configuration/how-to-use, step-by-step illustrated.


Thanks for the writeup. That's very helpful.
I started from scratch and was able to see the tiny Linux template is normal.

Now, another problem is that I can't seem to launch a VM; I'm getting
this error:
---------------------------
  [sshexec]      [java] INFO  [api.commands.DeployVMCmd]
(Job-Executor-13:job-13)
com.cloud.exception.InsufficientServerCapacityException: Unable to
create a deployment for VM[User|ccc]Scope=interface
com.cloud.dc.DataCenter; id=1
--------------------------

I also tried launching a VM with vanilla DevCloud(without doing any
ant commands),
 and I was ableto launch it. However, the launched tty Linux gets ip
address 10.0.0.15,
 which is the same address as devcloud and then web GUI became inaccessible.

As a side note, it should be useful to add a port forward setting for
8787 in VirtualBox
so we can remote debug easily.

Thanks,
Tomoe

RE: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Edison Su <Ed...@citrix.com>.

> -----Original Message-----
> From: tomoe@midokura.jp [mailto:tomoe@midokura.jp] On Behalf Of Tomoe
> Sugihara
> Sent: Monday, July 09, 2012 2:10 AM
> To: cloudstack-dev@incubator.apache.org
> Cc: cloudstack-users@incubator.apache.org
> Subject: Re: [RFC] DevCloud, an all-in-one-box CloudStack development
> environment
> 
> On Mon, Jul 9, 2012 at 4:25 PM, Edison Su <Ed...@citrix.com> wrote:
> 
> >
> >
> > Sent from my iPhone
> >
> > On Jul 8, 2012, at 11:31 PM, "Tomoe Sugihara" <to...@midokura.com>
> wrote:
> >
> > > On Mon, Jul 9, 2012 at 9:20 AM, Edison Su <Ed...@citrix.com>
> wrote:
> > >
> > >>
> > >>
> > >> Sent from my iPhone
> > >>
> > >> On Jul 7, 2012, at 9:19 AM, "Tomoe Sugihara" <tomoe@midokura.com
> > <mailto:
> > >> tomoe@midokura.com>> wrote:
> > >>
> > >> Hi Edison,
> > >>
> > >> This is very helpful for newbies like me.
> > >> However, I tried this according to the wiki page, but found some
> > problems
> > >> listed below.
> > >> I managed to add a host, but couldn't even launch a VM due to the
> issue
> > 3.
> > >>
> > >> I hope this would help improve DevCloud.
> > >>
> > >> ----------------------------
> > >> 1. ssh commands failed
> > >>
> > >>   I got "com.jcraft.jsch.JSchException: reject HostKey" when I
> tried
> > some
> > >> ant r* targets.
> > >>   So, I worked around this with the patch attached.
> > >> Thanks for your patch, but could please post the patch here?
> Attached is
> > >> not allowed in apache mailing list.
> > >>
> > >
> > > Sure. Will do.
> > >
> > >
> > >>
> > >> 2. rdeploydb didn't work
> > >>
> > >>  Since many scripts uses --password option to pass in password and
> mysql
> > >> prompts you, many of the commands failed.
> > >>
> > >>  I ended up ssh'ing to dom0 and did the equivalent db setup.
> > >>
> > >> Possible reason: do you override dbrootpw in
> > >> build/override/replace.properties on your host CloudStack source
> code
> > >> directory? If it's been override, then rdeploydb will use
> $dbrootpw to
> > >> deploy devcloud db, while devcloud db password is empty, so then
> failed.
> > >>
> > >
> > > I didn't touch anything on my working directory on the host. It was
> just
> > > pure master code at that time.
> >
> > Need to add DBROOTPW= in build/override/replace.properties
> >
> 
> Ah, OK. This was not on the wiki:)
> 
> >
> > >
> > >
> > >>
> > >> 3. tiny Linux template is not in good status
> > >>
> > >> Status says "Unable to resolve nfs1.lab.vmops.com<
> > >> http://nfs1.lab.vmops.com>"...
> > >>
> > >> Is there any place from which I can download templates easily?
> > >> You don't need to download this template, it's already
> preinstalled on
> > >> devcloud image, it's put under
> > /opt/storage/secondary/template/tmpl/1/5/.
> > >> After secondary storage vm booting up, it will report this
> template to
> > mgt
> > >> server.
> > >> Can you stop/start secondary storage vm? And check the management
> server
> > >> log(/opt/cloudstack/incu*/vmops.log, search ListTemplate. What
> > ListTemplate
> > >> returns?
> > >>
> > >
> > > I have the image under  /opt/storage/secondary/template/tmpl/1/5/,
> but
> > > after restarting
> > > SSVM, the same thing happened. And, I cant'
> > > find /opt/cloudstack/incu*/vmops.log.
> > It's in the devcloud, can you "find /opt -name vmops.log" inside
> devcloud?
> >
> 
> root@devcloud:~# find /opt -name vmops.log
> root@devcloud:~#
> 
> Btw, did you successful run "rdeploydb " and "rdebug"? if not, then the
> log
> > file is at /var/log/cloud/management/management-server.log
> >
> 
> Not rdeploydb, but successfully ran "rdebug".
> However, I still can't find ListTemplate even in /var/log/cloud/

Better to fix rdeploydb at first, right now, your system is in a good shape.
If you had taken a snapshot for devcloud after importing the devcloud.ova into virtualbox, then you can revert back to the initial state.
Then we can test the preinstalled cloudstack mgt server works for you or not, by go to http://localhost:8080/client, then enable the zone, wait for a few minutes, ssvm will come up, and the tiny user vm will be available.
Anyway, I'll write up the whole setup/configuration/how-to-use, step-by-step illustrated. 

> 
> root@devcloud:~# grep -i ListTemplate  /var/log/cloud/* -r
> root@devcloud:~#
> 
> Thanks,
> Tomoe
> 
> 
> 
> > >
> > > Cheers,
> > > Tomoe
> > >
> > >
> > >>
> > >> ------------------
> > >>
> > >> Cheers,
> > >> Tomoe
> > >>
> > >> On Sat, Jul 7, 2012 at 11:37 AM, Edison Su <Edison.su@citrix.com
> > <mailto:
> > >> Edison.su@citrix.com>> wrote:
> > >> Hi All,
> > >>   I created an all-in-one-box CloudStack development environment,
> name
> > it
> > >> as DevCloud. It's ready to download from
> > >> http://download.cloud.com/templates/devcloud/DevCloud.ova and the
> > >> document is put at
> http://wiki.cloudstack.org/display/comm/DevCloud.
> > >>   If you are a CloudStack developer whose daily tasks are directly
> > >> related to hypervisor, or are interested in CloudStack but don't
> want to
> > >> setup a CloudStack environment by yourself, welcome to have a try.
> > >>   Comments are welcome!
> > >>   Note: the image is about 1.5G, the downloading may take a while.
> > >>
> > >>
> >

RE: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Edison Su <Ed...@citrix.com>.

> -----Original Message-----
> From: tomoe@midokura.jp [mailto:tomoe@midokura.jp] On Behalf Of Tomoe
> Sugihara
> Sent: Monday, July 09, 2012 2:10 AM
> To: cloudstack-dev@incubator.apache.org
> Cc: cloudstack-users@incubator.apache.org
> Subject: Re: [RFC] DevCloud, an all-in-one-box CloudStack development
> environment
> 
> On Mon, Jul 9, 2012 at 4:25 PM, Edison Su <Ed...@citrix.com> wrote:
> 
> >
> >
> > Sent from my iPhone
> >
> > On Jul 8, 2012, at 11:31 PM, "Tomoe Sugihara" <to...@midokura.com>
> wrote:
> >
> > > On Mon, Jul 9, 2012 at 9:20 AM, Edison Su <Ed...@citrix.com>
> wrote:
> > >
> > >>
> > >>
> > >> Sent from my iPhone
> > >>
> > >> On Jul 7, 2012, at 9:19 AM, "Tomoe Sugihara" <tomoe@midokura.com
> > <mailto:
> > >> tomoe@midokura.com>> wrote:
> > >>
> > >> Hi Edison,
> > >>
> > >> This is very helpful for newbies like me.
> > >> However, I tried this according to the wiki page, but found some
> > problems
> > >> listed below.
> > >> I managed to add a host, but couldn't even launch a VM due to the
> issue
> > 3.
> > >>
> > >> I hope this would help improve DevCloud.
> > >>
> > >> ----------------------------
> > >> 1. ssh commands failed
> > >>
> > >>   I got "com.jcraft.jsch.JSchException: reject HostKey" when I
> tried
> > some
> > >> ant r* targets.
> > >>   So, I worked around this with the patch attached.
> > >> Thanks for your patch, but could please post the patch here?
> Attached is
> > >> not allowed in apache mailing list.
> > >>
> > >
> > > Sure. Will do.
> > >
> > >
> > >>
> > >> 2. rdeploydb didn't work
> > >>
> > >>  Since many scripts uses --password option to pass in password and
> mysql
> > >> prompts you, many of the commands failed.
> > >>
> > >>  I ended up ssh'ing to dom0 and did the equivalent db setup.
> > >>
> > >> Possible reason: do you override dbrootpw in
> > >> build/override/replace.properties on your host CloudStack source
> code
> > >> directory? If it's been override, then rdeploydb will use
> $dbrootpw to
> > >> deploy devcloud db, while devcloud db password is empty, so then
> failed.
> > >>
> > >
> > > I didn't touch anything on my working directory on the host. It was
> just
> > > pure master code at that time.
> >
> > Need to add DBROOTPW= in build/override/replace.properties
> >
> 
> Ah, OK. This was not on the wiki:)
> 
> >
> > >
> > >
> > >>
> > >> 3. tiny Linux template is not in good status
> > >>
> > >> Status says "Unable to resolve nfs1.lab.vmops.com<
> > >> http://nfs1.lab.vmops.com>"...
> > >>
> > >> Is there any place from which I can download templates easily?
> > >> You don't need to download this template, it's already
> preinstalled on
> > >> devcloud image, it's put under
> > /opt/storage/secondary/template/tmpl/1/5/.
> > >> After secondary storage vm booting up, it will report this
> template to
> > mgt
> > >> server.
> > >> Can you stop/start secondary storage vm? And check the management
> server
> > >> log(/opt/cloudstack/incu*/vmops.log, search ListTemplate. What
> > ListTemplate
> > >> returns?
> > >>
> > >
> > > I have the image under  /opt/storage/secondary/template/tmpl/1/5/,
> but
> > > after restarting
> > > SSVM, the same thing happened. And, I cant'
> > > find /opt/cloudstack/incu*/vmops.log.
> > It's in the devcloud, can you "find /opt -name vmops.log" inside
> devcloud?
> >
> 
> root@devcloud:~# find /opt -name vmops.log
> root@devcloud:~#
> 
> Btw, did you successful run "rdeploydb " and "rdebug"? if not, then the
> log
> > file is at /var/log/cloud/management/management-server.log
> >
> 
> Not rdeploydb, but successfully ran "rdebug".
> However, I still can't find ListTemplate even in /var/log/cloud/

Better to fix rdeploydb at first, right now, your system is in a good shape.
If you had taken a snapshot for devcloud after importing the devcloud.ova into virtualbox, then you can revert back to the initial state.
Then we can test the preinstalled cloudstack mgt server works for you or not, by go to http://localhost:8080/client, then enable the zone, wait for a few minutes, ssvm will come up, and the tiny user vm will be available.
Anyway, I'll write up the whole setup/configuration/how-to-use, step-by-step illustrated. 

> 
> root@devcloud:~# grep -i ListTemplate  /var/log/cloud/* -r
> root@devcloud:~#
> 
> Thanks,
> Tomoe
> 
> 
> 
> > >
> > > Cheers,
> > > Tomoe
> > >
> > >
> > >>
> > >> ------------------
> > >>
> > >> Cheers,
> > >> Tomoe
> > >>
> > >> On Sat, Jul 7, 2012 at 11:37 AM, Edison Su <Edison.su@citrix.com
> > <mailto:
> > >> Edison.su@citrix.com>> wrote:
> > >> Hi All,
> > >>   I created an all-in-one-box CloudStack development environment,
> name
> > it
> > >> as DevCloud. It's ready to download from
> > >> http://download.cloud.com/templates/devcloud/DevCloud.ova and the
> > >> document is put at
> http://wiki.cloudstack.org/display/comm/DevCloud.
> > >>   If you are a CloudStack developer whose daily tasks are directly
> > >> related to hypervisor, or are interested in CloudStack but don't
> want to
> > >> setup a CloudStack environment by yourself, welcome to have a try.
> > >>   Comments are welcome!
> > >>   Note: the image is about 1.5G, the downloading may take a while.
> > >>
> > >>
> >

Re: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Tomoe Sugihara <to...@midokura.com>.
On Mon, Jul 9, 2012 at 4:25 PM, Edison Su <Ed...@citrix.com> wrote:

>
>
> Sent from my iPhone
>
> On Jul 8, 2012, at 11:31 PM, "Tomoe Sugihara" <to...@midokura.com> wrote:
>
> > On Mon, Jul 9, 2012 at 9:20 AM, Edison Su <Ed...@citrix.com> wrote:
> >
> >>
> >>
> >> Sent from my iPhone
> >>
> >> On Jul 7, 2012, at 9:19 AM, "Tomoe Sugihara" <tomoe@midokura.com
> <mailto:
> >> tomoe@midokura.com>> wrote:
> >>
> >> Hi Edison,
> >>
> >> This is very helpful for newbies like me.
> >> However, I tried this according to the wiki page, but found some
> problems
> >> listed below.
> >> I managed to add a host, but couldn't even launch a VM due to the issue
> 3.
> >>
> >> I hope this would help improve DevCloud.
> >>
> >> ----------------------------
> >> 1. ssh commands failed
> >>
> >>   I got "com.jcraft.jsch.JSchException: reject HostKey" when I tried
> some
> >> ant r* targets.
> >>   So, I worked around this with the patch attached.
> >> Thanks for your patch, but could please post the patch here? Attached is
> >> not allowed in apache mailing list.
> >>
> >
> > Sure. Will do.
> >
> >
> >>
> >> 2. rdeploydb didn't work
> >>
> >>  Since many scripts uses --password option to pass in password and mysql
> >> prompts you, many of the commands failed.
> >>
> >>  I ended up ssh'ing to dom0 and did the equivalent db setup.
> >>
> >> Possible reason: do you override dbrootpw in
> >> build/override/replace.properties on your host CloudStack source code
> >> directory? If it's been override, then rdeploydb will use $dbrootpw to
> >> deploy devcloud db, while devcloud db password is empty, so then failed.
> >>
> >
> > I didn't touch anything on my working directory on the host. It was just
> > pure master code at that time.
>
> Need to add DBROOTPW= in build/override/replace.properties
>

Ah, OK. This was not on the wiki:)

>
> >
> >
> >>
> >> 3. tiny Linux template is not in good status
> >>
> >> Status says "Unable to resolve nfs1.lab.vmops.com<
> >> http://nfs1.lab.vmops.com>"...
> >>
> >> Is there any place from which I can download templates easily?
> >> You don't need to download this template, it's already preinstalled on
> >> devcloud image, it's put under
> /opt/storage/secondary/template/tmpl/1/5/.
> >> After secondary storage vm booting up, it will report this template to
> mgt
> >> server.
> >> Can you stop/start secondary storage vm? And check the management server
> >> log(/opt/cloudstack/incu*/vmops.log, search ListTemplate. What
> ListTemplate
> >> returns?
> >>
> >
> > I have the image under  /opt/storage/secondary/template/tmpl/1/5/, but
> > after restarting
> > SSVM, the same thing happened. And, I cant'
> > find /opt/cloudstack/incu*/vmops.log.
> It's in the devcloud, can you "find /opt -name vmops.log" inside devcloud?
>

root@devcloud:~# find /opt -name vmops.log
root@devcloud:~#

Btw, did you successful run "rdeploydb " and "rdebug"? if not, then the log
> file is at /var/log/cloud/management/management-server.log
>

Not rdeploydb, but successfully ran "rdebug".
However, I still can't find ListTemplate even in /var/log/cloud/

root@devcloud:~# grep -i ListTemplate  /var/log/cloud/* -r
root@devcloud:~#

Thanks,
Tomoe



> >
> > Cheers,
> > Tomoe
> >
> >
> >>
> >> ------------------
> >>
> >> Cheers,
> >> Tomoe
> >>
> >> On Sat, Jul 7, 2012 at 11:37 AM, Edison Su <Edison.su@citrix.com
> <mailto:
> >> Edison.su@citrix.com>> wrote:
> >> Hi All,
> >>   I created an all-in-one-box CloudStack development environment, name
> it
> >> as DevCloud. It's ready to download from
> >> http://download.cloud.com/templates/devcloud/DevCloud.ova and the
> >> document is put at http://wiki.cloudstack.org/display/comm/DevCloud.
> >>   If you are a CloudStack developer whose daily tasks are directly
> >> related to hypervisor, or are interested in CloudStack but don't want to
> >> setup a CloudStack environment by yourself, welcome to have a try.
> >>   Comments are welcome!
> >>   Note: the image is about 1.5G, the downloading may take a while.
> >>
> >>
>

Re: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Tomoe Sugihara <to...@midokura.com>.
On Mon, Jul 9, 2012 at 4:25 PM, Edison Su <Ed...@citrix.com> wrote:

>
>
> Sent from my iPhone
>
> On Jul 8, 2012, at 11:31 PM, "Tomoe Sugihara" <to...@midokura.com> wrote:
>
> > On Mon, Jul 9, 2012 at 9:20 AM, Edison Su <Ed...@citrix.com> wrote:
> >
> >>
> >>
> >> Sent from my iPhone
> >>
> >> On Jul 7, 2012, at 9:19 AM, "Tomoe Sugihara" <tomoe@midokura.com
> <mailto:
> >> tomoe@midokura.com>> wrote:
> >>
> >> Hi Edison,
> >>
> >> This is very helpful for newbies like me.
> >> However, I tried this according to the wiki page, but found some
> problems
> >> listed below.
> >> I managed to add a host, but couldn't even launch a VM due to the issue
> 3.
> >>
> >> I hope this would help improve DevCloud.
> >>
> >> ----------------------------
> >> 1. ssh commands failed
> >>
> >>   I got "com.jcraft.jsch.JSchException: reject HostKey" when I tried
> some
> >> ant r* targets.
> >>   So, I worked around this with the patch attached.
> >> Thanks for your patch, but could please post the patch here? Attached is
> >> not allowed in apache mailing list.
> >>
> >
> > Sure. Will do.
> >
> >
> >>
> >> 2. rdeploydb didn't work
> >>
> >>  Since many scripts uses --password option to pass in password and mysql
> >> prompts you, many of the commands failed.
> >>
> >>  I ended up ssh'ing to dom0 and did the equivalent db setup.
> >>
> >> Possible reason: do you override dbrootpw in
> >> build/override/replace.properties on your host CloudStack source code
> >> directory? If it's been override, then rdeploydb will use $dbrootpw to
> >> deploy devcloud db, while devcloud db password is empty, so then failed.
> >>
> >
> > I didn't touch anything on my working directory on the host. It was just
> > pure master code at that time.
>
> Need to add DBROOTPW= in build/override/replace.properties
>

Ah, OK. This was not on the wiki:)

>
> >
> >
> >>
> >> 3. tiny Linux template is not in good status
> >>
> >> Status says "Unable to resolve nfs1.lab.vmops.com<
> >> http://nfs1.lab.vmops.com>"...
> >>
> >> Is there any place from which I can download templates easily?
> >> You don't need to download this template, it's already preinstalled on
> >> devcloud image, it's put under
> /opt/storage/secondary/template/tmpl/1/5/.
> >> After secondary storage vm booting up, it will report this template to
> mgt
> >> server.
> >> Can you stop/start secondary storage vm? And check the management server
> >> log(/opt/cloudstack/incu*/vmops.log, search ListTemplate. What
> ListTemplate
> >> returns?
> >>
> >
> > I have the image under  /opt/storage/secondary/template/tmpl/1/5/, but
> > after restarting
> > SSVM, the same thing happened. And, I cant'
> > find /opt/cloudstack/incu*/vmops.log.
> It's in the devcloud, can you "find /opt -name vmops.log" inside devcloud?
>

root@devcloud:~# find /opt -name vmops.log
root@devcloud:~#

Btw, did you successful run "rdeploydb " and "rdebug"? if not, then the log
> file is at /var/log/cloud/management/management-server.log
>

Not rdeploydb, but successfully ran "rdebug".
However, I still can't find ListTemplate even in /var/log/cloud/

root@devcloud:~# grep -i ListTemplate  /var/log/cloud/* -r
root@devcloud:~#

Thanks,
Tomoe



> >
> > Cheers,
> > Tomoe
> >
> >
> >>
> >> ------------------
> >>
> >> Cheers,
> >> Tomoe
> >>
> >> On Sat, Jul 7, 2012 at 11:37 AM, Edison Su <Edison.su@citrix.com
> <mailto:
> >> Edison.su@citrix.com>> wrote:
> >> Hi All,
> >>   I created an all-in-one-box CloudStack development environment, name
> it
> >> as DevCloud. It's ready to download from
> >> http://download.cloud.com/templates/devcloud/DevCloud.ova and the
> >> document is put at http://wiki.cloudstack.org/display/comm/DevCloud.
> >>   If you are a CloudStack developer whose daily tasks are directly
> >> related to hypervisor, or are interested in CloudStack but don't want to
> >> setup a CloudStack environment by yourself, welcome to have a try.
> >>   Comments are welcome!
> >>   Note: the image is about 1.5G, the downloading may take a while.
> >>
> >>
>

Re: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Edison Su <Ed...@citrix.com>.

Sent from my iPhone

On Jul 8, 2012, at 11:31 PM, "Tomoe Sugihara" <to...@midokura.com> wrote:

> On Mon, Jul 9, 2012 at 9:20 AM, Edison Su <Ed...@citrix.com> wrote:
> 
>> 
>> 
>> Sent from my iPhone
>> 
>> On Jul 7, 2012, at 9:19 AM, "Tomoe Sugihara" <tomoe@midokura.com<mailto:
>> tomoe@midokura.com>> wrote:
>> 
>> Hi Edison,
>> 
>> This is very helpful for newbies like me.
>> However, I tried this according to the wiki page, but found some problems
>> listed below.
>> I managed to add a host, but couldn't even launch a VM due to the issue 3.
>> 
>> I hope this would help improve DevCloud.
>> 
>> ----------------------------
>> 1. ssh commands failed
>> 
>>   I got "com.jcraft.jsch.JSchException: reject HostKey" when I tried some
>> ant r* targets.
>>   So, I worked around this with the patch attached.
>> Thanks for your patch, but could please post the patch here? Attached is
>> not allowed in apache mailing list.
>> 
> 
> Sure. Will do.
> 
> 
>> 
>> 2. rdeploydb didn't work
>> 
>>  Since many scripts uses --password option to pass in password and mysql
>> prompts you, many of the commands failed.
>> 
>>  I ended up ssh'ing to dom0 and did the equivalent db setup.
>> 
>> Possible reason: do you override dbrootpw in
>> build/override/replace.properties on your host CloudStack source code
>> directory? If it's been override, then rdeploydb will use $dbrootpw to
>> deploy devcloud db, while devcloud db password is empty, so then failed.
>> 
> 
> I didn't touch anything on my working directory on the host. It was just
> pure master code at that time.

Need to add DBROOTPW= in build/override/replace.properties
> 
> 
> 
>> 
>> 3. tiny Linux template is not in good status
>> 
>> Status says "Unable to resolve nfs1.lab.vmops.com<
>> http://nfs1.lab.vmops.com>"...
>> 
>> Is there any place from which I can download templates easily?
>> You don't need to download this template, it's already preinstalled on
>> devcloud image, it's put under /opt/storage/secondary/template/tmpl/1/5/.
>> After secondary storage vm booting up, it will report this template to mgt
>> server.
>> Can you stop/start secondary storage vm? And check the management server
>> log(/opt/cloudstack/incu*/vmops.log, search ListTemplate. What ListTemplate
>> returns?
>> 
> 
> I have the image under  /opt/storage/secondary/template/tmpl/1/5/, but
> after restarting
> SSVM, the same thing happened. And, I cant'
> find /opt/cloudstack/incu*/vmops.log.
It's in the devcloud, can you "find /opt -name vmops.log" inside devcloud?
Btw, did you successful run "rdeploydb " and "rdebug"? if not, then the log file is at /var/log/cloud/management/management-server.log
> 
> Cheers,
> Tomoe
> 
> 
>> 
>> ------------------
>> 
>> Cheers,
>> Tomoe
>> 
>> On Sat, Jul 7, 2012 at 11:37 AM, Edison Su <Edison.su@citrix.com<mailto:
>> Edison.su@citrix.com>> wrote:
>> Hi All,
>>   I created an all-in-one-box CloudStack development environment, name it
>> as DevCloud. It's ready to download from
>> http://download.cloud.com/templates/devcloud/DevCloud.ova and the
>> document is put at http://wiki.cloudstack.org/display/comm/DevCloud.
>>   If you are a CloudStack developer whose daily tasks are directly
>> related to hypervisor, or are interested in CloudStack but don't want to
>> setup a CloudStack environment by yourself, welcome to have a try.
>>   Comments are welcome!
>>   Note: the image is about 1.5G, the downloading may take a while.
>> 
>> 

Re: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Edison Su <Ed...@citrix.com>.

Sent from my iPhone

On Jul 8, 2012, at 11:31 PM, "Tomoe Sugihara" <to...@midokura.com> wrote:

> On Mon, Jul 9, 2012 at 9:20 AM, Edison Su <Ed...@citrix.com> wrote:
> 
>> 
>> 
>> Sent from my iPhone
>> 
>> On Jul 7, 2012, at 9:19 AM, "Tomoe Sugihara" <tomoe@midokura.com<mailto:
>> tomoe@midokura.com>> wrote:
>> 
>> Hi Edison,
>> 
>> This is very helpful for newbies like me.
>> However, I tried this according to the wiki page, but found some problems
>> listed below.
>> I managed to add a host, but couldn't even launch a VM due to the issue 3.
>> 
>> I hope this would help improve DevCloud.
>> 
>> ----------------------------
>> 1. ssh commands failed
>> 
>>   I got "com.jcraft.jsch.JSchException: reject HostKey" when I tried some
>> ant r* targets.
>>   So, I worked around this with the patch attached.
>> Thanks for your patch, but could please post the patch here? Attached is
>> not allowed in apache mailing list.
>> 
> 
> Sure. Will do.
> 
> 
>> 
>> 2. rdeploydb didn't work
>> 
>>  Since many scripts uses --password option to pass in password and mysql
>> prompts you, many of the commands failed.
>> 
>>  I ended up ssh'ing to dom0 and did the equivalent db setup.
>> 
>> Possible reason: do you override dbrootpw in
>> build/override/replace.properties on your host CloudStack source code
>> directory? If it's been override, then rdeploydb will use $dbrootpw to
>> deploy devcloud db, while devcloud db password is empty, so then failed.
>> 
> 
> I didn't touch anything on my working directory on the host. It was just
> pure master code at that time.

Need to add DBROOTPW= in build/override/replace.properties
> 
> 
> 
>> 
>> 3. tiny Linux template is not in good status
>> 
>> Status says "Unable to resolve nfs1.lab.vmops.com<
>> http://nfs1.lab.vmops.com>"...
>> 
>> Is there any place from which I can download templates easily?
>> You don't need to download this template, it's already preinstalled on
>> devcloud image, it's put under /opt/storage/secondary/template/tmpl/1/5/.
>> After secondary storage vm booting up, it will report this template to mgt
>> server.
>> Can you stop/start secondary storage vm? And check the management server
>> log(/opt/cloudstack/incu*/vmops.log, search ListTemplate. What ListTemplate
>> returns?
>> 
> 
> I have the image under  /opt/storage/secondary/template/tmpl/1/5/, but
> after restarting
> SSVM, the same thing happened. And, I cant'
> find /opt/cloudstack/incu*/vmops.log.
It's in the devcloud, can you "find /opt -name vmops.log" inside devcloud?
Btw, did you successful run "rdeploydb " and "rdebug"? if not, then the log file is at /var/log/cloud/management/management-server.log
> 
> Cheers,
> Tomoe
> 
> 
>> 
>> ------------------
>> 
>> Cheers,
>> Tomoe
>> 
>> On Sat, Jul 7, 2012 at 11:37 AM, Edison Su <Edison.su@citrix.com<mailto:
>> Edison.su@citrix.com>> wrote:
>> Hi All,
>>   I created an all-in-one-box CloudStack development environment, name it
>> as DevCloud. It's ready to download from
>> http://download.cloud.com/templates/devcloud/DevCloud.ova and the
>> document is put at http://wiki.cloudstack.org/display/comm/DevCloud.
>>   If you are a CloudStack developer whose daily tasks are directly
>> related to hypervisor, or are interested in CloudStack but don't want to
>> setup a CloudStack environment by yourself, welcome to have a try.
>>   Comments are welcome!
>>   Note: the image is about 1.5G, the downloading may take a while.
>> 
>> 

About server hardware

Posted by Jewel Nuruddin <je...@yahoo.com>.
Hi All,

Need one comments about server hardware.
In one hypervisor I want to run 8 guest vm, what will be the main hardware I have to
take care properly!
can any one have any thought?

Thanks
Jewel

About server hardware

Posted by Jewel Nuruddin <je...@yahoo.com>.
Hi All,

Need one comments about server hardware.
In one hypervisor I want to run 8 guest vm, what will be the main hardware I have to
take care properly!
can any one have any thought?

Thanks
Jewel

Re: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Tomoe Sugihara <to...@midokura.com>.
On Mon, Jul 9, 2012 at 9:20 AM, Edison Su <Ed...@citrix.com> wrote:

>
>
> Sent from my iPhone
>
> On Jul 7, 2012, at 9:19 AM, "Tomoe Sugihara" <tomoe@midokura.com<mailto:
> tomoe@midokura.com>> wrote:
>
> Hi Edison,
>
> This is very helpful for newbies like me.
> However, I tried this according to the wiki page, but found some problems
> listed below.
> I managed to add a host, but couldn't even launch a VM due to the issue 3.
>
> I hope this would help improve DevCloud.
>
> ----------------------------
> 1. ssh commands failed
>
>    I got "com.jcraft.jsch.JSchException: reject HostKey" when I tried some
> ant r* targets.
>    So, I worked around this with the patch attached.
> Thanks for your patch, but could please post the patch here? Attached is
> not allowed in apache mailing list.
>

Sure. Will do.


>
> 2. rdeploydb didn't work
>
>   Since many scripts uses --password option to pass in password and mysql
> prompts you, many of the commands failed.
>
>   I ended up ssh'ing to dom0 and did the equivalent db setup.
>
> Possible reason: do you override dbrootpw in
> build/override/replace.properties on your host CloudStack source code
> directory? If it's been override, then rdeploydb will use $dbrootpw to
> deploy devcloud db, while devcloud db password is empty, so then failed.
>

I didn't touch anything on my working directory on the host. It was just
pure master code at that time.


>
> 3. tiny Linux template is not in good status
>
>  Status says "Unable to resolve nfs1.lab.vmops.com<
> http://nfs1.lab.vmops.com>"...
>
>  Is there any place from which I can download templates easily?
> You don't need to download this template, it's already preinstalled on
> devcloud image, it's put under /opt/storage/secondary/template/tmpl/1/5/.
> After secondary storage vm booting up, it will report this template to mgt
> server.
> Can you stop/start secondary storage vm? And check the management server
> log(/opt/cloudstack/incu*/vmops.log, search ListTemplate. What ListTemplate
> returns?
>

I have the image under  /opt/storage/secondary/template/tmpl/1/5/, but
after restarting
SSVM, the same thing happened. And, I cant'
find /opt/cloudstack/incu*/vmops.log.

Cheers,
Tomoe


>
> ------------------
>
> Cheers,
> Tomoe
>
> On Sat, Jul 7, 2012 at 11:37 AM, Edison Su <Edison.su@citrix.com<mailto:
> Edison.su@citrix.com>> wrote:
> Hi All,
>    I created an all-in-one-box CloudStack development environment, name it
> as DevCloud. It's ready to download from
> http://download.cloud.com/templates/devcloud/DevCloud.ova and the
> document is put at http://wiki.cloudstack.org/display/comm/DevCloud.
>    If you are a CloudStack developer whose daily tasks are directly
> related to hypervisor, or are interested in CloudStack but don't want to
> setup a CloudStack environment by yourself, welcome to have a try.
>    Comments are welcome!
>    Note: the image is about 1.5G, the downloading may take a while.
>
>

Re: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Tomoe Sugihara <to...@midokura.com>.
On Mon, Jul 9, 2012 at 9:20 AM, Edison Su <Ed...@citrix.com> wrote:

>
>
> Sent from my iPhone
>
> On Jul 7, 2012, at 9:19 AM, "Tomoe Sugihara" <tomoe@midokura.com<mailto:
> tomoe@midokura.com>> wrote:
>
> Hi Edison,
>
> This is very helpful for newbies like me.
> However, I tried this according to the wiki page, but found some problems
> listed below.
> I managed to add a host, but couldn't even launch a VM due to the issue 3.
>
> I hope this would help improve DevCloud.
>
> ----------------------------
> 1. ssh commands failed
>
>    I got "com.jcraft.jsch.JSchException: reject HostKey" when I tried some
> ant r* targets.
>    So, I worked around this with the patch attached.
> Thanks for your patch, but could please post the patch here? Attached is
> not allowed in apache mailing list.
>

Sure. Will do.


>
> 2. rdeploydb didn't work
>
>   Since many scripts uses --password option to pass in password and mysql
> prompts you, many of the commands failed.
>
>   I ended up ssh'ing to dom0 and did the equivalent db setup.
>
> Possible reason: do you override dbrootpw in
> build/override/replace.properties on your host CloudStack source code
> directory? If it's been override, then rdeploydb will use $dbrootpw to
> deploy devcloud db, while devcloud db password is empty, so then failed.
>

I didn't touch anything on my working directory on the host. It was just
pure master code at that time.


>
> 3. tiny Linux template is not in good status
>
>  Status says "Unable to resolve nfs1.lab.vmops.com<
> http://nfs1.lab.vmops.com>"...
>
>  Is there any place from which I can download templates easily?
> You don't need to download this template, it's already preinstalled on
> devcloud image, it's put under /opt/storage/secondary/template/tmpl/1/5/.
> After secondary storage vm booting up, it will report this template to mgt
> server.
> Can you stop/start secondary storage vm? And check the management server
> log(/opt/cloudstack/incu*/vmops.log, search ListTemplate. What ListTemplate
> returns?
>

I have the image under  /opt/storage/secondary/template/tmpl/1/5/, but
after restarting
SSVM, the same thing happened. And, I cant'
find /opt/cloudstack/incu*/vmops.log.

Cheers,
Tomoe


>
> ------------------
>
> Cheers,
> Tomoe
>
> On Sat, Jul 7, 2012 at 11:37 AM, Edison Su <Edison.su@citrix.com<mailto:
> Edison.su@citrix.com>> wrote:
> Hi All,
>    I created an all-in-one-box CloudStack development environment, name it
> as DevCloud. It's ready to download from
> http://download.cloud.com/templates/devcloud/DevCloud.ova and the
> document is put at http://wiki.cloudstack.org/display/comm/DevCloud.
>    If you are a CloudStack developer whose daily tasks are directly
> related to hypervisor, or are interested in CloudStack but don't want to
> setup a CloudStack environment by yourself, welcome to have a try.
>    Comments are welcome!
>    Note: the image is about 1.5G, the downloading may take a while.
>
>

Re: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Edison Su <Ed...@citrix.com>.

Sent from my iPhone

On Jul 8, 2012, at 7:24 PM, "David Nalley" <da...@gnsa.us> wrote:

> On Sun, Jul 8, 2012 at 8:20 PM, Edison Su <Ed...@citrix.com> wrote:
>> 
>> 
>> Sent from my iPhone
>> 
>> On Jul 7, 2012, at 9:19 AM, "Tomoe Sugihara" <to...@midokura.com>> wrote:
>> 
>> Hi Edison,
>> 
>> This is very helpful for newbies like me.
>> However, I tried this according to the wiki page, but found some problems listed below.
>> I managed to add a host, but couldn't even launch a VM due to the issue 3.
>> 
>> I hope this would help improve DevCloud.
>> 
>> ----------------------------
>> 1. ssh commands failed
>> 
>>   I got "com.jcraft.jsch.JSchException: reject HostKey" when I tried some ant r* targets.
>>   So, I worked around this with the patch attached.
>> Thanks for your patch, but could please post the patch here? Attached is not allowed in apache mailing list.
> 
> So it's expecting that you have sshed into the host first. (and it
> makes a difference which address) By default it will try and connect
> on localhost port 2222. So start by sshing manually to the host,
> should work after that.
> 
> 
>> 
>> 2. rdeploydb didn't work
>> 
>>  Since many scripts uses --password option to pass in password and mysql prompts you, many of the commands failed.
>> 
>>  I ended up ssh'ing to dom0 and did the equivalent db setup.
>> 
>> Possible reason: do you override dbrootpw in build/override/replace.properties on your host CloudStack source code directory? If it's been override, then rdeploydb will use $dbrootpw to deploy devcloud db, while devcloud db password is empty, so then failed.
> 
> Edison: with a fresh clone I am getting:
> [sshexec]      [exec] failed to init cloudev dbERROR 1045 (28000):
> Access denied for user 'cloud'@'localhost' (using password: YES)
> 
> I looked and it's passing --password="password".
> I fixed this in commit f157b702e4c6821fc4af4c27e085dea097b79101 and
> that gets me further, but it's still broken
> 
> [sshexec] deploy-cloudstack-db:
>  [sshexec]      [echo] deploydb server-setup.xml templates.sql ${DBROOTPW}
Mkdir build/override
cp build/replace.properties build/override/
add DBROOTPW= in build/override/replace.properties
rebuild and rdeploy
>  [sshexec]      [exec] Recreating Database cloud.
>  [sshexec]
>  [sshexec]      [exec] Please enter root password for MySQL.
>  [sshexec]
>  [sshexec]      [exec] Error: Cannot execute create-database.sql
>  [sshexec]
>  [sshexec]      [exec] Enter password: ERROR 1045 (28000): Access
> denied for user 'root'@'localhost' (using password: YES)
>  [sshexec]
>  [sshexec]      [exec] Result: 10
>  [sshexec]
> 
> 
> And similar issues with awsapi - I'll continue playing with it tonight
> and try and fix it.
> 
> 
> 
>> 
>> 3. tiny Linux template is not in good status
>> 
>> Status says "Unable to resolve nfs1.lab.vmops.com<http://nfs1.lab.vmops.com>"...
>> 
>> Is there any place from which I can download templates easily?
>> You don't need to download this template, it's already preinstalled on devcloud image, it's put under /opt/storage/secondary/template/tmpl/1/5/.
>> After secondary storage vm booting up, it will report this template to mgt server.
>> Can you stop/start secondary storage vm? And check the management server log(/opt/cloudstack/incu*/vmops.log, search ListTemplate. What ListTemplate returns?
> 
> Incidentally doesn't show up in mine either, and sysVMs aren't
> starting, I wanted to push new code up more than I wanted to start
> VMs, so I haven't gotten to play with this yet.
As above deploydb failed, the mgt server doesn't work properly. Fix the db issue first, then try "ant rdebug"

Re: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Tomoe Sugihara <to...@midokura.com>.
On Mon, Jul 9, 2012 at 11:23 AM, David Nalley <da...@gnsa.us> wrote:

> On Sun, Jul 8, 2012 at 8:20 PM, Edison Su <Ed...@citrix.com> wrote:
> >
> >
> > Sent from my iPhone
> >
> > On Jul 7, 2012, at 9:19 AM, "Tomoe Sugihara" <tomoe@midokura.com<mailto:
> tomoe@midokura.com>> wrote:
> >
> > Hi Edison,
> >
> > This is very helpful for newbies like me.
> > However, I tried this according to the wiki page, but found some
> problems listed below.
> > I managed to add a host, but couldn't even launch a VM due to the issue
> 3.
> >
> > I hope this would help improve DevCloud.
> >
> > ----------------------------
> > 1. ssh commands failed
> >
> >    I got "com.jcraft.jsch.JSchException: reject HostKey" when I tried
> some ant r* targets.
> >    So, I worked around this with the patch attached.
> > Thanks for your patch, but could please post the patch here? Attached is
> not allowed in apache mailing list.
>
> So it's expecting that you have sshed into the host first. (and it
> makes a difference which address) By default it will try and connect
> on localhost port 2222. So start by sshing manually to the host,
> should work after that.
>

On my host machine, Ubuntu 12.04 desktop, ssh didn't prompt me for adding
the host entry
to known_hosts. Maybe it's localhost?
I saw that other targets has "trust" option, so I thought I should add it.


> > 2. rdeploydb didn't work
> >
> >   Since many scripts uses --password option to pass in password and
> mysql prompts you, many of the commands failed.
> >
> >   I ended up ssh'ing to dom0 and did the equivalent db setup.
> >
> > Possible reason: do you override dbrootpw in
> build/override/replace.properties on your host CloudStack source code
> directory? If it's been override, then rdeploydb will use $dbrootpw to
> deploy devcloud db, while devcloud db password is empty, so then failed.
>
> Edison: with a fresh clone I am getting:
> [sshexec]      [exec] failed to init cloudev dbERROR 1045 (28000):
> Access denied for user 'cloud'@'localhost' (using password: YES)
>
> I looked and it's passing --password="password".
> I fixed this in commit f157b702e4c6821fc4af4c27e085dea097b79101 and
> that gets me further, but it's still broken
>
> [sshexec] deploy-cloudstack-db:
>   [sshexec]      [echo] deploydb server-setup.xml templates.sql ${DBROOTPW}
>   [sshexec]      [exec] Recreating Database cloud.
>   [sshexec]
>   [sshexec]      [exec] Please enter root password for MySQL.
>   [sshexec]
>   [sshexec]      [exec] Error: Cannot execute create-database.sql
>   [sshexec]
>   [sshexec]      [exec] Enter password: ERROR 1045 (28000): Access
> denied for user 'root'@'localhost' (using password: YES)
>   [sshexec]
>   [sshexec]      [exec] Result: 10
>   [sshexec]
>
>
> And similar issues with awsapi - I'll continue playing with it tonight
> and try and fix it.
>
>
>
> >
> > 3. tiny Linux template is not in good status
> >
> >  Status says "Unable to resolve nfs1.lab.vmops.com<
> http://nfs1.lab.vmops.com>"...
> >
> >  Is there any place from which I can download templates easily?
> > You don't need to download this template, it's already preinstalled on
> devcloud image, it's put under /opt/storage/secondary/template/tmpl/1/5/.
> > After secondary storage vm booting up, it will report this template to
> mgt server.
> > Can you stop/start secondary storage vm? And check the management server
> log(/opt/cloudstack/incu*/vmops.log, search ListTemplate. What ListTemplate
> returns?
>
> Incidentally doesn't show up in mine either, and sysVMs aren't
> starting, I wanted to push new code up more than I wanted to start
> VMs, so I haven't gotten to play with this yet.
>

On my env, sysVMs start, but I can't get consoles from webui.

Thanks,
Tomoe

Re: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by David Nalley <da...@gnsa.us>.
On Sun, Jul 8, 2012 at 8:20 PM, Edison Su <Ed...@citrix.com> wrote:
>
>
> Sent from my iPhone
>
> On Jul 7, 2012, at 9:19 AM, "Tomoe Sugihara" <to...@midokura.com>> wrote:
>
> Hi Edison,
>
> This is very helpful for newbies like me.
> However, I tried this according to the wiki page, but found some problems listed below.
> I managed to add a host, but couldn't even launch a VM due to the issue 3.
>
> I hope this would help improve DevCloud.
>
> ----------------------------
> 1. ssh commands failed
>
>    I got "com.jcraft.jsch.JSchException: reject HostKey" when I tried some ant r* targets.
>    So, I worked around this with the patch attached.
> Thanks for your patch, but could please post the patch here? Attached is not allowed in apache mailing list.

So it's expecting that you have sshed into the host first. (and it
makes a difference which address) By default it will try and connect
on localhost port 2222. So start by sshing manually to the host,
should work after that.


>
> 2. rdeploydb didn't work
>
>   Since many scripts uses --password option to pass in password and mysql prompts you, many of the commands failed.
>
>   I ended up ssh'ing to dom0 and did the equivalent db setup.
>
> Possible reason: do you override dbrootpw in build/override/replace.properties on your host CloudStack source code directory? If it's been override, then rdeploydb will use $dbrootpw to deploy devcloud db, while devcloud db password is empty, so then failed.

Edison: with a fresh clone I am getting:
[sshexec]      [exec] failed to init cloudev dbERROR 1045 (28000):
Access denied for user 'cloud'@'localhost' (using password: YES)

I looked and it's passing --password="password".
I fixed this in commit f157b702e4c6821fc4af4c27e085dea097b79101 and
that gets me further, but it's still broken

[sshexec] deploy-cloudstack-db:
  [sshexec]      [echo] deploydb server-setup.xml templates.sql ${DBROOTPW}
  [sshexec]      [exec] Recreating Database cloud.
  [sshexec]
  [sshexec]      [exec] Please enter root password for MySQL.
  [sshexec]
  [sshexec]      [exec] Error: Cannot execute create-database.sql
  [sshexec]
  [sshexec]      [exec] Enter password: ERROR 1045 (28000): Access
denied for user 'root'@'localhost' (using password: YES)
  [sshexec]
  [sshexec]      [exec] Result: 10
  [sshexec]


And similar issues with awsapi - I'll continue playing with it tonight
and try and fix it.



>
> 3. tiny Linux template is not in good status
>
>  Status says "Unable to resolve nfs1.lab.vmops.com<http://nfs1.lab.vmops.com>"...
>
>  Is there any place from which I can download templates easily?
> You don't need to download this template, it's already preinstalled on devcloud image, it's put under /opt/storage/secondary/template/tmpl/1/5/.
> After secondary storage vm booting up, it will report this template to mgt server.
> Can you stop/start secondary storage vm? And check the management server log(/opt/cloudstack/incu*/vmops.log, search ListTemplate. What ListTemplate returns?

Incidentally doesn't show up in mine either, and sysVMs aren't
starting, I wanted to push new code up more than I wanted to start
VMs, so I haven't gotten to play with this yet.

Re: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Edison Su <Ed...@citrix.com>.

Sent from my iPhone

On Jul 7, 2012, at 9:19 AM, "Tomoe Sugihara" <to...@midokura.com>> wrote:

Hi Edison,

This is very helpful for newbies like me.
However, I tried this according to the wiki page, but found some problems listed below.
I managed to add a host, but couldn't even launch a VM due to the issue 3.

I hope this would help improve DevCloud.

----------------------------
1. ssh commands failed

   I got "com.jcraft.jsch.JSchException: reject HostKey" when I tried some ant r* targets.
   So, I worked around this with the patch attached.
Thanks for your patch, but could please post the patch here? Attached is not allowed in apache mailing list.

2. rdeploydb didn't work

  Since many scripts uses --password option to pass in password and mysql prompts you, many of the commands failed.

  I ended up ssh'ing to dom0 and did the equivalent db setup.

Possible reason: do you override dbrootpw in build/override/replace.properties on your host CloudStack source code directory? If it's been override, then rdeploydb will use $dbrootpw to deploy devcloud db, while devcloud db password is empty, so then failed.

3. tiny Linux template is not in good status

 Status says "Unable to resolve nfs1.lab.vmops.com<http://nfs1.lab.vmops.com>"...

 Is there any place from which I can download templates easily?
You don't need to download this template, it's already preinstalled on devcloud image, it's put under /opt/storage/secondary/template/tmpl/1/5/.
After secondary storage vm booting up, it will report this template to mgt server.
Can you stop/start secondary storage vm? And check the management server log(/opt/cloudstack/incu*/vmops.log, search ListTemplate. What ListTemplate returns?

------------------

Cheers,
Tomoe

On Sat, Jul 7, 2012 at 11:37 AM, Edison Su <Ed...@citrix.com>> wrote:
Hi All,
   I created an all-in-one-box CloudStack development environment, name it as DevCloud. It's ready to download from http://download.cloud.com/templates/devcloud/DevCloud.ova and the document is put at http://wiki.cloudstack.org/display/comm/DevCloud.
   If you are a CloudStack developer whose daily tasks are directly related to hypervisor, or are interested in CloudStack but don't want to setup a CloudStack environment by yourself, welcome to have a try.
   Comments are welcome!
   Note: the image is about 1.5G, the downloading may take a while.


Re: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Edison Su <Ed...@citrix.com>.

Sent from my iPhone

On Jul 7, 2012, at 9:19 AM, "Tomoe Sugihara" <to...@midokura.com>> wrote:

Hi Edison,

This is very helpful for newbies like me.
However, I tried this according to the wiki page, but found some problems listed below.
I managed to add a host, but couldn't even launch a VM due to the issue 3.

I hope this would help improve DevCloud.

----------------------------
1. ssh commands failed

   I got "com.jcraft.jsch.JSchException: reject HostKey" when I tried some ant r* targets.
   So, I worked around this with the patch attached.
Thanks for your patch, but could please post the patch here? Attached is not allowed in apache mailing list.

2. rdeploydb didn't work

  Since many scripts uses --password option to pass in password and mysql prompts you, many of the commands failed.

  I ended up ssh'ing to dom0 and did the equivalent db setup.

Possible reason: do you override dbrootpw in build/override/replace.properties on your host CloudStack source code directory? If it's been override, then rdeploydb will use $dbrootpw to deploy devcloud db, while devcloud db password is empty, so then failed.

3. tiny Linux template is not in good status

 Status says "Unable to resolve nfs1.lab.vmops.com<http://nfs1.lab.vmops.com>"...

 Is there any place from which I can download templates easily?
You don't need to download this template, it's already preinstalled on devcloud image, it's put under /opt/storage/secondary/template/tmpl/1/5/.
After secondary storage vm booting up, it will report this template to mgt server.
Can you stop/start secondary storage vm? And check the management server log(/opt/cloudstack/incu*/vmops.log, search ListTemplate. What ListTemplate returns?

------------------

Cheers,
Tomoe

On Sat, Jul 7, 2012 at 11:37 AM, Edison Su <Ed...@citrix.com>> wrote:
Hi All,
   I created an all-in-one-box CloudStack development environment, name it as DevCloud. It's ready to download from http://download.cloud.com/templates/devcloud/DevCloud.ova and the document is put at http://wiki.cloudstack.org/display/comm/DevCloud.
   If you are a CloudStack developer whose daily tasks are directly related to hypervisor, or are interested in CloudStack but don't want to setup a CloudStack environment by yourself, welcome to have a try.
   Comments are welcome!
   Note: the image is about 1.5G, the downloading may take a while.


Re: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Tomoe Sugihara <to...@midokura.com>.
Hi Edison,

This is very helpful for newbies like me.
However, I tried this according to the wiki page, but found some problems
listed below.
I managed to add a host, but couldn't even launch a VM due to the issue 3.

I hope this would help improve DevCloud.

----------------------------
1. ssh commands failed

   I got "com.jcraft.jsch.JSchException: reject HostKey" when I tried some
ant r* targets.
   So, I worked around this with the patch attached.

2. rdeploydb didn't work

  Since many scripts uses --password option to pass in password and mysql
prompts you, many of the commands failed.

  I ended up ssh'ing to dom0 and did the equivalent db setup.

3. tiny Linux template is not in good status

 Status says "Unable to resolve nfs1.lab.vmops.com"...

 Is there any place from which I can download templates easily?

------------------

Cheers,
Tomoe

On Sat, Jul 7, 2012 at 11:37 AM, Edison Su <Ed...@citrix.com> wrote:

> Hi All,
>    I created an all-in-one-box CloudStack development environment, name it
> as DevCloud. It's ready to download from
> http://download.cloud.com/templates/devcloud/DevCloud.ova and the
> document is put at http://wiki.cloudstack.org/display/comm/DevCloud.
>    If you are a CloudStack developer whose daily tasks are directly
> related to hypervisor, or are interested in CloudStack but don't want to
> setup a CloudStack environment by yourself, welcome to have a try.
>    Comments are welcome!
>    Note: the image is about 1.5G, the downloading may take a while.
>

Re: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by David Nalley <da...@gnsa.us>.
On Fri, Jul 6, 2012 at 10:37 PM, Edison Su <Ed...@citrix.com> wrote:
> Hi All,
>    I created an all-in-one-box CloudStack development environment, name it as DevCloud. It's ready to download from http://download.cloud.com/templates/devcloud/DevCloud.ova and the document is put at http://wiki.cloudstack.org/display/comm/DevCloud.
>    If you are a CloudStack developer whose daily tasks are directly related to hypervisor, or are interested in CloudStack but don't want to setup a CloudStack environment by yourself, welcome to have a try.
>    Comments are welcome!
>    Note: the image is about 1.5G, the downloading may take a while.

First of all - AWESOME - thanks for doing this work.

Second - can you tell us a little about this. You provided an image -
so I assume it will run in a hypervisor without needing to have nested
hardware virt? What kind of hypervisor does the CloudStack instance
use?

If someone wanted to replicate this image themselves, how would one do
it? What did you do to customize the image?

--David

Re: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Tomoe Sugihara <to...@midokura.com>.
Hi Edison,

This is very helpful for newbies like me.
However, I tried this according to the wiki page, but found some problems
listed below.
I managed to add a host, but couldn't even launch a VM due to the issue 3.

I hope this would help improve DevCloud.

----------------------------
1. ssh commands failed

   I got "com.jcraft.jsch.JSchException: reject HostKey" when I tried some
ant r* targets.
   So, I worked around this with the patch attached.

2. rdeploydb didn't work

  Since many scripts uses --password option to pass in password and mysql
prompts you, many of the commands failed.

  I ended up ssh'ing to dom0 and did the equivalent db setup.

3. tiny Linux template is not in good status

 Status says "Unable to resolve nfs1.lab.vmops.com"...

 Is there any place from which I can download templates easily?

------------------

Cheers,
Tomoe

On Sat, Jul 7, 2012 at 11:37 AM, Edison Su <Ed...@citrix.com> wrote:

> Hi All,
>    I created an all-in-one-box CloudStack development environment, name it
> as DevCloud. It's ready to download from
> http://download.cloud.com/templates/devcloud/DevCloud.ova and the
> document is put at http://wiki.cloudstack.org/display/comm/DevCloud.
>    If you are a CloudStack developer whose daily tasks are directly
> related to hypervisor, or are interested in CloudStack but don't want to
> setup a CloudStack environment by yourself, welcome to have a try.
>    Comments are welcome!
>    Note: the image is about 1.5G, the downloading may take a while.
>

RE: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Edison Su <Ed...@citrix.com>.

> -----Original Message-----
> From: Chip Childers [mailto:chip.childers@sungard.com]
> Sent: Monday, July 09, 2012 10:34 AM
> To: cloudstack-dev@incubator.apache.org
> Subject: Re: [RFC] DevCloud, an all-in-one-box CloudStack development
> environment
>
> Edison,
>
> I'm getting database connection issues (I'm past the root password
> config) during the rdeploydb ant task.
>
> I'll keep debugging, but a pointer would be helpful.
>
> Here's the command I'm using:
>
> # ant rdeploydb -Drhost=127.0.0.1 -Drport=2222
>
> Here's the relevant log:
>
>   [sshexec] deploy-cloudstack-db:
>   [sshexec]
>   [sshexec]      [echo] deploydb server-setup.xml templates.sql
>   [sshexec]
>   [sshexec]      [exec] Recreating Database cloud.
>   [sshexec]
>   [sshexec]      [exec] Recreating Database cloud_usage
>   [sshexec]
>   [sshexec]      [exec] CP is
> ./:/opt/cloudstack/apache-tomcat-6.0.32/conf:/opt/cloudstack/apache-
> tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-
> agent.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-api.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-
> axis.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-backport-util-concurrent-3.0.jar:/opt/cloudstack/apache-
> tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-bcprov-jdk16-
> 1.45.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-cglib.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-commons-codec-
> 1.5.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-commons-collections-3.2.1.jar:/opt/cloudstack/apache-
> tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-commons-configuration-
> 1.8.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-commons-dbcp-1.4.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/clo
>   [sshexec] ud-commons-discovery.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-commons-httpclient-
> 3.1.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-commons-lang-2.6.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-commons-logging-
> 1.1.1.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-commons-pool-1.5.6.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-console-
> proxy.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-core.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-dp-user-concentrated-
> pod.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-dp-user-dispersing.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-
> ehcache.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-email.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-google-gson-
> 1.7.1.jar:/opt/cloud
>   [sshexec] stack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-host-allocator-random.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-httpcore-
> 4.0.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-iControl.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-jasypt-
> 1.8.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-jnetpcap.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-jsch-
> 0.1.42.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-jstl-1.2.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-
> junit.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-libvirt-0.4.5.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-log4j-
> extras.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-log4j.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-manageontap.jar:/opt/clouds
>   [sshexec] tack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-
> netscaler.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-netscaler-sdx.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-ovm.jar:/opt/cloudstack/apache-
> tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-plugin-
> elb.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-plugin-f5.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-plugin-
> netapp.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-plugin-netscaler.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-plugin-
> ovs.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-plugin-srx.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-
> server.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-storage-allocator-random.jar:/opt/cloudstack/apache-
> tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-trilead-ssh2-build
>   [sshexec] 213.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-user-authenticator-
> ldap.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-user-authenticator-md5.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-user-authenticator-
> plaintext.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-utils.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-vmware-
> base.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-vmware.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-ws-commons-util-
> 1.0.2.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-wsdl4j-1.6.2.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-
> wsdl4j.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-xen.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-xenserver-5.6.100-
> 1.jar:/opt/cloudstack/apache-tomcat-6.0.32
>   [sshexec] /webapps/client/WEB-INF/lib/cloud-xmlrpc-client-
> 3.1.3.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-xmlrpc-common-3.1.3.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-xstream-
> 1.3.1.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/vmware-apputils.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/vmware-lib-
> jaxrpc.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/vmware-vim25.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/vmware-
> vim.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/annotations-
> api.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/catalina-
> ant.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/catalina-
> ha.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/lib/catalina.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/lib/catalina-tribes.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/lib/cloud-mysql-connector-java-5.1.7-
> bin.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/ecj-
> 3.3.1.jar:/opt/cloudstack/apache-tomc
>   [sshexec] at-6.0.32/lib/el-api.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/lib/jasper-el.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/lib/jasper.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/jsp-
> api.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/mysql-connector-java-
> 5.1.7-bin.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/servlet-
> api.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/tomcat-
> coyote.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/tomcat-
> dbcp.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/tomcat-i18n-
> es.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/tomcat-i18n-
> fr.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/tomcat-i18n-ja.jar
>   [sshexec]
>   [sshexec]      [exec] Log4j configuration from :
> /opt/cloudstack/apache-tomcat-6.0.32/conf/log4j-cloud.xml
>   [sshexec]
>   [sshexec]      [exec] ERROR [cloud.test.DatabaseConfig] (main:)
> error creating service offering
>   [sshexec]
>   [sshexec]      [exec]
> com.cloud.utils.exception.CloudRuntimeException: DB Exception on: null
>   [sshexec]
>   [sshexec]      [exec]       at
> com.cloud.utils.db.GenericDaoBase.persist(GenericDaoBase.java:1310)
>   [sshexec]
>   [sshexec]      [exec]       at
> com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34)
>   [sshexec]
>   [sshexec]      [exec]       at
> com.cloud.test.DatabaseConfig.saveServiceOffering(DatabaseConfig.java:9
> 24)
>   [sshexec]
>   [sshexec]      [exec]       at
> com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34)
>   [sshexec]
>   [sshexec]      [exec]       at
> com.cloud.test.DatabaseConfig.saveCurrentObject(DatabaseConfig.java:456)
>   [sshexec]
>   [sshexec]      [exec]       at
> com.cloud.test.DatabaseConfig.access$100(DatabaseConfig.java:62)
>   [sshexec]
>   [sshexec]      [exec]       at
> com.cloud.test.DatabaseConfig$DbConfigXMLHandler.endElement(DatabaseCon
> fig.java:1289)
>   [sshexec]
>   [sshexec]      [exec]       at
> com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.endElement
> (AbstractSAXParser.java:604)
>   [sshexec]
>   [sshexec]      [exec]       at
> com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.
> scanEndElement(XMLDocumentFragmentScannerImpl.java:1759)
>   [sshexec]
>   [sshexec]      [exec]       at
> com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$
> FragmentContentDriver.next(XMLDocumentFragmentScannerImpl.java:2915)
>   [sshexec]      [exec]       at
> com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XML
> DocumentScannerImpl.java:625)
>   [sshexec]      [exec]       at
> com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.
> scanDocument(XMLDocumentFragmentScannerImpl.java:488)
>   [sshexec]      [exec]       at
> com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML
> 11Configuration.java:819)
>   [sshexec]      [exec]       at
> com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML
> 11Configuration.java:748)
>   [sshexec]      [exec]       at
> com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.ja
> va:123)
>   [sshexec]      [exec]       at
> com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(Abst
> ractSAXParser.java:1208)
>   [sshexec]      [exec]       at
> com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.par
> se(SAXParserImpl.java:525)
>   [sshexec]      [exec]       at
> javax.xml.parsers.SAXParser.parse(SAXParser.java:392)
>   [sshexec]      [exec]       at
> javax.xml.parsers.SAXParser.parse(SAXParser.java:328)
>   [sshexec]      [exec]       at
> com.cloud.test.DatabaseConfig.doConfig(DatabaseConfig.java:424)
>   [sshexec]      [exec]       at
> com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34)
>   [sshexec]      [exec]       at
> com.cloud.test.DatabaseConfig.main(DatabaseConfig.java:365)
>   [sshexec]      [exec] Caused by:
> com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException:
> Could not create connection to database server. Attempted reconnect 3
> times. Giving up.
>   [sshexec]      [exec]       at
> sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
>   [sshexec]      [exec]       at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructor
> AccessorImpl.java:57)
>   [sshexec]      [exec]       at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingCon
> structorAccessorImpl.java:45)
>   [sshexec]      [exec]       at
> java.lang.reflect.Constructor.newInstance(Constructor.java:532)
>   [sshexec]      [exec]       at
> com.mysql.jdbc.Util.handleNewInstance(Util.java:406)
>   [sshexec]      [exec]       at
> com.mysql.jdbc.Util.getInstance(Util.java:381)
>   [sshexec]      [exec]       at
> com.mysql.jdbc.SQLError.createSQLException(SQLError.java:984)
>   [sshexec]      [exec]       at
> com.mysql.jdbc.SQLError.createSQLException(SQLError.java:956)
>   [sshexec]      [exec]       at
> com.mysql.jdbc.SQLError.createSQLException(SQLError.java:926)
>   [sshexec]      [exec]       at
> com.mysql.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:2270)
>   [sshexec]      [exec]       at
> com.mysql.jdbc.ConnectionImpl.<init>(ConnectionImpl.java:723)
>   [sshexec]
>   [sshexec]      [exec]       at
> com.mysql.jdbc.JDBC4Connection.<init>(JDBC4Connection.java:46)
>   [sshexec]
>   [sshexec]      [exec]       at
> sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
>   [sshexec]
>   [sshexec]      [exec]       at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructor
> AccessorImpl.java:57)
>   [sshexec]
>   [sshexec]      [exec]       at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingCon
> structorAccessorImpl.java:45)
>   [sshexec]
>   [sshexec]      [exec]       at
> java.lang.reflect.Constructor.newInstance(Constructor.java:532)
>   [sshexec]
>   [sshexec]      [exec]       at
> com.mysql.jdbc.Util.handleNewInstance(Util.java:406)
>   [sshexec]      [exec]       at
> com.mysql.jdbc.ConnectionImpl.getInstance(ConnectionImpl.java:302)
>   [sshexec]      [exec]       at
> com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:2
> 82)
>   [sshexec]      [exec]       at
> java.sql.DriverManager.getConnection(DriverManager.java:620)
>   [sshexec]      [exec]       at
> java.sql.DriverManager.getConnection(DriverManager.java:200)
>   [sshexec]      [exec]       at
> org.apache.commons.dbcp.DriverManagerConnectionFactory.createConnection
> (DriverManagerConnectionFactory.java:75)
>   [sshexec]      [exec]       at
> org.apache.commons.dbcp.PoolableConnectionFactory.makeObject(PoolableCo
> nnectionFactory.java:582)
>   [sshexec]      [exec]       at
> org.apache.commons.pool.impl.GenericObjectPool.borrowObject(GenericObje
> ctPool.java:1181)
>   [sshexec]      [exec]       at
> org.apache.commons.dbcp.PoolingDataSource.getConnection(PoolingDataSour
> ce.java:106)
>   [sshexec]      [exec]       at
> com.cloud.utils.db.Transaction.getConnection(Transaction.java:514)
>   [sshexec]      [exec]       at
> com.cloud.utils.db.Transaction.prepareAutoCloseStatement(Transaction.ja
> va:445)
>   [sshexec]      [exec]       at
> com.cloud.utils.db.GenericDaoBase.persist(GenericDaoBase.java:1268)
>   [sshexec]      [exec]       ... 33 more
>   [sshexec]      [exec] Caused by:
> com.mysql.jdbc.exceptions.jdbc4.CommunicationsException:
> Communications link failure
>   [sshexec]      [exec]
>   [sshexec]      [exec] Last packet sent to the server was 0 ms ago.
>   [sshexec]      [exec]       ... 60 more
>   [sshexec]      [exec] Caused by: java.net.UnknownHostException:
> @DBHOST@

It says DBHOST is missing. As a developer, to get rdeploydb work, need to:
1. mkdir build/override/
2. cp build/replace.properties to build/override/replace.properties
3. add DBROOTPW= in build/override/replace.properties

Following is my replace.properties:
DBUSER=cloud
DBPW=cloud
DBROOTPW=
MSLOG=vmops.log
APISERVERLOG=api.log
DBHOST=localhost
AGENTLOGDIR=logs
AGENTLOG=logs/agent.log
MSMNTDIR=/mnt
COMPONENTS-SPEC=components-premium.xml
AWSAPILOG=awsapi.log
REMOTEHOST=localhost



>   [sshexec]      [exec]       ... 58 more
>
> Wash, rinse, repeat on many other similar exceptions...
>
> -chip

Re: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Chip Childers <ch...@sungard.com>.
Works now.  Thanks Edison.

On Mon, Jul 9, 2012 at 2:43 PM, Edison Su <Ed...@citrix.com> wrote:
> It's a bug the latest master, replace.properties is missing under build directory. I'll fix it.
>

RE: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Edison Su <Ed...@citrix.com>.

> -----Original Message-----
> From: Chip Childers [mailto:chip.childers@sungard.com]
> Sent: Monday, July 09, 2012 10:34 AM
> To: cloudstack-dev@incubator.apache.org
> Subject: Re: [RFC] DevCloud, an all-in-one-box CloudStack development
> environment
>
> Edison,
>
> I'm getting database connection issues (I'm past the root password
> config) during the rdeploydb ant task.
>
> I'll keep debugging, but a pointer would be helpful.
>
> Here's the command I'm using:
>
> # ant rdeploydb -Drhost=127.0.0.1 -Drport=2222
>
> Here's the relevant log:
>
>   [sshexec] deploy-cloudstack-db:
>   [sshexec]
>   [sshexec]      [echo] deploydb server-setup.xml templates.sql
>   [sshexec]
>   [sshexec]      [exec] Recreating Database cloud.
>   [sshexec]
>   [sshexec]      [exec] Recreating Database cloud_usage
>   [sshexec]
>   [sshexec]      [exec] CP is
> ./:/opt/cloudstack/apache-tomcat-6.0.32/conf:/opt/cloudstack/apache-
> tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-
> agent.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-api.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-
> axis.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-backport-util-concurrent-3.0.jar:/opt/cloudstack/apache-
> tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-bcprov-jdk16-
> 1.45.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-cglib.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-commons-codec-
> 1.5.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-commons-collections-3.2.1.jar:/opt/cloudstack/apache-
> tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-commons-configuration-
> 1.8.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-commons-dbcp-1.4.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/clo
>   [sshexec] ud-commons-discovery.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-commons-httpclient-
> 3.1.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-commons-lang-2.6.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-commons-logging-
> 1.1.1.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-commons-pool-1.5.6.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-console-
> proxy.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-core.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-dp-user-concentrated-
> pod.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-dp-user-dispersing.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-
> ehcache.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-email.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-google-gson-
> 1.7.1.jar:/opt/cloud
>   [sshexec] stack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-host-allocator-random.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-httpcore-
> 4.0.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-iControl.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-jasypt-
> 1.8.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-jnetpcap.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-jsch-
> 0.1.42.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-jstl-1.2.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-
> junit.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-libvirt-0.4.5.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-log4j-
> extras.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-log4j.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-manageontap.jar:/opt/clouds
>   [sshexec] tack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-
> netscaler.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-netscaler-sdx.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-ovm.jar:/opt/cloudstack/apache-
> tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-plugin-
> elb.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-plugin-f5.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-plugin-
> netapp.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-plugin-netscaler.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-plugin-
> ovs.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-plugin-srx.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-
> server.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-storage-allocator-random.jar:/opt/cloudstack/apache-
> tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-trilead-ssh2-build
>   [sshexec] 213.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-user-authenticator-
> ldap.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-user-authenticator-md5.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-user-authenticator-
> plaintext.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-utils.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-vmware-
> base.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-vmware.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-ws-commons-util-
> 1.0.2.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-wsdl4j-1.6.2.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-
> wsdl4j.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-xen.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-xenserver-5.6.100-
> 1.jar:/opt/cloudstack/apache-tomcat-6.0.32
>   [sshexec] /webapps/client/WEB-INF/lib/cloud-xmlrpc-client-
> 3.1.3.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/cloud-xmlrpc-common-3.1.3.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/cloud-xstream-
> 1.3.1.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/vmware-apputils.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/vmware-lib-
> jaxrpc.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-
> INF/lib/vmware-vim25.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/webapps/client/WEB-INF/lib/vmware-
> vim.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/annotations-
> api.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/catalina-
> ant.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/catalina-
> ha.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/lib/catalina.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/lib/catalina-tribes.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/lib/cloud-mysql-connector-java-5.1.7-
> bin.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/ecj-
> 3.3.1.jar:/opt/cloudstack/apache-tomc
>   [sshexec] at-6.0.32/lib/el-api.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/lib/jasper-el.jar:/opt/cloudstack/apache-tomcat-
> 6.0.32/lib/jasper.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/jsp-
> api.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/mysql-connector-java-
> 5.1.7-bin.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/servlet-
> api.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/tomcat-
> coyote.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/tomcat-
> dbcp.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/tomcat-i18n-
> es.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/tomcat-i18n-
> fr.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/tomcat-i18n-ja.jar
>   [sshexec]
>   [sshexec]      [exec] Log4j configuration from :
> /opt/cloudstack/apache-tomcat-6.0.32/conf/log4j-cloud.xml
>   [sshexec]
>   [sshexec]      [exec] ERROR [cloud.test.DatabaseConfig] (main:)
> error creating service offering
>   [sshexec]
>   [sshexec]      [exec]
> com.cloud.utils.exception.CloudRuntimeException: DB Exception on: null
>   [sshexec]
>   [sshexec]      [exec]       at
> com.cloud.utils.db.GenericDaoBase.persist(GenericDaoBase.java:1310)
>   [sshexec]
>   [sshexec]      [exec]       at
> com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34)
>   [sshexec]
>   [sshexec]      [exec]       at
> com.cloud.test.DatabaseConfig.saveServiceOffering(DatabaseConfig.java:9
> 24)
>   [sshexec]
>   [sshexec]      [exec]       at
> com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34)
>   [sshexec]
>   [sshexec]      [exec]       at
> com.cloud.test.DatabaseConfig.saveCurrentObject(DatabaseConfig.java:456)
>   [sshexec]
>   [sshexec]      [exec]       at
> com.cloud.test.DatabaseConfig.access$100(DatabaseConfig.java:62)
>   [sshexec]
>   [sshexec]      [exec]       at
> com.cloud.test.DatabaseConfig$DbConfigXMLHandler.endElement(DatabaseCon
> fig.java:1289)
>   [sshexec]
>   [sshexec]      [exec]       at
> com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.endElement
> (AbstractSAXParser.java:604)
>   [sshexec]
>   [sshexec]      [exec]       at
> com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.
> scanEndElement(XMLDocumentFragmentScannerImpl.java:1759)
>   [sshexec]
>   [sshexec]      [exec]       at
> com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$
> FragmentContentDriver.next(XMLDocumentFragmentScannerImpl.java:2915)
>   [sshexec]      [exec]       at
> com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XML
> DocumentScannerImpl.java:625)
>   [sshexec]      [exec]       at
> com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.
> scanDocument(XMLDocumentFragmentScannerImpl.java:488)
>   [sshexec]      [exec]       at
> com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML
> 11Configuration.java:819)
>   [sshexec]      [exec]       at
> com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML
> 11Configuration.java:748)
>   [sshexec]      [exec]       at
> com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.ja
> va:123)
>   [sshexec]      [exec]       at
> com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(Abst
> ractSAXParser.java:1208)
>   [sshexec]      [exec]       at
> com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.par
> se(SAXParserImpl.java:525)
>   [sshexec]      [exec]       at
> javax.xml.parsers.SAXParser.parse(SAXParser.java:392)
>   [sshexec]      [exec]       at
> javax.xml.parsers.SAXParser.parse(SAXParser.java:328)
>   [sshexec]      [exec]       at
> com.cloud.test.DatabaseConfig.doConfig(DatabaseConfig.java:424)
>   [sshexec]      [exec]       at
> com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34)
>   [sshexec]      [exec]       at
> com.cloud.test.DatabaseConfig.main(DatabaseConfig.java:365)
>   [sshexec]      [exec] Caused by:
> com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException:
> Could not create connection to database server. Attempted reconnect 3
> times. Giving up.
>   [sshexec]      [exec]       at
> sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
>   [sshexec]      [exec]       at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructor
> AccessorImpl.java:57)
>   [sshexec]      [exec]       at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingCon
> structorAccessorImpl.java:45)
>   [sshexec]      [exec]       at
> java.lang.reflect.Constructor.newInstance(Constructor.java:532)
>   [sshexec]      [exec]       at
> com.mysql.jdbc.Util.handleNewInstance(Util.java:406)
>   [sshexec]      [exec]       at
> com.mysql.jdbc.Util.getInstance(Util.java:381)
>   [sshexec]      [exec]       at
> com.mysql.jdbc.SQLError.createSQLException(SQLError.java:984)
>   [sshexec]      [exec]       at
> com.mysql.jdbc.SQLError.createSQLException(SQLError.java:956)
>   [sshexec]      [exec]       at
> com.mysql.jdbc.SQLError.createSQLException(SQLError.java:926)
>   [sshexec]      [exec]       at
> com.mysql.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:2270)
>   [sshexec]      [exec]       at
> com.mysql.jdbc.ConnectionImpl.<init>(ConnectionImpl.java:723)
>   [sshexec]
>   [sshexec]      [exec]       at
> com.mysql.jdbc.JDBC4Connection.<init>(JDBC4Connection.java:46)
>   [sshexec]
>   [sshexec]      [exec]       at
> sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
>   [sshexec]
>   [sshexec]      [exec]       at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructor
> AccessorImpl.java:57)
>   [sshexec]
>   [sshexec]      [exec]       at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingCon
> structorAccessorImpl.java:45)
>   [sshexec]
>   [sshexec]      [exec]       at
> java.lang.reflect.Constructor.newInstance(Constructor.java:532)
>   [sshexec]
>   [sshexec]      [exec]       at
> com.mysql.jdbc.Util.handleNewInstance(Util.java:406)
>   [sshexec]      [exec]       at
> com.mysql.jdbc.ConnectionImpl.getInstance(ConnectionImpl.java:302)
>   [sshexec]      [exec]       at
> com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:2
> 82)
>   [sshexec]      [exec]       at
> java.sql.DriverManager.getConnection(DriverManager.java:620)
>   [sshexec]      [exec]       at
> java.sql.DriverManager.getConnection(DriverManager.java:200)
>   [sshexec]      [exec]       at
> org.apache.commons.dbcp.DriverManagerConnectionFactory.createConnection
> (DriverManagerConnectionFactory.java:75)
>   [sshexec]      [exec]       at
> org.apache.commons.dbcp.PoolableConnectionFactory.makeObject(PoolableCo
> nnectionFactory.java:582)
>   [sshexec]      [exec]       at
> org.apache.commons.pool.impl.GenericObjectPool.borrowObject(GenericObje
> ctPool.java:1181)
>   [sshexec]      [exec]       at
> org.apache.commons.dbcp.PoolingDataSource.getConnection(PoolingDataSour
> ce.java:106)
>   [sshexec]      [exec]       at
> com.cloud.utils.db.Transaction.getConnection(Transaction.java:514)
>   [sshexec]      [exec]       at
> com.cloud.utils.db.Transaction.prepareAutoCloseStatement(Transaction.ja
> va:445)
>   [sshexec]      [exec]       at
> com.cloud.utils.db.GenericDaoBase.persist(GenericDaoBase.java:1268)
>   [sshexec]      [exec]       ... 33 more
>   [sshexec]      [exec] Caused by:
> com.mysql.jdbc.exceptions.jdbc4.CommunicationsException:
> Communications link failure
>   [sshexec]      [exec]
>   [sshexec]      [exec] Last packet sent to the server was 0 ms ago.
>   [sshexec]      [exec]       ... 60 more
>   [sshexec]      [exec] Caused by: java.net.UnknownHostException:
> @DBHOST@
>   [sshexec]      [exec]       ... 58 more
>
> Wash, rinse, repeat on many other similar exceptions...


It's a bug the latest master, replace.properties is missing under build directory. I'll fix it.

>
> -chip

Re: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Chip Childers <ch...@sungard.com>.
Edison,

I'm getting database connection issues (I'm past the root password
config) during the rdeploydb ant task.

I'll keep debugging, but a pointer would be helpful.

Here's the command I'm using:

# ant rdeploydb -Drhost=127.0.0.1 -Drport=2222

Here's the relevant log:

  [sshexec] deploy-cloudstack-db:
  [sshexec]
  [sshexec]      [echo] deploydb server-setup.xml templates.sql
  [sshexec]
  [sshexec]      [exec] Recreating Database cloud.
  [sshexec]
  [sshexec]      [exec] Recreating Database cloud_usage
  [sshexec]
  [sshexec]      [exec] CP is
./:/opt/cloudstack/apache-tomcat-6.0.32/conf:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-agent.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-api.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-axis.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-backport-util-concurrent-3.0.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-bcprov-jdk16-1.45.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-cglib.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-commons-codec-1.5.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-commons-collections-3.2.1.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-commons-configuration-1.8.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-commons-dbcp-1.4.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/clo
  [sshexec] ud-commons-discovery.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-commons-httpclient-3.1.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-commons-lang-2.6.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-commons-logging-1.1.1.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-commons-pool-1.5.6.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-console-proxy.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-core.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-dp-user-concentrated-pod.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-dp-user-dispersing.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-ehcache.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-email.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-google-gson-1.7.1.jar:/opt/cloud
  [sshexec] stack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-host-allocator-random.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-httpcore-4.0.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-iControl.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-jasypt-1.8.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-jnetpcap.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-jsch-0.1.42.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-jstl-1.2.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-junit.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-libvirt-0.4.5.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-log4j-extras.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-log4j.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-manageontap.jar:/opt/clouds
  [sshexec] tack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-netscaler.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-netscaler-sdx.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-ovm.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-plugin-elb.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-plugin-f5.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-plugin-netapp.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-plugin-netscaler.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-plugin-ovs.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-plugin-srx.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-server.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-storage-allocator-random.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-trilead-ssh2-build
  [sshexec] 213.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-user-authenticator-ldap.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-user-authenticator-md5.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-user-authenticator-plaintext.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-utils.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-vmware-base.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-vmware.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-ws-commons-util-1.0.2.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-wsdl4j-1.6.2.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-wsdl4j.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-xen.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-xenserver-5.6.100-1.jar:/opt/cloudstack/apache-tomcat-6.0.32
  [sshexec] /webapps/client/WEB-INF/lib/cloud-xmlrpc-client-3.1.3.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-xmlrpc-common-3.1.3.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/cloud-xstream-1.3.1.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/vmware-apputils.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/vmware-lib-jaxrpc.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/vmware-vim25.jar:/opt/cloudstack/apache-tomcat-6.0.32/webapps/client/WEB-INF/lib/vmware-vim.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/annotations-api.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/catalina-ant.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/catalina-ha.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/catalina.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/catalina-tribes.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/cloud-mysql-connector-java-5.1.7-bin.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/ecj-3.3.1.jar:/opt/cloudstack/apache-tomc
  [sshexec] at-6.0.32/lib/el-api.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/jasper-el.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/jasper.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/jsp-api.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/mysql-connector-java-5.1.7-bin.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/servlet-api.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/tomcat-coyote.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/tomcat-dbcp.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/tomcat-i18n-es.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/tomcat-i18n-fr.jar:/opt/cloudstack/apache-tomcat-6.0.32/lib/tomcat-i18n-ja.jar
  [sshexec]
  [sshexec]      [exec] Log4j configuration from :
/opt/cloudstack/apache-tomcat-6.0.32/conf/log4j-cloud.xml
  [sshexec]
  [sshexec]      [exec] ERROR [cloud.test.DatabaseConfig] (main:)
error creating service offering
  [sshexec]
  [sshexec]      [exec]
com.cloud.utils.exception.CloudRuntimeException: DB Exception on: null
  [sshexec]
  [sshexec]      [exec] 	at
com.cloud.utils.db.GenericDaoBase.persist(GenericDaoBase.java:1310)
  [sshexec]
  [sshexec]      [exec] 	at
com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34)
  [sshexec]
  [sshexec]      [exec] 	at
com.cloud.test.DatabaseConfig.saveServiceOffering(DatabaseConfig.java:924)
  [sshexec]
  [sshexec]      [exec] 	at
com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34)
  [sshexec]
  [sshexec]      [exec] 	at
com.cloud.test.DatabaseConfig.saveCurrentObject(DatabaseConfig.java:456)
  [sshexec]
  [sshexec]      [exec] 	at
com.cloud.test.DatabaseConfig.access$100(DatabaseConfig.java:62)
  [sshexec]
  [sshexec]      [exec] 	at
com.cloud.test.DatabaseConfig$DbConfigXMLHandler.endElement(DatabaseConfig.java:1289)
  [sshexec]
  [sshexec]      [exec] 	at
com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.endElement(AbstractSAXParser.java:604)
  [sshexec]
  [sshexec]      [exec] 	at
com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanEndElement(XMLDocumentFragmentScannerImpl.java:1759)
  [sshexec]
  [sshexec]      [exec] 	at
com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(XMLDocumentFragmentScannerImpl.java:2915)
  [sshexec]      [exec] 	at
com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:625)
  [sshexec]      [exec] 	at
com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:488)
  [sshexec]      [exec] 	at
com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:819)
  [sshexec]      [exec] 	at
com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:748)
  [sshexec]      [exec] 	at
com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:123)
  [sshexec]      [exec] 	at
com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1208)
  [sshexec]      [exec] 	at
com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:525)
  [sshexec]      [exec] 	at
javax.xml.parsers.SAXParser.parse(SAXParser.java:392)
  [sshexec]      [exec] 	at
javax.xml.parsers.SAXParser.parse(SAXParser.java:328)
  [sshexec]      [exec] 	at
com.cloud.test.DatabaseConfig.doConfig(DatabaseConfig.java:424)
  [sshexec]      [exec] 	at
com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34)
  [sshexec]      [exec] 	at
com.cloud.test.DatabaseConfig.main(DatabaseConfig.java:365)
  [sshexec]      [exec] Caused by:
com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException:
Could not create connection to database server. Attempted reconnect 3
times. Giving up.
  [sshexec]      [exec] 	at
sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
  [sshexec]      [exec] 	at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
  [sshexec]      [exec] 	at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
  [sshexec]      [exec] 	at
java.lang.reflect.Constructor.newInstance(Constructor.java:532)
  [sshexec]      [exec] 	at com.mysql.jdbc.Util.handleNewInstance(Util.java:406)
  [sshexec]      [exec] 	at com.mysql.jdbc.Util.getInstance(Util.java:381)
  [sshexec]      [exec] 	at
com.mysql.jdbc.SQLError.createSQLException(SQLError.java:984)
  [sshexec]      [exec] 	at
com.mysql.jdbc.SQLError.createSQLException(SQLError.java:956)
  [sshexec]      [exec] 	at
com.mysql.jdbc.SQLError.createSQLException(SQLError.java:926)
  [sshexec]      [exec] 	at
com.mysql.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:2270)
  [sshexec]      [exec] 	at
com.mysql.jdbc.ConnectionImpl.<init>(ConnectionImpl.java:723)
  [sshexec]
  [sshexec]      [exec] 	at
com.mysql.jdbc.JDBC4Connection.<init>(JDBC4Connection.java:46)
  [sshexec]
  [sshexec]      [exec] 	at
sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
  [sshexec]
  [sshexec]      [exec] 	at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
  [sshexec]
  [sshexec]      [exec] 	at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
  [sshexec]
  [sshexec]      [exec] 	at
java.lang.reflect.Constructor.newInstance(Constructor.java:532)
  [sshexec]
  [sshexec]      [exec] 	at com.mysql.jdbc.Util.handleNewInstance(Util.java:406)
  [sshexec]      [exec] 	at
com.mysql.jdbc.ConnectionImpl.getInstance(ConnectionImpl.java:302)
  [sshexec]      [exec] 	at
com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:282)
  [sshexec]      [exec] 	at
java.sql.DriverManager.getConnection(DriverManager.java:620)
  [sshexec]      [exec] 	at
java.sql.DriverManager.getConnection(DriverManager.java:200)
  [sshexec]      [exec] 	at
org.apache.commons.dbcp.DriverManagerConnectionFactory.createConnection(DriverManagerConnectionFactory.java:75)
  [sshexec]      [exec] 	at
org.apache.commons.dbcp.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:582)
  [sshexec]      [exec] 	at
org.apache.commons.pool.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:1181)
  [sshexec]      [exec] 	at
org.apache.commons.dbcp.PoolingDataSource.getConnection(PoolingDataSource.java:106)
  [sshexec]      [exec] 	at
com.cloud.utils.db.Transaction.getConnection(Transaction.java:514)
  [sshexec]      [exec] 	at
com.cloud.utils.db.Transaction.prepareAutoCloseStatement(Transaction.java:445)
  [sshexec]      [exec] 	at
com.cloud.utils.db.GenericDaoBase.persist(GenericDaoBase.java:1268)
  [sshexec]      [exec] 	... 33 more
  [sshexec]      [exec] Caused by:
com.mysql.jdbc.exceptions.jdbc4.CommunicationsException:
Communications link failure
  [sshexec]      [exec]
  [sshexec]      [exec] Last packet sent to the server was 0 ms ago.
  [sshexec]      [exec] 	... 60 more
  [sshexec]      [exec] Caused by: java.net.UnknownHostException: @DBHOST@
  [sshexec]      [exec] 	... 58 more

Wash, rinse, repeat on many other similar exceptions...

-chip

Re: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Tomoe Sugihara <to...@midokura.com>.
Hi Edison,

This is very helpful for newbies like me.
However, I tried this according to the wiki page, but found some problems
listed below.
I managed to add a host, but couldn't even launch a VM due to the issue 3.

I hope this would help improve DevCloud.

----------------------------
1. ssh commands failed

   I got "com.jcraft.jsch.JSchException: reject HostKey" when I tried some
ant r* targets.
   So, I worked around this with the patch attached.

2. rdeploydb didn't work

  Since many scripts uses --password option to pass in password and mysql
prompts you, many of the commands failed.

  I ended up ssh'ing to dom0 and did the equivalent db setup.

3. tiny Linux template is not in good status

 Status says "Unable to resolve nfs1.lab.vmops.com"...

 Is there any place from which I can download templates easily?

------------------

Cheers,
Tomoe

On Sat, Jul 7, 2012 at 11:37 AM, Edison Su <Ed...@citrix.com> wrote:

> Hi All,
>    I created an all-in-one-box CloudStack development environment, name it
> as DevCloud. It's ready to download from
> http://download.cloud.com/templates/devcloud/DevCloud.ova and the
> document is put at http://wiki.cloudstack.org/display/comm/DevCloud.
>    If you are a CloudStack developer whose daily tasks are directly
> related to hypervisor, or are interested in CloudStack but don't want to
> setup a CloudStack environment by yourself, welcome to have a try.
>    Comments are welcome!
>    Note: the image is about 1.5G, the downloading may take a while.
>

[RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Chip Childers <ch...@sungard.com>.
This should have been sent to the dev list.  Sorry about that.

---------- Forwarded message ----------
From: Chip Childers <ch...@sungard.com>
Date: Mon, Jul 9, 2012 at 11:31 PM
Subject: Re: [RFC] DevCloud, an all-in-one-box CloudStack development
environment
To: cloudstack-users@incubator.apache.org


On Mon, Jul 9, 2012 at 9:28 PM, Edison Su <Ed...@citrix.com> wrote:
> The known stuffs left are:
> 1. Need to automate CloudStack management server installation. We need a preinstalled CloudStack mgt server in DevCloud, for ordinary user. The main issue is that on master branch, DEB build is broken, and mgt server doesn't work on Ubuntu 12.04(such as tomcat6.conf is changed, some jar files are changed, not include in the class path etc). I manually hacked the DEB build and then changed a lot of files to get it work.

That one sounds messy...  Is there a reason that you started with
12.04 as the OS?  Does Fedora perhaps work better for now?

> 2. Minor one: such as setting root password to "password", set dom0 mem to 512M

Patch submitted via reviewboard.  https://reviews.apache.org/r/5877/

Any others like this?

> 4. Need to document or automate the VirtualBox image or ova creating process, such as what's the hardware configuration for the VM, what's the Port Forwarding rules we are using, etc.

This is where Vagrant can help out, since one of it's main goals in
life is to help configure the VirtualBox environment for a VM (or set
of VMs).  This includes all sorts of useful knobs.  If you want to do
the documentation, I wouldn't mind taking a shot at the vagrant
configuration.

>> Two other thoughts / questions:
>>
>> 1 - Did you consider using puppet recipes to configure the system?
>>
>> 2 - Did you consider wrapping the configuration / setup process with
>> Vagrant?
>>
> I thought about it before, but I am not familiar with both of these tools, so if the community can help, that will be great!
> Based on what devcloudscript.sh did, it should be doable if we move to puppet/Vagrant?
>

Looking at the script, absolutely.  Perhaps we can start with vagrant
at the beginning (using your existing script within the Vagrant
configuration process), and then look at shifting from the shell
provisioner type to a puppet manifest approach.  Sound reasonable?

Re: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by David Nalley <da...@gnsa.us>.
On Mon, Jul 9, 2012 at 11:31 PM, Chip Childers
<ch...@sungard.com> wrote:
> On Mon, Jul 9, 2012 at 9:28 PM, Edison Su <Ed...@citrix.com> wrote:
>> The known stuffs left are:
>> 1. Need to automate CloudStack management server installation. We need a preinstalled CloudStack mgt server in DevCloud, for ordinary user. The main issue is that on master branch, DEB build is broken, and mgt server doesn't work on Ubuntu 12.04(such as tomcat6.conf is changed, some jar files are changed, not include in the class path etc). I manually hacked the DEB build and then changed a lot of files to get it work.
>
> That one sounds messy...  Is there a reason that you started with
> 12.04 as the OS?  Does Fedora perhaps work better for now?
>
>> 2. Minor one: such as setting root password to "password", set dom0 mem to 512M
>
> Patch submitted via reviewboard.  https://reviews.apache.org/r/5877/
>
> Any others like this?
>
>> 4. Need to document or automate the VirtualBox image or ova creating process, such as what's the hardware configuration for the VM, what's the Port Forwarding rules we are using, etc.
>
> This is where Vagrant can help out, since one of it's main goals in
> life is to help configure the VirtualBox environment for a VM (or set
> of VMs).  This includes all sorts of useful knobs.  If you want to do
> the documentation, I wouldn't mind taking a shot at the vagrant
> configuration.
>
>>> Two other thoughts / questions:
>>>
>>> 1 - Did you consider using puppet recipes to configure the system?
>>>
>>> 2 - Did you consider wrapping the configuration / setup process with
>>> Vagrant?
>>>
>> I thought about it before, but I am not familiar with both of these tools, so if the community can help, that will be great!
>> Based on what devcloudscript.sh did, it should be doable if we move to puppet/Vagrant?
>>
>
> Looking at the script, absolutely.  Perhaps we can start with vagrant
> at the beginning (using your existing script within the Vagrant
> configuration process), and then look at shifting from the shell
> provisioner type to a puppet manifest approach.  Sound reasonable?

Yes, vagrant is ideal for this - and it means we could be generating
new images every night or at any other interval. If you are interested
in doing this, please do so!

RE: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Edison Su <Ed...@citrix.com>.

> -----Original Message-----
> From: Chip Childers [mailto:chip.childers@sungard.com]
> Sent: Wednesday, July 11, 2012 9:49 AM
> To: cloudstack-dev@incubator.apache.org
> Cc: David Nalley
> Subject: Re: [RFC] DevCloud, an all-in-one-box CloudStack development
> environment
> 
> On Tue, Jul 10, 2012 at 6:36 PM, Edison Su <Ed...@citrix.com> wrote:
> > The base image is easy to be created:
> > 1. Ubuntu 12.04 server, fresh installation, few things need to take
> into consideration:
> >     1) Devcloud vm disk size, is about 20G
> >     2) During installation, disk partition should be look like this:
> >        Root partition: need a separate /opt partition on LVM, which
> is used as primary storage and secondary storage. Created on LVM, so
> the partition can be extended easily if needed.
> >     3) The default installed packages: select SSH server.
> 
> Done, including the VirtualBox Guest Additions kernel modules (so that
> vagrant can work).
> 
> >     The Vagrant can not act as
> https://help.ubuntu.com/12.04/serverguide/jeos-and-vmbuilder.html ? If
> it can automate Ubuntu OS installation itself, that will be great...
> 
> I haven't really thought about how to build the "base box" yet, but
> that's an infrequent event really.

At least we'd have a document about how to setup the "base box", or people can't reproduce the image.

> 
> > 2. After Server installed, execute: "devcloudsetup.sh -p", will
> install xen+xcp, then reboot.
> 
> So a couple of points here:
> 
> 1 - I had initially thought about having "devcloudstetup.sh -p" as
> part of the Vagrant provisioning process.  Now that I've gone through
> it, I don't think that's the right place in the workflow.  Unless
> anyone objects, I'll do this step as part of the "base box"
> preparation.


Yes, it should be in the "base box" installation procedure, as it installs the OS/Hypervisor stuff.


> 
> 2 - The xcp-networking install requires console interaction (AFAIK).
> Do you know how to avoid the "bridged vs. ovs" prompt during the
> install process?
> 
> 3 - I'm assuming that you used "bridged" for the xcp network config.
> Correct?


Yes.

> 
> >> 2) steps you took to hack together the CloudStack build / install?
> >>
> >> For point 2, are you perhaps already looking at fixing the master
> >> branch build within Ubuntu 12.04?  If not, but you know the steps
> you
> >> generally took, I can start to look at this after the initial
> Vagrant
> >> work.
> >
> > Not yet. I think it's better let me do it, as it takes me a while to
> figure it out, what's wrong with the build. Don't waste your time on it.
> > I'll work on it tomorrow.
> 
> OK.  Let me know if you want any support.
> 
> > 4. Need to document or automate the VirtualBox image or ova
> > creating process, such as what's the hardware configuration for the
> VM,
> > what's the Port Forwarding rules we are using, etc.
> 
> I've got notes for the "base image" creation process, that I can start
> to put into a clean location.  There are several steps that can be
> added around your existing "-p" setup phase.  I'm thinking that there
> should be an option to specifically configure the OS as a Vagrant base
> image, allowing someone that uses VMware or Parallels (or other) to
> get to the same point in the process.

Agree. If need to install VirtualBox addon in the setupscript, then better to have an option to enable/disable it.


> 
> Here is the config that I have in the Vagrantfile now:
> 
> Vagrant::Config.run do |config|
>   config.vm.box = "devcloudbase-ubuntu-12-04-64bit"
>   # TODO: get a place to host the base image
>   # config.vm.box_url = "http://domain.com/path/to/above.box"
> 
>   # Uncomment this line to enable the console for debugging the
>   # build process.
>   # config.vm.boot_mode = :gui
> 
>   config.vm.forward_port 22, 2222
>   config.vm.forward_port 8080, 8080
>   config.vm.forward_port 8443, 8443
>   config.vm.forward_port 5901, 5901
>   config.vm.forward_port 8787, 8787
>   config.vm.forward_port 8250, 8250
> end

Re: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Chip Childers <ch...@sungard.com>.
On Tue, Jul 10, 2012 at 6:36 PM, Edison Su <Ed...@citrix.com> wrote:
> The base image is easy to be created:
> 1. Ubuntu 12.04 server, fresh installation, few things need to take into consideration:
>     1) Devcloud vm disk size, is about 20G
>     2) During installation, disk partition should be look like this:
>        Root partition: need a separate /opt partition on LVM, which is used as primary storage and secondary storage. Created on LVM, so the partition can be extended easily if needed.
>     3) The default installed packages: select SSH server.

Done, including the VirtualBox Guest Additions kernel modules (so that
vagrant can work).

>     The Vagrant can not act as https://help.ubuntu.com/12.04/serverguide/jeos-and-vmbuilder.html ? If it can automate Ubuntu OS installation itself, that will be great...

I haven't really thought about how to build the "base box" yet, but
that's an infrequent event really.

> 2. After Server installed, execute: "devcloudsetup.sh -p", will install xen+xcp, then reboot.

So a couple of points here:

1 - I had initially thought about having "devcloudstetup.sh -p" as
part of the Vagrant provisioning process.  Now that I've gone through
it, I don't think that's the right place in the workflow.  Unless
anyone objects, I'll do this step as part of the "base box"
preparation.

2 - The xcp-networking install requires console interaction (AFAIK).
Do you know how to avoid the "bridged vs. ovs" prompt during the
install process?

3 - I'm assuming that you used "bridged" for the xcp network config.  Correct?

>> 2) steps you took to hack together the CloudStack build / install?
>>
>> For point 2, are you perhaps already looking at fixing the master
>> branch build within Ubuntu 12.04?  If not, but you know the steps you
>> generally took, I can start to look at this after the initial Vagrant
>> work.
>
> Not yet. I think it's better let me do it, as it takes me a while to figure it out, what's wrong with the build. Don't waste your time on it.
> I'll work on it tomorrow.

OK.  Let me know if you want any support.

> 4. Need to document or automate the VirtualBox image or ova
> creating process, such as what's the hardware configuration for the VM,
> what's the Port Forwarding rules we are using, etc.

I've got notes for the "base image" creation process, that I can start
to put into a clean location.  There are several steps that can be
added around your existing "-p" setup phase.  I'm thinking that there
should be an option to specifically configure the OS as a Vagrant base
image, allowing someone that uses VMware or Parallels (or other) to
get to the same point in the process.

Here is the config that I have in the Vagrantfile now:

Vagrant::Config.run do |config|
  config.vm.box = "devcloudbase-ubuntu-12-04-64bit"
  # TODO: get a place to host the base image
  # config.vm.box_url = "http://domain.com/path/to/above.box"

  # Uncomment this line to enable the console for debugging the
  # build process.
  # config.vm.boot_mode = :gui

  config.vm.forward_port 22, 2222
  config.vm.forward_port 8080, 8080
  config.vm.forward_port 8443, 8443
  config.vm.forward_port 5901, 5901
  config.vm.forward_port 8787, 8787
  config.vm.forward_port 8250, 8250
end

RE: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Edison Su <Ed...@citrix.com>.

> -----Original Message-----
> From: Chip Childers [mailto:chip.childers@sungard.com]
> Sent: Tuesday, July 10, 2012 2:06 PM
> To: cloudstack-dev@incubator.apache.org
> Subject: Re: [RFC] DevCloud, an all-in-one-box CloudStack development
> environment
> 
> On Tue, Jul 10, 2012 at 1:35 AM, Edison Su <Ed...@citrix.com> wrote:
> >
> > On Jul 9, 2012, at 8:32 PM, "Chip Childers"
> <ch...@sungard.com> wrote:
> >
> >> On Mon, Jul 9, 2012 at 9:28 PM, Edison Su <Ed...@citrix.com>
> wrote:
> >>> The known stuffs left are:
> >>> 1. Need to automate CloudStack management server installation. We
> need a preinstalled CloudStack mgt server in DevCloud, for ordinary
> user. The main issue is that on master branch, DEB build is broken, and
> mgt server doesn't work on Ubuntu 12.04(such as tomcat6.conf is changed,
> some jar files are changed, not include in the class path etc). I
> manually hacked the DEB build and then changed a lot of files to get it
> work.
> >>
> >> That one sounds messy...  Is there a reason that you started with
> >> 12.04 as the OS?  Does Fedora perhaps work better for now?
> >
> > Only Ubuntu 12.04 supports Xen + xcp. Why choose Xen, not QEMU, or
> KVM?
> > 1. CloudStack has the best support for Xen for the known reason...
> > 2. DevCloud running in a VM, so KVM doesn't work as VirtualBox
> doesn't support nested CPU virtualization.
> > 3. PV Xen vm will be faster than the QEMU, and lesser CPU overhead.
> >
> > If running DevCloud inside a VM, Ubuntu 12.04 is an ideal choice for
> now.
> >  CloudStack supports Ubuntu 10.04, as 12.04 is already out for a
> while, it's time to add the support for 12.04 now.
> 
> I'm working on the simple Vagrant configuration now, based on your
> image.  However, the details above should probably be sorted out.
> Ideally, the base Vagrant box would be created from the point where
> you had completed the base OS install plus the Xen + xcp installs.
> Vagrant is most useful if it takes care of the initial installation of
> the software you are going to be working with.
> 
> Do you happen to have:
> 1) steps to reach the Ubuntu + Xen + Xcp?

The base image is easy to be created:
1. Ubuntu 12.04 server, fresh installation, few things need to take into consideration:
    1) Devcloud vm disk size, is about 20G
    2) During installation, disk partition should be look like this:
       Root partition: need a separate /opt partition on LVM, which is used as primary storage and secondary storage. Created on LVM, so the partition can be extended easily if needed.
    3) The default installed packages: select SSH server.
    The Vagrant can not act as https://help.ubuntu.com/12.04/serverguide/jeos-and-vmbuilder.html ? If it can automate Ubuntu OS installation itself, that will be great...

2. After Server installed, execute: "devcloudsetup.sh -p", will install xen+xcp, then reboot.


> 2) steps you took to hack together the CloudStack build / install?
> 
> For point 2, are you perhaps already looking at fixing the master
> branch build within Ubuntu 12.04?  If not, but you know the steps you
> generally took, I can start to look at this after the initial Vagrant
> work.

Not yet. I think it's better let me do it, as it takes me a while to figure it out, what's wrong with the build. Don't waste your time on it.
I'll work on it tomorrow.

> 
> >>> 4. Need to document or automate the VirtualBox image or ova
> creating process, such as what's the hardware configuration for the VM,
> what's the Port Forwarding rules we are using, etc.
> >>
> >> This is where Vagrant can help out, since one of it's main goals in
> >> life is to help configure the VirtualBox environment for a VM (or
> set
> >> of VMs).  This includes all sorts of useful knobs.  If you want to
> do
> >> the documentation, I wouldn't mind taking a shot at the vagrant
> >> configuration.
> > That will be great! If there anything I can help, feel free to email
> me.
> 
> I'm working on the obvious bits now (again, based on a "base image"
> that is your already created / tweaked image).  I'll send in a patch
> with a first pass vagrant config file when I'm done.
> 
> Also, who would I talk to about being able to push this new vagrant
> image up into downloads.cloudstack.org once I have something working?

David, is there a storage place can be shared by the community? 

> 
> -chip

Re: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Chip Childers <ch...@sungard.com>.
On Tue, Jul 10, 2012 at 1:35 AM, Edison Su <Ed...@citrix.com> wrote:
>
> On Jul 9, 2012, at 8:32 PM, "Chip Childers" <ch...@sungard.com> wrote:
>
>> On Mon, Jul 9, 2012 at 9:28 PM, Edison Su <Ed...@citrix.com> wrote:
>>> The known stuffs left are:
>>> 1. Need to automate CloudStack management server installation. We need a preinstalled CloudStack mgt server in DevCloud, for ordinary user. The main issue is that on master branch, DEB build is broken, and mgt server doesn't work on Ubuntu 12.04(such as tomcat6.conf is changed, some jar files are changed, not include in the class path etc). I manually hacked the DEB build and then changed a lot of files to get it work.
>>
>> That one sounds messy...  Is there a reason that you started with
>> 12.04 as the OS?  Does Fedora perhaps work better for now?
>
> Only Ubuntu 12.04 supports Xen + xcp. Why choose Xen, not QEMU, or KVM?
> 1. CloudStack has the best support for Xen for the known reason...
> 2. DevCloud running in a VM, so KVM doesn't work as VirtualBox doesn't support nested CPU virtualization.
> 3. PV Xen vm will be faster than the QEMU, and lesser CPU overhead.
>
> If running DevCloud inside a VM, Ubuntu 12.04 is an ideal choice for now.
>  CloudStack supports Ubuntu 10.04, as 12.04 is already out for a while, it's time to add the support for 12.04 now.

I'm working on the simple Vagrant configuration now, based on your
image.  However, the details above should probably be sorted out.
Ideally, the base Vagrant box would be created from the point where
you had completed the base OS install plus the Xen + xcp installs.
Vagrant is most useful if it takes care of the initial installation of
the software you are going to be working with.

Do you happen to have:
1) steps to reach the Ubuntu + Xen + Xcp?
2) steps you took to hack together the CloudStack build / install?

For point 2, are you perhaps already looking at fixing the master
branch build within Ubuntu 12.04?  If not, but you know the steps you
generally took, I can start to look at this after the initial Vagrant
work.

>>> 4. Need to document or automate the VirtualBox image or ova creating process, such as what's the hardware configuration for the VM, what's the Port Forwarding rules we are using, etc.
>>
>> This is where Vagrant can help out, since one of it's main goals in
>> life is to help configure the VirtualBox environment for a VM (or set
>> of VMs).  This includes all sorts of useful knobs.  If you want to do
>> the documentation, I wouldn't mind taking a shot at the vagrant
>> configuration.
> That will be great! If there anything I can help, feel free to email me.

I'm working on the obvious bits now (again, based on a "base image"
that is your already created / tweaked image).  I'll send in a patch
with a first pass vagrant config file when I'm done.

Also, who would I talk to about being able to push this new vagrant
image up into downloads.cloudstack.org once I have something working?

-chip

Re: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Edison Su <Ed...@citrix.com>.

Sent from my iPhone

On Jul 9, 2012, at 8:32 PM, "Chip Childers" <ch...@sungard.com> wrote:

> On Mon, Jul 9, 2012 at 9:28 PM, Edison Su <Ed...@citrix.com> wrote:
>> The known stuffs left are:
>> 1. Need to automate CloudStack management server installation. We need a preinstalled CloudStack mgt server in DevCloud, for ordinary user. The main issue is that on master branch, DEB build is broken, and mgt server doesn't work on Ubuntu 12.04(such as tomcat6.conf is changed, some jar files are changed, not include in the class path etc). I manually hacked the DEB build and then changed a lot of files to get it work.
> 
> That one sounds messy...  Is there a reason that you started with
> 12.04 as the OS?  Does Fedora perhaps work better for now?

Only Ubuntu 12.04 supports Xen + xcp. Why choose Xen, not QEMU, or KVM?
1. CloudStack has the best support for Xen for the known reason...
2. DevCloud running in a VM, so KVM doesn't work as VirtualBox doesn't support nested CPU virtualization.
3. PV Xen vm will be faster than the QEMU, and lesser CPU overhead.

If running DevCloud inside a VM, Ubuntu 12.04 is an ideal choice for now. 
 CloudStack supports Ubuntu 10.04, as 12.04 is already out for a while, it's time to add the support for 12.04 now.
> 
>> 2. Minor one: such as setting root password to "password", set dom0 mem to 512M
> 
> Patch submitted via reviewboard.  https://reviews.apache.org/r/5877/
> 
> Any others like this?

Thanks, I'll check in. No more right now.
> 
>> 4. Need to document or automate the VirtualBox image or ova creating process, such as what's the hardware configuration for the VM, what's the Port Forwarding rules we are using, etc.
> 
> This is where Vagrant can help out, since one of it's main goals in
> life is to help configure the VirtualBox environment for a VM (or set
> of VMs).  This includes all sorts of useful knobs.  If you want to do
> the documentation, I wouldn't mind taking a shot at the vagrant
> configuration.
That will be great! If there anything I can help, feel free to email me.
> 
>>> Two other thoughts / questions:
>>> 
>>> 1 - Did you consider using puppet recipes to configure the system?
>>> 
>>> 2 - Did you consider wrapping the configuration / setup process with
>>> Vagrant?
>>> 
>> I thought about it before, but I am not familiar with both of these tools, so if the community can help, that will be great!
>> Based on what devcloudscript.sh did, it should be doable if we move to puppet/Vagrant?
>> 
> 
> Looking at the script, absolutely.  Perhaps we can start with vagrant
> at the beginning (using your existing script within the Vagrant
> configuration process), and then look at shifting from the shell
> provisioner type to a puppet manifest approach.  Sound reasonable?
Nice. Let's do it!

Re: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Chip Childers <ch...@sungard.com>.
On Mon, Jul 9, 2012 at 9:28 PM, Edison Su <Ed...@citrix.com> wrote:
> The known stuffs left are:
> 1. Need to automate CloudStack management server installation. We need a preinstalled CloudStack mgt server in DevCloud, for ordinary user. The main issue is that on master branch, DEB build is broken, and mgt server doesn't work on Ubuntu 12.04(such as tomcat6.conf is changed, some jar files are changed, not include in the class path etc). I manually hacked the DEB build and then changed a lot of files to get it work.

That one sounds messy...  Is there a reason that you started with
12.04 as the OS?  Does Fedora perhaps work better for now?

> 2. Minor one: such as setting root password to "password", set dom0 mem to 512M

Patch submitted via reviewboard.  https://reviews.apache.org/r/5877/

Any others like this?

> 4. Need to document or automate the VirtualBox image or ova creating process, such as what's the hardware configuration for the VM, what's the Port Forwarding rules we are using, etc.

This is where Vagrant can help out, since one of it's main goals in
life is to help configure the VirtualBox environment for a VM (or set
of VMs).  This includes all sorts of useful knobs.  If you want to do
the documentation, I wouldn't mind taking a shot at the vagrant
configuration.

>> Two other thoughts / questions:
>>
>> 1 - Did you consider using puppet recipes to configure the system?
>>
>> 2 - Did you consider wrapping the configuration / setup process with
>> Vagrant?
>>
> I thought about it before, but I am not familiar with both of these tools, so if the community can help, that will be great!
> Based on what devcloudscript.sh did, it should be doable if we move to puppet/Vagrant?
>

Looking at the script, absolutely.  Perhaps we can start with vagrant
at the beginning (using your existing script within the Vagrant
configuration process), and then look at shifting from the shell
provisioner type to a puppet manifest approach.  Sound reasonable?

RE: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Edison Su <Ed...@citrix.com>.

> -----Original Message-----
> From: Chip Childers [mailto:chip.childers@sungard.com]
> Sent: Monday, July 09, 2012 5:31 PM
> To: cloudstack-users@incubator.apache.org
> Subject: Re: [RFC] DevCloud, an all-in-one-box CloudStack development
> environment
> 
> On Mon, Jul 9, 2012 at 6:57 PM, Edison Su <Ed...@citrix.com> wrote:
> > BTW, the wiki page is been updated with step-by-step illustration on
> how to use DevCloud: http://wiki.cloudstack.org/display/comm/DevCloud
> 
> Edison,
> 
> This really is great...  I love that I can now work with CloudStack
> without network access!
> 
> You mentioned earlier in the thread that you had partially implemented
> the devcloud build process in the devcloudsetup.sh script.  Do you
> have a list of outstanding items that others can pitch in and add to
> the script?

The automate build process is 90% implemented, I think. 
First, what the current build script did are:
1. install and config xen/xcp/network, then reboot into ubuntu dom0(devcloudsetup.sh -p)
2. create primary storage and secondary storage pool, download default templates, download cloudstack git repo etc (devcloudsetup.sh -P)

The known stuffs left are:
1. Need to automate CloudStack management server installation. We need a preinstalled CloudStack mgt server in DevCloud, for ordinary user. The main issue is that on master branch, DEB build is broken, and mgt server doesn't work on Ubuntu 12.04(such as tomcat6.conf is changed, some jar files are changed, not include in the class path etc). I manually hacked the DEB build and then changed a lot of files to get it work. 
2. Minor one: such as setting root password to "password", set dom0 mem to 512M
3. There are two default templates I haven't upload to public domain. A tiny user PV VM template(using http://www.xen.org/files/ttylinux-i486-8.0.img + debian dom0 kernel) is created, but haven't automated the creating process. 
4. Need to document or automate the VirtualBox image or ova creating process, such as what's the hardware configuration for the VM, what's the Port Forwarding rules we are using, etc.

The above Item 3, I can upload this two templates to public domain ASAP, don't know if any other items anybody has interest in?


> 
> One thing that I really liked about the OpenStack project's DevStack,
> is that it is really a set of scripts that build an environment from a
> fresh install of Ubuntu OR Fedora.  I would love if this was a goal we
> could work towards with DevCloud.

I think we can do better than DevStack:)

> 
> Two other thoughts / questions:
> 
> 1 - Did you consider using puppet recipes to configure the system?
> 
> 2 - Did you consider wrapping the configuration / setup process with
> Vagrant?
> 
> I'd love to help make this an easier / cleaner / more maintainable
> tool for the community.  Please do share any thoughts on how you might
> want help from others.


I thought about it before, but I am not familiar with both of these tools, so if the community can help, that will be great!
Based on what devcloudscript.sh did, it should be doable if we move to puppet/Vagrant?

> 
> -chip

Re: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Chip Childers <ch...@sungard.com>.
On Mon, Jul 9, 2012 at 6:57 PM, Edison Su <Ed...@citrix.com> wrote:
> BTW, the wiki page is been updated with step-by-step illustration on how to use DevCloud: http://wiki.cloudstack.org/display/comm/DevCloud

Edison,

This really is great...  I love that I can now work with CloudStack
without network access!

You mentioned earlier in the thread that you had partially implemented
the devcloud build process in the devcloudsetup.sh script.  Do you
have a list of outstanding items that others can pitch in and add to
the script?

One thing that I really liked about the OpenStack project's DevStack,
is that it is really a set of scripts that build an environment from a
fresh install of Ubuntu OR Fedora.  I would love if this was a goal we
could work towards with DevCloud.

Two other thoughts / questions:

1 - Did you consider using puppet recipes to configure the system?

2 - Did you consider wrapping the configuration / setup process with Vagrant?

I'd love to help make this an easier / cleaner / more maintainable
tool for the community.  Please do share any thoughts on how you might
want help from others.

-chip

RE: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Edison Su <Ed...@citrix.com>.
Nice, it works for you. 
BTW, the wiki page is been updated with step-by-step illustration on how to use DevCloud: http://wiki.cloudstack.org/display/comm/DevCloud


> -----Original Message-----
> From: sebastien goasguen [mailto:runseb@gmail.com]
> Sent: Monday, July 09, 2012 2:48 PM
> To: cloudstack-users@incubator.apache.org
> Subject: Re: [RFC] DevCloud, an all-in-one-box CloudStack development
> environment
> 
> Thanks. It works if I had more memory to the host and I don't specify
> a tinydiskoffering.
> I will check the storage setup.
> 
> -sebastien
> 
> 
> On Mon, Jul 9, 2012 at 5:30 PM, Edison Su <Ed...@citrix.com> wrote:
> > I guess you are talking about the memory in Xen dom0?
> > By default, Xen Ubuntu dom0 using 512M, plus few small MB memory used
> by xen itself, so there are around 1G - 512MB memory available for
> CloudStack.
> > 3 system VMs(ssvm/cpvm and router vm) will use 300MB, still around
> 200MB available to create two tiny VMs(100MB per VM).
> > You can take a look at mgt server UI: Infrastructure -> Hosts ->
> statistics, it will report how many memory are available for CloudStack.
> >
> >> -----Original Message-----
> >> From: sebastien goasguen [mailto:runseb@gmail.com]
> >> Sent: Monday, July 09, 2012 1:59 PM
> >> To: cloudstack-users@incubator.apache.org
> >> Subject: Re: [RFC] DevCloud, an all-in-one-box CloudStack
> development
> >> environment
> >>
> >> HI, yes I am using the tinyoffering.
> >>
> >> I used 1GB as well, but somehow only get 400 MB of RAM with the
> >> default xen kernel.
> >> If I specify 2GB during the import, I still only get 400MB.
> >> I have to specify the Ubuntu kernel in the boot menu to see the
> proper
> >> memory but Xen does not seem to be running.
> >>
> >> -sebastien
> >>
> >> On Mon, Jul 9, 2012 at 3:49 PM, Edison Su <Ed...@citrix.com>
> wrote:
> >> > Which service offering are you using to create the VM? The tiny?
> >> > And how much physical memory do you give to DevCloud? I tested
> with
> >> 1G memory, at least I can create one user VM.
> >> >
> >> >> -----Original Message-----
> >> >> From: sebastien goasguen [mailto:runseb@gmail.com]
> >> >> Sent: Monday, July 09, 2012 12:40 PM
> >> >> To: cloudstack-users@incubator.apache.org
> >> >> Subject: Re: [RFC] DevCloud, an all-in-one-box CloudStack
> >> development
> >> >> environment
> >> >>
> >> >> Hi Edison,
> >> >>
> >> >> I almost got this working. But my instances fail.
> >> >>
> >> >> The log give me a "Could not find suitable Deployment
> >> >> destination.."/"Insufficient server capacity exception" error.
> >> >>
> >> >> With the 2 systems VMs running, I am out of memory it seems. I
> only
> >> >> have 10MB left.
> >> >>
> >> >> -Sebastien
> >> >>
> >> >> On Fri, Jul 6, 2012 at 10:37 PM, Edison Su <Ed...@citrix.com>
> >> wrote:
> >> >> > Hi All,
> >> >> >    I created an all-in-one-box CloudStack development
> environment,
> >> >> name it as DevCloud. It's ready to download from
> >> >> http://download.cloud.com/templates/devcloud/DevCloud.ova and the
> >> >> document is put at
> http://wiki.cloudstack.org/display/comm/DevCloud.
> >> >> >    If you are a CloudStack developer whose daily tasks are
> >> directly
> >> >> related to hypervisor, or are interested in CloudStack but don't
> >> want
> >> >> to setup a CloudStack environment by yourself, welcome to have a
> try.
> >> >> >    Comments are welcome!
> >> >> >    Note: the image is about 1.5G, the downloading may take a
> while.
> >> >>
> >> >>
> >> >>
> >> >> --
> >> >> ---
> >> >> Sebastien Goasguen
> >> >> Open Source Cloud Evangelist, Cloudstack
> >> >> http://sites.google.com/site/runseb/
> >>
> >>
> >>
> >> --
> >> ---
> >> Sebastien Goasguen
> >> Open Source Cloud Evangelist, Cloudstack
> >> http://sites.google.com/site/runseb/
> 
> 
> 
> --
> ---
> Sebastien Goasguen
> Open Source Cloud Evangelist, Cloudstack
> http://sites.google.com/site/runseb/

Re: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by sebastien goasguen <ru...@gmail.com>.
Thanks. It works if I had more memory to the host and I don't specify
a tinydiskoffering.
I will check the storage setup.

-sebastien


On Mon, Jul 9, 2012 at 5:30 PM, Edison Su <Ed...@citrix.com> wrote:
> I guess you are talking about the memory in Xen dom0?
> By default, Xen Ubuntu dom0 using 512M, plus few small MB memory used by xen itself, so there are around 1G - 512MB memory available for CloudStack.
> 3 system VMs(ssvm/cpvm and router vm) will use 300MB, still around 200MB available to create two tiny VMs(100MB per VM).
> You can take a look at mgt server UI: Infrastructure -> Hosts -> statistics, it will report how many memory are available for CloudStack.
>
>> -----Original Message-----
>> From: sebastien goasguen [mailto:runseb@gmail.com]
>> Sent: Monday, July 09, 2012 1:59 PM
>> To: cloudstack-users@incubator.apache.org
>> Subject: Re: [RFC] DevCloud, an all-in-one-box CloudStack development
>> environment
>>
>> HI, yes I am using the tinyoffering.
>>
>> I used 1GB as well, but somehow only get 400 MB of RAM with the
>> default xen kernel.
>> If I specify 2GB during the import, I still only get 400MB.
>> I have to specify the Ubuntu kernel in the boot menu to see the proper
>> memory but Xen does not seem to be running.
>>
>> -sebastien
>>
>> On Mon, Jul 9, 2012 at 3:49 PM, Edison Su <Ed...@citrix.com> wrote:
>> > Which service offering are you using to create the VM? The tiny?
>> > And how much physical memory do you give to DevCloud? I tested with
>> 1G memory, at least I can create one user VM.
>> >
>> >> -----Original Message-----
>> >> From: sebastien goasguen [mailto:runseb@gmail.com]
>> >> Sent: Monday, July 09, 2012 12:40 PM
>> >> To: cloudstack-users@incubator.apache.org
>> >> Subject: Re: [RFC] DevCloud, an all-in-one-box CloudStack
>> development
>> >> environment
>> >>
>> >> Hi Edison,
>> >>
>> >> I almost got this working. But my instances fail.
>> >>
>> >> The log give me a "Could not find suitable Deployment
>> >> destination.."/"Insufficient server capacity exception" error.
>> >>
>> >> With the 2 systems VMs running, I am out of memory it seems. I only
>> >> have 10MB left.
>> >>
>> >> -Sebastien
>> >>
>> >> On Fri, Jul 6, 2012 at 10:37 PM, Edison Su <Ed...@citrix.com>
>> wrote:
>> >> > Hi All,
>> >> >    I created an all-in-one-box CloudStack development environment,
>> >> name it as DevCloud. It's ready to download from
>> >> http://download.cloud.com/templates/devcloud/DevCloud.ova and the
>> >> document is put at http://wiki.cloudstack.org/display/comm/DevCloud.
>> >> >    If you are a CloudStack developer whose daily tasks are
>> directly
>> >> related to hypervisor, or are interested in CloudStack but don't
>> want
>> >> to setup a CloudStack environment by yourself, welcome to have a try.
>> >> >    Comments are welcome!
>> >> >    Note: the image is about 1.5G, the downloading may take a while.
>> >>
>> >>
>> >>
>> >> --
>> >> ---
>> >> Sebastien Goasguen
>> >> Open Source Cloud Evangelist, Cloudstack
>> >> http://sites.google.com/site/runseb/
>>
>>
>>
>> --
>> ---
>> Sebastien Goasguen
>> Open Source Cloud Evangelist, Cloudstack
>> http://sites.google.com/site/runseb/



-- 
---
Sebastien Goasguen
Open Source Cloud Evangelist, Cloudstack
http://sites.google.com/site/runseb/

RE: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Edison Su <Ed...@citrix.com>.
I guess you are talking about the memory in Xen dom0?
By default, Xen Ubuntu dom0 using 512M, plus few small MB memory used by xen itself, so there are around 1G - 512MB memory available for CloudStack.
3 system VMs(ssvm/cpvm and router vm) will use 300MB, still around 200MB available to create two tiny VMs(100MB per VM).
You can take a look at mgt server UI: Infrastructure -> Hosts -> statistics, it will report how many memory are available for CloudStack.

> -----Original Message-----
> From: sebastien goasguen [mailto:runseb@gmail.com]
> Sent: Monday, July 09, 2012 1:59 PM
> To: cloudstack-users@incubator.apache.org
> Subject: Re: [RFC] DevCloud, an all-in-one-box CloudStack development
> environment
> 
> HI, yes I am using the tinyoffering.
> 
> I used 1GB as well, but somehow only get 400 MB of RAM with the
> default xen kernel.
> If I specify 2GB during the import, I still only get 400MB.
> I have to specify the Ubuntu kernel in the boot menu to see the proper
> memory but Xen does not seem to be running.
> 
> -sebastien
> 
> On Mon, Jul 9, 2012 at 3:49 PM, Edison Su <Ed...@citrix.com> wrote:
> > Which service offering are you using to create the VM? The tiny?
> > And how much physical memory do you give to DevCloud? I tested with
> 1G memory, at least I can create one user VM.
> >
> >> -----Original Message-----
> >> From: sebastien goasguen [mailto:runseb@gmail.com]
> >> Sent: Monday, July 09, 2012 12:40 PM
> >> To: cloudstack-users@incubator.apache.org
> >> Subject: Re: [RFC] DevCloud, an all-in-one-box CloudStack
> development
> >> environment
> >>
> >> Hi Edison,
> >>
> >> I almost got this working. But my instances fail.
> >>
> >> The log give me a "Could not find suitable Deployment
> >> destination.."/"Insufficient server capacity exception" error.
> >>
> >> With the 2 systems VMs running, I am out of memory it seems. I only
> >> have 10MB left.
> >>
> >> -Sebastien
> >>
> >> On Fri, Jul 6, 2012 at 10:37 PM, Edison Su <Ed...@citrix.com>
> wrote:
> >> > Hi All,
> >> >    I created an all-in-one-box CloudStack development environment,
> >> name it as DevCloud. It's ready to download from
> >> http://download.cloud.com/templates/devcloud/DevCloud.ova and the
> >> document is put at http://wiki.cloudstack.org/display/comm/DevCloud.
> >> >    If you are a CloudStack developer whose daily tasks are
> directly
> >> related to hypervisor, or are interested in CloudStack but don't
> want
> >> to setup a CloudStack environment by yourself, welcome to have a try.
> >> >    Comments are welcome!
> >> >    Note: the image is about 1.5G, the downloading may take a while.
> >>
> >>
> >>
> >> --
> >> ---
> >> Sebastien Goasguen
> >> Open Source Cloud Evangelist, Cloudstack
> >> http://sites.google.com/site/runseb/
> 
> 
> 
> --
> ---
> Sebastien Goasguen
> Open Source Cloud Evangelist, Cloudstack
> http://sites.google.com/site/runseb/

Re: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by sebastien goasguen <ru...@gmail.com>.
HI, yes I am using the tinyoffering.

I used 1GB as well, but somehow only get 400 MB of RAM with the
default xen kernel.
If I specify 2GB during the import, I still only get 400MB.
I have to specify the Ubuntu kernel in the boot menu to see the proper
memory but Xen does not seem to be running.

-sebastien

On Mon, Jul 9, 2012 at 3:49 PM, Edison Su <Ed...@citrix.com> wrote:
> Which service offering are you using to create the VM? The tiny?
> And how much physical memory do you give to DevCloud? I tested with 1G memory, at least I can create one user VM.
>
>> -----Original Message-----
>> From: sebastien goasguen [mailto:runseb@gmail.com]
>> Sent: Monday, July 09, 2012 12:40 PM
>> To: cloudstack-users@incubator.apache.org
>> Subject: Re: [RFC] DevCloud, an all-in-one-box CloudStack development
>> environment
>>
>> Hi Edison,
>>
>> I almost got this working. But my instances fail.
>>
>> The log give me a "Could not find suitable Deployment
>> destination.."/"Insufficient server capacity exception" error.
>>
>> With the 2 systems VMs running, I am out of memory it seems. I only
>> have 10MB left.
>>
>> -Sebastien
>>
>> On Fri, Jul 6, 2012 at 10:37 PM, Edison Su <Ed...@citrix.com> wrote:
>> > Hi All,
>> >    I created an all-in-one-box CloudStack development environment,
>> name it as DevCloud. It's ready to download from
>> http://download.cloud.com/templates/devcloud/DevCloud.ova and the
>> document is put at http://wiki.cloudstack.org/display/comm/DevCloud.
>> >    If you are a CloudStack developer whose daily tasks are directly
>> related to hypervisor, or are interested in CloudStack but don't want
>> to setup a CloudStack environment by yourself, welcome to have a try.
>> >    Comments are welcome!
>> >    Note: the image is about 1.5G, the downloading may take a while.
>>
>>
>>
>> --
>> ---
>> Sebastien Goasguen
>> Open Source Cloud Evangelist, Cloudstack
>> http://sites.google.com/site/runseb/



-- 
---
Sebastien Goasguen
Open Source Cloud Evangelist, Cloudstack
http://sites.google.com/site/runseb/

RE: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Edison Su <Ed...@citrix.com>.
Which service offering are you using to create the VM? The tiny?
And how much physical memory do you give to DevCloud? I tested with 1G memory, at least I can create one user VM.

> -----Original Message-----
> From: sebastien goasguen [mailto:runseb@gmail.com]
> Sent: Monday, July 09, 2012 12:40 PM
> To: cloudstack-users@incubator.apache.org
> Subject: Re: [RFC] DevCloud, an all-in-one-box CloudStack development
> environment
> 
> Hi Edison,
> 
> I almost got this working. But my instances fail.
> 
> The log give me a "Could not find suitable Deployment
> destination.."/"Insufficient server capacity exception" error.
> 
> With the 2 systems VMs running, I am out of memory it seems. I only
> have 10MB left.
> 
> -Sebastien
> 
> On Fri, Jul 6, 2012 at 10:37 PM, Edison Su <Ed...@citrix.com> wrote:
> > Hi All,
> >    I created an all-in-one-box CloudStack development environment,
> name it as DevCloud. It's ready to download from
> http://download.cloud.com/templates/devcloud/DevCloud.ova and the
> document is put at http://wiki.cloudstack.org/display/comm/DevCloud.
> >    If you are a CloudStack developer whose daily tasks are directly
> related to hypervisor, or are interested in CloudStack but don't want
> to setup a CloudStack environment by yourself, welcome to have a try.
> >    Comments are welcome!
> >    Note: the image is about 1.5G, the downloading may take a while.
> 
> 
> 
> --
> ---
> Sebastien Goasguen
> Open Source Cloud Evangelist, Cloudstack
> http://sites.google.com/site/runseb/

Re: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by sebastien goasguen <ru...@gmail.com>.
Hi Edison,

I almost got this working. But my instances fail.

The log give me a "Could not find suitable Deployment
destination.."/"Insufficient server capacity exception" error.

With the 2 systems VMs running, I am out of memory it seems. I only
have 10MB left.

-Sebastien

On Fri, Jul 6, 2012 at 10:37 PM, Edison Su <Ed...@citrix.com> wrote:
> Hi All,
>    I created an all-in-one-box CloudStack development environment, name it as DevCloud. It's ready to download from http://download.cloud.com/templates/devcloud/DevCloud.ova and the document is put at http://wiki.cloudstack.org/display/comm/DevCloud.
>    If you are a CloudStack developer whose daily tasks are directly related to hypervisor, or are interested in CloudStack but don't want to setup a CloudStack environment by yourself, welcome to have a try.
>    Comments are welcome!
>    Note: the image is about 1.5G, the downloading may take a while.



-- 
---
Sebastien Goasguen
Open Source Cloud Evangelist, Cloudstack
http://sites.google.com/site/runseb/

Re: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by David Nalley <da...@gnsa.us>.
On Fri, Jul 6, 2012 at 10:37 PM, Edison Su <Ed...@citrix.com> wrote:
> Hi All,
>    I created an all-in-one-box CloudStack development environment, name it as DevCloud. It's ready to download from http://download.cloud.com/templates/devcloud/DevCloud.ova and the document is put at http://wiki.cloudstack.org/display/comm/DevCloud.
>    If you are a CloudStack developer whose daily tasks are directly related to hypervisor, or are interested in CloudStack but don't want to setup a CloudStack environment by yourself, welcome to have a try.
>    Comments are welcome!
>    Note: the image is about 1.5G, the downloading may take a while.

First of all - AWESOME - thanks for doing this work.

Second - can you tell us a little about this. You provided an image -
so I assume it will run in a hypervisor without needing to have nested
hardware virt? What kind of hypervisor does the CloudStack instance
use?

If someone wanted to replicate this image themselves, how would one do
it? What did you do to customize the image?

--David

Re: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by David Nalley <da...@gnsa.us>.
On Fri, Jul 6, 2012 at 10:37 PM, Edison Su <Ed...@citrix.com> wrote:
> Hi All,
>    I created an all-in-one-box CloudStack development environment, name it as DevCloud. It's ready to download from http://download.cloud.com/templates/devcloud/DevCloud.ova and the document is put at http://wiki.cloudstack.org/display/comm/DevCloud.
>    If you are a CloudStack developer whose daily tasks are directly related to hypervisor, or are interested in CloudStack but don't want to setup a CloudStack environment by yourself, welcome to have a try.
>    Comments are welcome!
>    Note: the image is about 1.5G, the downloading may take a while.

First of all - AWESOME - thanks for doing this work.

Second - can you tell us a little about this. You provided an image -
so I assume it will run in a hypervisor without needing to have nested
hardware virt? What kind of hypervisor does the CloudStack instance
use?

If someone wanted to replicate this image themselves, how would one do
it? What did you do to customize the image?

--David

Re: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by John Kinsella <jl...@stratosec.co>.
Awesome! But...why so big?
(will play with it this weekend)



On Jul 6, 2012, at 19:38, "Edison Su" <Ed...@citrix.com> wrote:

> Hi All,
>   I created an all-in-one-box CloudStack development environment, name it as DevCloud. It's ready to download from http://download.cloud.com/templates/devcloud/DevCloud.ova and the document is put at http://wiki.cloudstack.org/display/comm/DevCloud. 
>   If you are a CloudStack developer whose daily tasks are directly related to hypervisor, or are interested in CloudStack but don't want to setup a CloudStack environment by yourself, welcome to have a try. 
>   Comments are welcome!
>   Note: the image is about 1.5G, the downloading may take a while.
> 


Re: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by Edison Su <Ed...@citrix.com>.

Sent from my iPhone

On Jul 7, 2012, at 4:07 PM, "John Kinsella" <jl...@stratosec.co> wrote:

> Got it up and running with virtual box on osx. No luck yet importing it into Parallels, if I figure that out  I'll add a "how to" to the wiki page.
> 
> Some thoughts:
> * Do a little cleanup before packaging the disk image for download - I see things like root's bash history. Not giving away a lot of info, but anything helps a malicious user. Might want to clean out /var/log as well.
Will do, there is a script: devcloudsetup.sh under tools/devcloud/, will setup the whole image, but it's not 100% automated yet.  After automate the image build process, then we will get clean image.
> * Might want to clean up the users/permissions in mysql - user cloud can connect from anywhere without a password, and I see 2 users with no usernames/passwords - not sure how mysqld will treat those, but probably shouldn't be there.

Both root and cloud user don't have password, the reason is to make it simple: when deploying db, don't need to config password. 
> * At login I'm shown there's 26 security updates - might want to apply those to the release.
Ok, will do.
> * At least on mac, accessing the UI works with http://localhost:8080/client, not my machine's IP.
In order to get console proxy work, when rdeploydb, need a routable ip on the -Drhost command line, the ip will be stored in devcloud db. Otherwise, using localhost is enough.
> 
> I can't get past "View all" for any of the items on the Infrastructure page to add zones/etc, not sure if that's just me, won't have time to debug further on that today...
Maybe need to wait for a while or refresh ui... 

Thanks for your test and comments.
> 
> John
> 
> On Jul 6, 2012, at 7:37 PM, Edison Su wrote:
> 
>> Hi All,
>>  I created an all-in-one-box CloudStack development environment, name it as DevCloud. It's ready to download from http://download.cloud.com/templates/devcloud/DevCloud.ova and the document is put at http://wiki.cloudstack.org/display/comm/DevCloud. 
>>  If you are a CloudStack developer whose daily tasks are directly related to hypervisor, or are interested in CloudStack but don't want to setup a CloudStack environment by yourself, welcome to have a try. 
>>  Comments are welcome!
>>  Note: the image is about 1.5G, the downloading may take a while.
>> 
> 
> 

Re: [RFC] DevCloud, an all-in-one-box CloudStack development environment

Posted by John Kinsella <jl...@stratosec.co>.
Got it up and running with virtual box on osx. No luck yet importing it into Parallels, if I figure that out  I'll add a "how to" to the wiki page.

Some thoughts:
* Do a little cleanup before packaging the disk image for download - I see things like root's bash history. Not giving away a lot of info, but anything helps a malicious user. Might want to clean out /var/log as well.
* Might want to clean up the users/permissions in mysql - user cloud can connect from anywhere without a password, and I see 2 users with no usernames/passwords - not sure how mysqld will treat those, but probably shouldn't be there.
* At login I'm shown there's 26 security updates - might want to apply those to the release.
* At least on mac, accessing the UI works with http://localhost:8080/client, not my machine's IP.

I can't get past "View all" for any of the items on the Infrastructure page to add zones/etc, not sure if that's just me, won't have time to debug further on that today...

John

On Jul 6, 2012, at 7:37 PM, Edison Su wrote:

> Hi All,
>   I created an all-in-one-box CloudStack development environment, name it as DevCloud. It's ready to download from http://download.cloud.com/templates/devcloud/DevCloud.ova and the document is put at http://wiki.cloudstack.org/display/comm/DevCloud. 
>   If you are a CloudStack developer whose daily tasks are directly related to hypervisor, or are interested in CloudStack but don't want to setup a CloudStack environment by yourself, welcome to have a try. 
>   Comments are welcome!
>   Note: the image is about 1.5G, the downloading may take a while.
>