You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@cloudstack.apache.org by Geoff Higginbottom <ge...@shapeblue.com> on 2013/06/15 17:45:43 UTC

CloudMonkey Broken

I've been testing CloudMonkey against CloudStack 4.1 and am hitting some problems.

I've previously used CloudMonkey to deploy complete Clouds, but even though I'm using scripts I've used successfully previously, it now appears to be hanging when I try and use the 'create physicalnetwork' command.  The physicalnetwork does get created, it.s just giving any feedback such as ID etc.

Here is an example of the command I am using my full command

> create physicalnetwork name=Management zoneid=9eaff802-4060-4de7-bea9-36cbecce8f95 broadcastdomainrange=Zone isolationmethods=VLAN

Shanker has mentioned he has come across this as well, has anyone else seen this, and if so is there a fix?

Regards

Geoff Higginbottom

D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>

geoff.higginbottom@shapeblue.com<ma...@shapeblue.com>

This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is operated under license from Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: CloudMonkey Broken

Posted by Sebastien Goasguen <ru...@gmail.com>.
Geoff can you file a bug for this ?

I will try to have a look at it on monday.

-Sebastien

On 15 Jun 2013, at 18:35, Geoff Higginbottom <ge...@shapeblue.com> wrote:

> Hi Marcus,
> 
> I have set asyncblock to true as I need to wait for the Physical Network to be created so I can then add a traffic type to it.
> 
> I used to do this by capturing the ID of the Physical Network using the | grep ^id\ = | awk '{print $3}'` section of the 1st command, then use the output in the following add traffictype command (just like on the CloudMonkey wiki example)
> 
> phy1_id=`$cli create physicalnetwork name=$phy1_name zoneid=$zone_id broadcastdomain=Zone | grep ^id\ = | awk '{print $3}'`
> $cli add traffictype traffictype=$phy1_tt physicalnetworkid=$phy1_id
> 
> The problem is CloudMonkey is throwing an error, and not sending back the info correctly.
> 
> My current 'work around' is to set the timeout to 10, accept that the console is going to throw out a load of errors, but ignore them then query the ID of the Physical Network in a 2nd command (using the name of the Physical Network I just created)
> 
> $cli create physicalnetwork name=$phy1_name zoneid=$zone_id broadcastdomain=Zone
> phy1_id=`$cli list physicalnetworks name=$phy1_name | grep ^id\ = | awk '{print $3}'`
> $cli add traffictype traffictype=$phy1_tt physicalnetworkid=$phy1_id
> 
> This seems to work, even when I am creating 4 Physical Networks one after another, but I would rather I did not have to use this workaround, its dirty.
> 
> Regards
> 
> Geoff Higginbottom
> 
> D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
> 
> geoff.higginbottom@shapeblue.com
> 
> -----Original Message-----
> From: Marcus Sorensen [mailto:shadowsor@gmail.com]
> Sent: 15 June 2013 17:04
> To: dev@cloudstack.apache.org
> Subject: Re: CloudMonkey Broken
> 
> Is your asyncblock parameter set to true? This mode isnt supposed to return a job id. Its supposed to block until the job is done, but something is wrong with it.
> On Jun 15, 2013 9:46 AM, "Geoff Higginbottom" < geoff.higginbottom@shapeblue.com> wrote:
> 
>> I've been testing CloudMonkey against CloudStack 4.1 and am hitting
>> some problems.
>> 
>> I've previously used CloudMonkey to deploy complete Clouds, but even
>> though I'm using scripts I've used successfully previously, it now
>> appears to be hanging when I try and use the 'create physicalnetwork'
>> command.  The physicalnetwork does get created, it.s just giving any
>> feedback such as ID etc.
>> 
>> Here is an example of the command I am using my full command
>> 
>>> create physicalnetwork name=Management
>> zoneid=9eaff802-4060-4de7-bea9-36cbecce8f95 broadcastdomainrange=Zone
>> isolationmethods=VLAN
>> 
>> Shanker has mentioned he has come across this as well, has anyone else
>> seen this, and if so is there a fix?
>> 
>> Regards
>> 
>> Geoff Higginbottom
>> 
>> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603 0540<tel:
>> +442036030540> | M: +447968161581<tel:+447968161581>
>> 
>> geoff.higginbottom@shapeblue.com<mailto:geoff.higginbottom@shapeblue.c
>> om>
>> 
>> This email and any attachments to it may be confidential and are
>> intended solely for the use of the individual to whom it is addressed.
>> Any views or opinions expressed are solely those of the author and do
>> not necessarily represent those of Shape Blue Ltd or related
>> companies. If you are not the intended recipient of this email, you
>> must neither take any action based upon its contents, nor copy or show
>> it to anyone. Please contact the sender if you believe you have
>> received this email in error. Shape Blue Ltd is a company incorporated
>> in England & Wales. ShapeBlue Services India LLP is operated under
>> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>> 
> This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is operated under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
> 

RE: CloudMonkey Broken

Posted by Geoff Higginbottom <ge...@shapeblue.com>.
Hi Marcus,

I have set asyncblock to true as I need to wait for the Physical Network to be created so I can then add a traffic type to it.

I used to do this by capturing the ID of the Physical Network using the | grep ^id\ = | awk '{print $3}'` section of the 1st command, then use the output in the following add traffictype command (just like on the CloudMonkey wiki example)

phy1_id=`$cli create physicalnetwork name=$phy1_name zoneid=$zone_id broadcastdomain=Zone | grep ^id\ = | awk '{print $3}'`
$cli add traffictype traffictype=$phy1_tt physicalnetworkid=$phy1_id

The problem is CloudMonkey is throwing an error, and not sending back the info correctly.

My current 'work around' is to set the timeout to 10, accept that the console is going to throw out a load of errors, but ignore them then query the ID of the Physical Network in a 2nd command (using the name of the Physical Network I just created)

$cli create physicalnetwork name=$phy1_name zoneid=$zone_id broadcastdomain=Zone
phy1_id=`$cli list physicalnetworks name=$phy1_name | grep ^id\ = | awk '{print $3}'`
$cli add traffictype traffictype=$phy1_tt physicalnetworkid=$phy1_id

This seems to work, even when I am creating 4 Physical Networks one after another, but I would rather I did not have to use this workaround, its dirty.

Regards

Geoff Higginbottom

D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581

geoff.higginbottom@shapeblue.com

-----Original Message-----
From: Marcus Sorensen [mailto:shadowsor@gmail.com]
Sent: 15 June 2013 17:04
To: dev@cloudstack.apache.org
Subject: Re: CloudMonkey Broken

Is your asyncblock parameter set to true? This mode isnt supposed to return a job id. Its supposed to block until the job is done, but something is wrong with it.
On Jun 15, 2013 9:46 AM, "Geoff Higginbottom" < geoff.higginbottom@shapeblue.com> wrote:

> I've been testing CloudMonkey against CloudStack 4.1 and am hitting
> some problems.
>
> I've previously used CloudMonkey to deploy complete Clouds, but even
> though I'm using scripts I've used successfully previously, it now
> appears to be hanging when I try and use the 'create physicalnetwork'
> command.  The physicalnetwork does get created, it.s just giving any
> feedback such as ID etc.
>
> Here is an example of the command I am using my full command
>
> > create physicalnetwork name=Management
> zoneid=9eaff802-4060-4de7-bea9-36cbecce8f95 broadcastdomainrange=Zone
> isolationmethods=VLAN
>
> Shanker has mentioned he has come across this as well, has anyone else
> seen this, and if so is there a fix?
>
> Regards
>
> Geoff Higginbottom
>
> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603 0540<tel:
> +442036030540> | M: +447968161581<tel:+447968161581>
>
> geoff.higginbottom@shapeblue.com<mailto:geoff.higginbottom@shapeblue.c
> om>
>
> This email and any attachments to it may be confidential and are
> intended solely for the use of the individual to whom it is addressed.
> Any views or opinions expressed are solely those of the author and do
> not necessarily represent those of Shape Blue Ltd or related
> companies. If you are not the intended recipient of this email, you
> must neither take any action based upon its contents, nor copy or show
> it to anyone. Please contact the sender if you believe you have
> received this email in error. Shape Blue Ltd is a company incorporated
> in England & Wales. ShapeBlue Services India LLP is operated under
> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is operated under license from Shape Blue Ltd. ShapeBlue is a registered trademark.


Re: CloudMonkey Broken

Posted by Marcus Sorensen <sh...@gmail.com>.
Is your asyncblock parameter set to true? This mode isnt supposed to return
a job id. Its supposed to block until the job is done, but something is
wrong with it.
On Jun 15, 2013 9:46 AM, "Geoff Higginbottom" <
geoff.higginbottom@shapeblue.com> wrote:

> I've been testing CloudMonkey against CloudStack 4.1 and am hitting some
> problems.
>
> I've previously used CloudMonkey to deploy complete Clouds, but even
> though I'm using scripts I've used successfully previously, it now appears
> to be hanging when I try and use the 'create physicalnetwork' command.  The
> physicalnetwork does get created, it.s just giving any feedback such as ID
> etc.
>
> Here is an example of the command I am using my full command
>
> > create physicalnetwork name=Management
> zoneid=9eaff802-4060-4de7-bea9-36cbecce8f95 broadcastdomainrange=Zone
> isolationmethods=VLAN
>
> Shanker has mentioned he has come across this as well, has anyone else
> seen this, and if so is there a fix?
>
> Regards
>
> Geoff Higginbottom
>
> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603 0540<tel:
> +442036030540> | M: +447968161581<tel:+447968161581>
>
> geoff.higginbottom@shapeblue.com<ma...@shapeblue.com>
>
> This email and any attachments to it may be confidential and are intended
> solely for the use of the individual to whom it is addressed. Any views or
> opinions expressed are solely those of the author and do not necessarily
> represent those of Shape Blue Ltd or related companies. If you are not the
> intended recipient of this email, you must neither take any action based
> upon its contents, nor copy or show it to anyone. Please contact the sender
> if you believe you have received this email in error. Shape Blue Ltd is a
> company incorporated in England & Wales. ShapeBlue Services India LLP is
> operated under license from Shape Blue Ltd. ShapeBlue is a registered
> trademark.
>

Re: CloudMonkey Broken

Posted by Rohit Yadav <bh...@apache.org>.
Geoff,

There was some issue with asyncblock which got introduced on master by this
commit:

commit 6e22843acb6bbd61260849fac171bba61ac6650f
Author: Funs Kessen <fu...@barred.org>
Date:   Fri Apr 5 22:25:34 2013 +0530

    Cloudmonkey requester.py change to return clearer errors and implement
a logic change for async calls.

It was reviewed by me and I failed to check/verify the changes done to the
asyncblock logic at the time due to which it either results in a key error
or goes into an infinite recursive loop.
I've fixed this on master, since the pypi release channel is to be used for
official releases I'll create a new pypi channel called cloudmonkey-latest
and release it in the wild for folks who want the latest and the greatest.

Cheers.


On Sat, Jun 15, 2013 at 9:15 PM, Geoff Higginbottom <
geoff.higginbottom@shapeblue.com> wrote:

> I've been testing CloudMonkey against CloudStack 4.1 and am hitting some
> problems.
>
> I've previously used CloudMonkey to deploy complete Clouds, but even
> though I'm using scripts I've used successfully previously, it now appears
> to be hanging when I try and use the 'create physicalnetwork' command.  The
> physicalnetwork does get created, it.s just giving any feedback such as ID
> etc.
>
> Here is an example of the command I am using my full command
>
> > create physicalnetwork name=Management
> zoneid=9eaff802-4060-4de7-bea9-36cbecce8f95 broadcastdomainrange=Zone
> isolationmethods=VLAN
>
> Shanker has mentioned he has come across this as well, has anyone else
> seen this, and if so is there a fix?
>
> Regards
>
> Geoff Higginbottom
>
> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603 0540<tel:
> +442036030540> | M: +447968161581<tel:+447968161581>
>
> geoff.higginbottom@shapeblue.com<ma...@shapeblue.com>
>
> This email and any attachments to it may be confidential and are intended
> solely for the use of the individual to whom it is addressed. Any views or
> opinions expressed are solely those of the author and do not necessarily
> represent those of Shape Blue Ltd or related companies. If you are not the
> intended recipient of this email, you must neither take any action based
> upon its contents, nor copy or show it to anyone. Please contact the sender
> if you believe you have received this email in error. Shape Blue Ltd is a
> company incorporated in England & Wales. ShapeBlue Services India LLP is
> operated under license from Shape Blue Ltd. ShapeBlue is a registered
> trademark.
>

Re: CloudMonkey Broken

Posted by Rohit Yadav <bh...@apache.org>.
Hi Geoff,

Fixed on 4.1, please upgrade to latest from the official:
https://pypi.python.org/pypi/cloudmonkey, or
https://pypi.python.org/packages/source/c/cloudmonkey/cloudmonkey-4.1.0-1.tar.gz#md5=e838aded51fe822c61b65f83bceed18f

Cheers.

On Sat, Jun 15, 2013 at 9:15 PM, Geoff Higginbottom <
geoff.higginbottom@shapeblue.com> wrote:

> I've been testing CloudMonkey against CloudStack 4.1 and am hitting some
> problems.
>
> I've previously used CloudMonkey to deploy complete Clouds, but even
> though I'm using scripts I've used successfully previously, it now appears
> to be hanging when I try and use the 'create physicalnetwork' command.  The
> physicalnetwork does get created, it.s just giving any feedback such as ID
> etc.
>
> Here is an example of the command I am using my full command
>
> > create physicalnetwork name=Management
> zoneid=9eaff802-4060-4de7-bea9-36cbecce8f95 broadcastdomainrange=Zone
> isolationmethods=VLAN
>
> Shanker has mentioned he has come across this as well, has anyone else
> seen this, and if so is there a fix?
>
> Regards
>
> Geoff Higginbottom
>
> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603 0540<tel:
> +442036030540> | M: +447968161581<tel:+447968161581>
>
> geoff.higginbottom@shapeblue.com<ma...@shapeblue.com>
>
> This email and any attachments to it may be confidential and are intended
> solely for the use of the individual to whom it is addressed. Any views or
> opinions expressed are solely those of the author and do not necessarily
> represent those of Shape Blue Ltd or related companies. If you are not the
> intended recipient of this email, you must neither take any action based
> upon its contents, nor copy or show it to anyone. Please contact the sender
> if you believe you have received this email in error. Shape Blue Ltd is a
> company incorporated in England & Wales. ShapeBlue Services India LLP is
> operated under license from Shape Blue Ltd. ShapeBlue is a registered
> trademark.
>