You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@cloudstack.apache.org by Rohit Yadav <ro...@shapeblue.com> on 2015/03/20 10:57:57 UTC

[DISCUSS] Automating SystemVM template creation for VMWare

Hi,

The systemvm template build system does not do all the steps for
producing a valid systemvm template for VMWare, from wiki and past
discussions I know that some extra steps are needed but I'm not sure.

This wikis notes some of those steps:

https://cwiki.apache.org/confluence/display/CLOUDSTACK/Creating+System+VM+template+for+Vmware+from+generated+Vbox+template

Can anyone confirm this issue? And, update the wiki if more steps are
needed?

Also can we automate those additional steps using Jenkins? Or perhaps
semi-automate the creation process by writing scripts that do these
extra steps for us?

Regards,
Rohit Yadav
Software Architect, ShapeBlue
M. +91 8826230892 | rohit.yadav@shapeblue.com
Blog: bhaisaab.org | Twitter: @_bhaisaab
PS. If you see any footer below, I did not add it :)
Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>

This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: [DISCUSS] Automating SystemVM template creation for VMWare

Posted by ilya <il...@gmail.com>.
++Lucian, i know i mentioned i can help with rolling vmware ovf 
templates but did not get to - here are the instructions..

Rohit,

We roll vmware templates continuously via jenkins without the need of 
vagrant. Only using virt-install with KVM and ovftool from vmware.

You dont have to use virt-install, if img file is created and vmware 
tools are installed, here is what i did to make it vmware ova image.

On high level,
1) create dummy VMX file - via stage_vmx function
2) convert raw/img file to vdml via qemu-img
3) inject content into vmx file
3) use ovftool from vmware to roll ova image

### stage_vmx
function stage_vmx (){
cat << VMXFILE > "$3/$1.vmx"
.encoding = "UTF-8"
config.version = "8"
virtualHW.version = "9"
pciBridge0.present = "true"
pciBridge4.present = "true"
pciBridge4.virtualDev = "pcieRootPort"
pciBridge4.functions = "8"
pciBridge5.present = "true"
pciBridge5.virtualDev = "pcieRootPort"
pciBridge5.functions = "8"
pciBridge6.present = "true"
pciBridge6.virtualDev = "pcieRootPort"
pciBridge6.functions = "8"
pciBridge7.present = "true"
pciBridge7.virtualDev = "pcieRootPort"
pciBridge7.functions = "8"
vmci0.present = "true"
hpet0.present = "true"
nvram = "$1.nvram"
virtualHW.productCompatibility = "hosted"
powerType.powerOff = "soft"
powerType.powerOn = "hard"
powerType.suspend = "hard"
powerType.reset = "soft"
displayName = "$1"
extendedConfigFile = "$1.vmxf"
scsi0.present = "true"
scsi0.sharedBus = "none"
scsi0.virtualDev = "lsilogic"
memsize = "1024"
svga.autodetect = "true"
guestOS = "other-64"
sched.cpu.min = "0"
sched.cpu.units = "mhz"
sched.mem.min = "0"
sched.mem.max = "1024"
scsi0:1.present = "true"
scsi0:1.fileName = "$2"
scsi0:1.deviceType = "scsi-hardDisk"
ide0:0.present = "true"
ide0:0.clientDevice = "true"
ide0:0.deviceType = "cdrom-raw"
ide0:0.allowGuestConnectionControl = "false"
ethernet0.present = "true"
ethernet0.virtualDev = "e1000"
ethernet0.wakeOnPcktRcv = "false"
ethernet0.networkName = "vSwitch0"
ethernet0.addressType = "static"
ethernet0.address = "06:e6:20:00:00:1a"
machine.id = ""
devices.hotplug = "true"
nicAdapter = "E1000"
keyboard.typematicMindelay = "2000000"
floppy0.present = "FALSE"
scsi0.pciSlotNumber = "16"
ethernet0.pciSlotNumber = "32"
vmci0.id = "1572826102"
vmci0.pciSlotNumber = "33"
tools.syncTime = "FALSE"
uuid.location = "56 4d ab 75 73 c1 95 3d-f4 af c4 ce 75 fb ac 37"
cleanShutdown = "FALSE"
replay.supported = "FALSE"
sched.swap.derivedName = "$1.vswp"
pciBridge0.pciSlotNumber = "17"
pciBridge4.pciSlotNumber = "21"
pciBridge5.pciSlotNumber = "22"
pciBridge6.pciSlotNumber = "23"
pciBridge7.pciSlotNumber = "24"
softPowerOff = "FALSE"
VMXFILE
}

#convert to vmdk
qemu-img convert -f raw -O vmdk $myvmimage $myvmimagevmdk && echo "NOTE: 
The VMDK image for $myvmname is $myvmimagevmdk" || echo "ERROR: qemu-img 
conversion from img to vmdk failed!"

# create vmx staging file
stage_vmx $VMNAME $VMDK-FILE  $DIR-OF-VMDK

#create ova with vmx and vmdk, ovftool binary must be available
OVFTOOL=$(which ovftool)
$OVFTOOL $NAME.vmx $NAME.ova

Regards
ilya


On 3/20/15 2:57 AM, Rohit Yadav wrote:
> Hi,
>
> The systemvm template build system does not do all the steps for
> producing a valid systemvm template for VMWare, from wiki and past
> discussions I know that some extra steps are needed but I'm not sure.
>
> This wikis notes some of those steps:
>
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Creating+System+VM+template+for+Vmware+from+generated+Vbox+template 
>
>
> Can anyone confirm this issue? And, update the wiki if more steps are
> needed?
>
> Also can we automate those additional steps using Jenkins? Or perhaps
> semi-automate the creation process by writing scripts that do these
> extra steps for us?
>
> Regards,
> Rohit Yadav
> Software Architect, ShapeBlue
> M. +91 8826230892 | rohit.yadav@shapeblue.com
> Blog: bhaisaab.org | Twitter: @_bhaisaab
> PS. If you see any footer below, I did not add it :)
> Find out more about ShapeBlue and our range of CloudStack related 
> services
>
> IaaS Cloud Design & 
> Build<http://shapeblue.com/iaas-cloud-design-and-build//>
> CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> CloudStack Software 
> Engineering<http://shapeblue.com/cloudstack-software-engineering/>
> CloudStack Infrastructure 
> Support<http://shapeblue.com/cloudstack-infrastructure-support/>
> CloudStack Bootcamp Training 
> Courses<http://shapeblue.com/cloudstack-training/>
>
> This email and any attachments to it may be confidential and are 
> intended solely for the use of the individual to whom it is addressed. 
> Any views or opinions expressed are solely those of the author and do 
> not necessarily represent those of Shape Blue Ltd or related 
> companies. If you are not the intended recipient of this email, you 
> must neither take any action based upon its contents, nor copy or show 
> it to anyone. Please contact the sender if you believe you have 
> received this email in error. Shape Blue Ltd is a company incorporated 
> in England & Wales. ShapeBlue Services India LLP is a company 
> incorporated in India and is operated under license from Shape Blue 
> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in 
> Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA 
> Pty Ltd is a company registered by The Republic of South Africa and is 
> traded under license from Shape Blue Ltd. ShapeBlue is a registered 
> trademark.


Re: [DISCUSS] Automating SystemVM template creation for VMWare

Posted by Rohit Yadav <ro...@shapeblue.com>.
Hi Daan,

The Jenkins job do produce ova images, the issue is that an additional cdrom device is added and some secret sauce needs to be injected in the template to make it work on vmware. I’m not sure what that is, perhaps a VMWare guru can comment. I’ll try to explore more next week and fix the automation as much as I can.

> On 20-Mar-2015, at 8:25 pm, Daan Hoogland <da...@gmail.com> wrote:
>
> Rohit, why don't you look into the systemvm jobs. These should produce
> vmware images as well. If not, we have some jobs that do work on our
> internal jenkins. Those we use for a vmware zone so these must work
> correctly.
>
> On Fri, Mar 20, 2015 at 10:57 AM, Rohit Yadav <ro...@shapeblue.com> wrote:
>> Hi,
>>
>> The systemvm template build system does not do all the steps for
>> producing a valid systemvm template for VMWare, from wiki and past
>> discussions I know that some extra steps are needed but I'm not sure.
>>
>> This wikis notes some of those steps:
>>
>> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Creating+System+VM+template+for+Vmware+from+generated+Vbox+template
>>
>> Can anyone confirm this issue? And, update the wiki if more steps are
>> needed?
>>
>> Also can we automate those additional steps using Jenkins? Or perhaps
>> semi-automate the creation process by writing scripts that do these
>> extra steps for us?
>>
>> Regards,
>> Rohit Yadav
>> Software Architect, ShapeBlue
>> M. +91 8826230892 | rohit.yadav@shapeblue.com
>> Blog: bhaisaab.org | Twitter: @_bhaisaab
>> PS. If you see any footer below, I did not add it :)
>> Find out more about ShapeBlue and our range of CloudStack related services
>>
>> IaaS Cloud Design &
>> Build<http://shapeblue.com/iaas-cloud-design-and-build//>
>> CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>> CloudStack Software
>> Engineering<http://shapeblue.com/cloudstack-software-engineering/>
>> CloudStack Infrastructure
>> Support<http://shapeblue.com/cloudstack-infrastructure-support/>
>> CloudStack Bootcamp Training
>> Courses<http://shapeblue.com/cloudstack-training/>
>>
>> This email and any attachments to it may be confidential and are intended
>> solely for the use of the individual to whom it is addressed. Any views or
>> opinions expressed are solely those of the author and do not necessarily
>> represent those of Shape Blue Ltd or related companies. If you are not the
>> intended recipient of this email, you must neither take any action based
>> upon its contents, nor copy or show it to anyone. Please contact the sender
>> if you believe you have received this email in error. Shape Blue Ltd is a
>> company incorporated in England & Wales. ShapeBlue Services India LLP is a
>> company incorporated in India and is operated under license from Shape Blue
>> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil
>> and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a
>> company registered by The Republic of South Africa and is traded under
>> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>
>
>
> --
> Daan

Regards,
Rohit Yadav
Software Architect, ShapeBlue
M. +91 88 262 30892 | rohit.yadav@shapeblue.com
Blog: bhaisaab.org | Twitter: @_bhaisaab



Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>

This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: [DISCUSS] Automating SystemVM template creation for VMWare

Posted by Daan Hoogland <da...@gmail.com>.
Rohit, why don't you look into the systemvm jobs. These should produce
vmware images as well. If not, we have some jobs that do work on our
internal jenkins. Those we use for a vmware zone so these must work
correctly.

On Fri, Mar 20, 2015 at 10:57 AM, Rohit Yadav <ro...@shapeblue.com> wrote:
> Hi,
>
> The systemvm template build system does not do all the steps for
> producing a valid systemvm template for VMWare, from wiki and past
> discussions I know that some extra steps are needed but I'm not sure.
>
> This wikis notes some of those steps:
>
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Creating+System+VM+template+for+Vmware+from+generated+Vbox+template
>
> Can anyone confirm this issue? And, update the wiki if more steps are
> needed?
>
> Also can we automate those additional steps using Jenkins? Or perhaps
> semi-automate the creation process by writing scripts that do these
> extra steps for us?
>
> Regards,
> Rohit Yadav
> Software Architect, ShapeBlue
> M. +91 8826230892 | rohit.yadav@shapeblue.com
> Blog: bhaisaab.org | Twitter: @_bhaisaab
> PS. If you see any footer below, I did not add it :)
> Find out more about ShapeBlue and our range of CloudStack related services
>
> IaaS Cloud Design &
> Build<http://shapeblue.com/iaas-cloud-design-and-build//>
> CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> CloudStack Software
> Engineering<http://shapeblue.com/cloudstack-software-engineering/>
> CloudStack Infrastructure
> Support<http://shapeblue.com/cloudstack-infrastructure-support/>
> CloudStack Bootcamp Training
> Courses<http://shapeblue.com/cloudstack-training/>
>
> This email and any attachments to it may be confidential and are intended
> solely for the use of the individual to whom it is addressed. Any views or
> opinions expressed are solely those of the author and do not necessarily
> represent those of Shape Blue Ltd or related companies. If you are not the
> intended recipient of this email, you must neither take any action based
> upon its contents, nor copy or show it to anyone. Please contact the sender
> if you believe you have received this email in error. Shape Blue Ltd is a
> company incorporated in England & Wales. ShapeBlue Services India LLP is a
> company incorporated in India and is operated under license from Shape Blue
> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil
> and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a
> company registered by The Republic of South Africa and is traded under
> license from Shape Blue Ltd. ShapeBlue is a registered trademark.



-- 
Daan