You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@cloudstack.apache.org by Prasanna Santhanam <ts...@apache.org> on 2013/06/15 15:32:25 UTC

Test Result for test-smoke-matrix #469

Test Run: #469
--------
Total:96
Fail :17
Skip :2
--------

name                                               pass    fail    skip
test_portable_publicip/                               0       2       0
test_ssvm/                                            6       4       0
test_templates/                                       7       0       1
test_deploy_vm_with_userdata/                         2       0       0
test_guest_vlan_range/                                1       0       0
test_internal_lb/                                     1       0       0
test_scale_vm/                                        0       1       0
test_iso/                                             4       1       1
test_vm_snapshots/                                    0       3       0
test_disk_offerings/                                  3       0       0
test_non_contigiousvlan/                              1       0       0
test_network/                                         7       3       0
test_volumes/                                         9       0       0
test_regions/                                         1       0       0
test_secondary_storage/                               1       1       0
test_network_acl/                                     1       0       0
test_global_settings/                                 1       0       0
test_nic/                                             1       0       0
test_vm_life_cycle/                                   9       1       0
test_pvlan/                                           1       0       0
test_service_offerings/                               4       0       0
test_deploy_vms_with_varied_deploymentplanners/       2       1       0
test_routers/                                        10       0       0
test_deploy_vm/                                       1       0       0
test_privategw_acl/                                   1       0       0
test_public_ip_range/                                 1       0       0
test_resource_detail/                                 1       0       0
test_affinity_groups/                                 1       0       0
--------


Regressions
--------
name                                                                                    duration    age
integration.smoke.test_secondary_storage.TestSecStorageServices.test_01_sys_vm_start       0.184      1

Failures
--------
name                                                                                                                            duration    age
integration.smoke.test_portable_publicip.TestPortablePublicIPAcquire.test_createPortablePublicIPAcquire                            0.001    159
integration.smoke.test_portable_publicip.TestPortablePublicIPRange.test_createPortablePublicIPRange                                0.001    159
integration.smoke.test_ssvm.TestSSVMs.test_03_ssvm_internals                                                                       3.089    293
integration.smoke.test_ssvm.TestSSVMs.test_05_stop_ssvm                                                                           77.836    293
integration.smoke.test_ssvm.TestSSVMs.test_07_reboot_ssvm                                                                         82.731    293
integration.smoke.test_ssvm.TestSSVMs.test_09_destroy_ssvm                                                                       200.867    293
integration.smoke.test_scale_vm.TestScaleVm.test_01_scale_vm                                                                       0.115    206
integration.smoke.test_iso.TestISO.test_04_extract_Iso                                                                             5.169      1
integration.smoke.test_vm_snapshots.TestVmSnapshot.test_01_create_vm_snapshots                                                  1654.1        4
integration.smoke.test_vm_snapshots.TestVmSnapshot.test_02_revert_vm_snapshots                                                  1653.77       4
integration.smoke.test_vm_snapshots.TestVmSnapshot.test_03_delete_vm_snapshots                                                     0.061      4
integration.smoke.test_network.TestLoadBalancingRule.test_02_create_lb_rule_non_nat                                               15.401     12
integration.smoke.test_network.TestPortForwarding.test_02_port_fwd_on_non_src_nat                                                 20.419     27
integration.smoke.test_network.TestRebootRouter.test_reboot_router                                                               267.101    137
integration.smoke.test_vm_life_cycle.TestVMLifeCycle.test_09_expunge_vm                                                            5.11      27
integration.smoke.test_deploy_vms_with_varied_deploymentplanners.TestDeployVmWithVariedPlanners.test_deployvm_userdispersing     116.184     55

Fixed
--------
name                                                                                   duration    age
integration.smoke.test_network.TestAssignRemoveLB.test_assign_and_removal_lb            724.347      0
integration.smoke.test_network.TestLoadBalancingRule.test_01_create_lb_rule_src_nat     158.561      0
integration.smoke.test_volumes.TestCreateVolume.test_01_create_volume                   235.804      0
integration.smoke.test_volumes.TestVolumes.test_02_attach_volume                         10.638      0
integration.smoke.test_vm_life_cycle.TestVMLifeCycle.test_10_attachAndDetach_iso         71.477      0

detailed report @
http://jenkins.buildacloud.org/view/cloudstack-qa/job/test-smoke-matrix/469/testReport/

Thanks,

-- 
Prasanna.,

------------------------
Powered by BigRock.com


RE: Test Result for test-smoke-matrix #469

Posted by Sudha Ponnaganti <su...@citrix.com>.
Thanks Prasanna,

This would help to check daily if we are making progress or not on getting the failed TC fixed. 
Requesting community to see the failed TCs and help to fix product issues. Automation tag has been used for defects logged for the failures. 

As suggested in IRC Meeting, we can stop check-ins in to master, till we get  to 100% and once we have baseline,  it would be easy to track failures introduced with each check in. 

Thanks
/sudha



-----Original Message-----
From: Prasanna Santhanam [mailto:tsp@apache.org] 
Sent: Saturday, June 15, 2013 6:32 AM
To: CloudStack Dev
Subject: Test Result for test-smoke-matrix #469

Test Run: #469
--------
Total:96
Fail :17
Skip :2
--------

name                                               pass    fail    skip
test_portable_publicip/                               0       2       0
test_ssvm/                                            6       4       0
test_templates/                                       7       0       1
test_deploy_vm_with_userdata/                         2       0       0
test_guest_vlan_range/                                1       0       0
test_internal_lb/                                     1       0       0
test_scale_vm/                                        0       1       0
test_iso/                                             4       1       1
test_vm_snapshots/                                    0       3       0
test_disk_offerings/                                  3       0       0
test_non_contigiousvlan/                              1       0       0
test_network/                                         7       3       0
test_volumes/                                         9       0       0
test_regions/                                         1       0       0
test_secondary_storage/                               1       1       0
test_network_acl/                                     1       0       0
test_global_settings/                                 1       0       0
test_nic/                                             1       0       0
test_vm_life_cycle/                                   9       1       0
test_pvlan/                                           1       0       0
test_service_offerings/                               4       0       0
test_deploy_vms_with_varied_deploymentplanners/       2       1       0
test_routers/                                        10       0       0
test_deploy_vm/                                       1       0       0
test_privategw_acl/                                   1       0       0
test_public_ip_range/                                 1       0       0
test_resource_detail/                                 1       0       0
test_affinity_groups/                                 1       0       0
--------


Regressions
--------
name                                                                                    duration    age
integration.smoke.test_secondary_storage.TestSecStorageServices.test_01_sys_vm_start       0.184      1

Failures
--------
name                                                                                                                            duration    age
integration.smoke.test_portable_publicip.TestPortablePublicIPAcquire.test_createPortablePublicIPAcquire                            0.001    159
integration.smoke.test_portable_publicip.TestPortablePublicIPRange.test_createPortablePublicIPRange                                0.001    159
integration.smoke.test_ssvm.TestSSVMs.test_03_ssvm_internals                                                                       3.089    293
integration.smoke.test_ssvm.TestSSVMs.test_05_stop_ssvm                                                                           77.836    293
integration.smoke.test_ssvm.TestSSVMs.test_07_reboot_ssvm                                                                         82.731    293
integration.smoke.test_ssvm.TestSSVMs.test_09_destroy_ssvm                                                                       200.867    293
integration.smoke.test_scale_vm.TestScaleVm.test_01_scale_vm                                                                       0.115    206
integration.smoke.test_iso.TestISO.test_04_extract_Iso                                                                             5.169      1
integration.smoke.test_vm_snapshots.TestVmSnapshot.test_01_create_vm_snapshots                                                  1654.1        4
integration.smoke.test_vm_snapshots.TestVmSnapshot.test_02_revert_vm_snapshots                                                  1653.77       4
integration.smoke.test_vm_snapshots.TestVmSnapshot.test_03_delete_vm_snapshots                                                     0.061      4
integration.smoke.test_network.TestLoadBalancingRule.test_02_create_lb_rule_non_nat                                               15.401     12
integration.smoke.test_network.TestPortForwarding.test_02_port_fwd_on_non_src_nat                                                 20.419     27
integration.smoke.test_network.TestRebootRouter.test_reboot_router                                                               267.101    137
integration.smoke.test_vm_life_cycle.TestVMLifeCycle.test_09_expunge_vm                                                            5.11      27
integration.smoke.test_deploy_vms_with_varied_deploymentplanners.TestDeployVmWithVariedPlanners.test_deployvm_userdispersing     116.184     55

Fixed
--------
name                                                                                   duration    age
integration.smoke.test_network.TestAssignRemoveLB.test_assign_and_removal_lb            724.347      0
integration.smoke.test_network.TestLoadBalancingRule.test_01_create_lb_rule_src_nat     158.561      0
integration.smoke.test_volumes.TestCreateVolume.test_01_create_volume                   235.804      0
integration.smoke.test_volumes.TestVolumes.test_02_attach_volume                         10.638      0
integration.smoke.test_vm_life_cycle.TestVMLifeCycle.test_10_attachAndDetach_iso         71.477      0

detailed report @
http://jenkins.buildacloud.org/view/cloudstack-qa/job/test-smoke-matrix/469/testReport/

Thanks,

-- 
Prasanna.,

------------------------
Powered by BigRock.com


Re: Test Result for test-smoke-matrix #469

Posted by Chip Childers <ch...@sungard.com>.
On Sat, Jun 15, 2013 at 07:06:04PM +0530, Prasanna Santhanam wrote:
> This is the sample output for the detail requested by Sudha to
> automated tests running on jenkins. The email is automated, but
> generated on my laptop and I choose to send it.
> 
> If there's further fields to be tweaked, feel free to
> contribute/request them @ https://github.com/vogxn/jenkins2email

This is great!

> 
> On Sat, Jun 15, 2013 at 07:02:25PM +0530, Prasanna Santhanam wrote:
> > 
> > detailed report @
> > http://jenkins.buildacloud.org/view/cloudstack-qa/job/test-smoke-matrix/469/testReport/
> > 
> > Thanks,
> > 
> -- 
> Prasanna.,
> 
> ------------------------
> Powered by BigRock.com
> 
> 

Re: Test Result for test-smoke-matrix #469

Posted by Prasanna Santhanam <ts...@apache.org>.
This is the sample output for the detail requested by Sudha to
automated tests running on jenkins. The email is automated, but
generated on my laptop and I choose to send it.

If there's further fields to be tweaked, feel free to
contribute/request them @ https://github.com/vogxn/jenkins2email

On Sat, Jun 15, 2013 at 07:02:25PM +0530, Prasanna Santhanam wrote:
> 
> detailed report @
> http://jenkins.buildacloud.org/view/cloudstack-qa/job/test-smoke-matrix/469/testReport/
> 
> Thanks,
> 
-- 
Prasanna.,

------------------------
Powered by BigRock.com