[ACS 42] BVTs - KVM Advanced and Basiz Zone Automnated test results

[Sudha Ponnaganti <su...@citrix.com>]

Hi,

We are at a stage that BVTs are passing at high %age and below are the test results. I have posted results early on but we were at a very low %ages and did not post it even though we are running them on weekly basis on 4.2 code base. But here are the results as these are a little easy to comprehend and showing improved quality status from where we have started. However regression runs are still showing lower pass rates. Once reached to a decent level, will start posting them to community. Thanks to all those who have helped us to get here.

KVM Advanced Stage - almost 99% ( once we fix test case issues, will be reaching 100%)
KVM Basic Zone - 95% ( same here TC issues)
Defects are being tracked closely to get to 100% this week.

KVM Advanced zone:
Test cases                           Total TC's             Failed TC's           Comments
test_vm_life_cycle         10           0
test_affinity_groups      1              0
test_guest_vlan_range 1              0
test_service_offerings  4              0
test_network    7              0
test_loadbalance             3              0
deploy_vms_with_varied_deploymentplanners               3              0
test_iso                6              0
test_internal_lb               3              0
test_secondary_storage              2              0
test_volumes    9              2              i)  https://issues.apache.org/jira/browse/CLOUDSTACK-2725
(Need to fix in test  case)
test_global_settings       1              0
test_deploy_vm_with_userdata              2              0
test_nic                1              0
test_templates 8              0
test_non_contigiousvlan              0              0
test_network_acl            1              0
test_portable_publicip  2              0
test_public_ip_range     1              0
test_pvlan          1              0
test_primary_storage    2              0
test_privategw_acl         1              0
test_regions      1              0
test_resource_detail     1              0
test_routers      9              0
test_disk_offerings        3              0
test_ssvm           10           0
deploy_vm         1              0
                                94           2
Pass rate              97.87%

KVM Basic Zone:
Test cases           Total TC's             Failed TC's           Comments
test_vm_life_cycle         9              0
test_affinity_groups      1              0
test_service_offerings  3              0
deploy_vms_with_varied_deploymentplanners               3              0
test_iso                6              0
test_secondary_storage              2              0
test_volumes    9              2              i)  https://issues.apache.org/jira/browse/CLOUDSTACK-2725 (Need to fix in test  case)
test_global_settings       1              0
test_deploy_vm_with_userdata              2              0
test_nic                1              0
test_templates 7              0
test_portable_publicip  2              1              https://issues.apache.org/jira/browse/CLOUDSTACK-3454 (test cases issue)

test_primary_storage    2              0
test_regions      1              0
test_routers      1              0
test_disk_offerings        3              0
deploy_vm         1              0
test_ssvm           10           0
                64           3
Pass rate              95.31

Thanks
/sudha