You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@cloudstack.apache.org by Raja Pullela <ra...@citrix.com> on 2015/12/08 13:23:03 UTC

BVT report for the week of 12/7

Here are the BVT results based on the latest master, going forward please expect to see an email on the BVTs beginning of every week:
- XS Basic - 97.3% (4.6 RC passrate 96.9%)
- XS Adv - 92.7% (4.6 RC passrate 93.4%)
- KVM Basic - 98.6% (4.6 RC passrate - 98.6%)
- KVM Adv - 96.4% (4.6 RC passrate - 96.3%)

Following are failing on both XS Adv and KVM Adv setups and possible product defects
* <nose.suite.ContextSuite context=TestVMLifeCycle>:setup  //Issue: Failed to create firewall rule
* <nose.suite.ContextSuite context=TestCreateVolume>:setup  //Issue: Failed to apply port forwarding rule
* integration.smoke.test_privategw_acl.TestPrivateGwACL.test_02_vpc_privategw_static_routes //Issue: Ping to outside world from VM should be successful
* integration.smoke.test_privategw_acl.TestPrivateGwACL.test_03_rvpc_privategw_static_routes //Issue: Ping to outside world from VM should be successful

Failed Test cases -  
XS Basic - 
- integration.smoke.test_vm_snapshots.TestSnapshots.test_01_test_vm_volume_snapshot  // testcase issue
- integration.smoke.test_iso.TestISO.test_07_list_default_iso  //known testcase issue
KVM Basic -
* integration.smoke.test_iso.TestCreateIso.test_01_create_iso  //Timeout waiting for response from storage host
* integration.smoke.test_iso.TestISO.test_07_list_default_iso  //known testcase issue
XS Adv - 
* integration.smoke.test_quota.TestQuota.test_01_quota //New tests added, test setup issue
* integration.smoke.test_quota.TestQuota.test_02_quota //New tests added, test setup issue
* integration.smoke.test_quota.TestQuota.test_03_quota //New tests added, test setup issue
* integration.smoke.test_quota.TestQuota.test_04_quota //New tests added, test setup issue
* integration.smoke.test_quota.TestQuota.test_05_quota //New tests added, test setup issue
* integration.smoke.test_quota.TestQuota.test_06_quota //New tests added, test setup issue
* integration.smoke.test_quota.TestQuota.test_07_quota //New tests added, test setup issue
* <nose.suite.ContextSuite context=TestVMLifeCycle>:setup  //Issue: Failed to create firewall rule
* <nose.suite.ContextSuite context=TestCreateVolume>:setup  //Issue: Failed to apply port forwarding rule
* integration.smoke.test_privategw_acl.TestPrivateGwACL.test_02_vpc_privategw_static_routes //Issue: Ping to outside world from VM should be successful
* integration.smoke.test_privategw_acl.TestPrivateGwACL.test_03_rvpc_privategw_static_routes //Issue: Ping to outside world from VM should be successful
* integration.smoke.test_vpc_vpn.TestVpcRemoteAccessVpn.test_vpc_remote_access_vpn
* integration.smoke.test_vpc_vpn.TestVpcSite2SiteVpn.test_vpc_site2site_vpn //testcase issue
* integration.smoke.test_internal_lb.TestInternalLb.test02_internallb_haproxy_stats_on_all_interfaces  //testcase issue
* integration.smoke.test_internal_lb.TestInternalLb.test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80  // testcase issue
* integration.smoke.test_vm_snapshots.TestSnapshots.test_01_test_vm_volume_snapshot  // testcase issue
* integration.smoke.test_iso.TestISO.test_07_list_default_iso  // known testcase issue
KVM Adv- 
* integration.smoke.test_quota.TestQuota.test_01_quota //New tests added, test setup issue
* integration.smoke.test_quota.TestQuota.test_02_quota //New tests added, test setup issue
* integration.smoke.test_quota.TestQuota.test_03_quota  //New tests added, test setup issue
* integration.smoke.test_quota.TestQuota.test_04_quota  //New tests added, test setup issue
* integration.smoke.test_quota.TestQuota.test_05_quota  //New tests added, test setup issue
* integration.smoke.test_quota.TestQuota.test_06_quota  //New tests added, test setup issue
* integration.smoke.test_quota.TestQuota.test_07_quota  //New tests added, test setup issue
* <nose.suite.ContextSuite context=TestVpcSite2SiteVpn>:setup  //Testcase issue
* integration.smoke.test_privategw_acl.TestPrivateGwACL.test_02_vpc_privategw_static_routes  //Issue: Ping to outside world from VM should be successful
* integration.smoke.test_privategw_acl.TestPrivateGwACL.test_03_rvpc_privategw_static_routes  //Issue: Ping to outside world from VM should be successful
* integration.smoke.test_iso.TestISO.test_07_list_default_iso //known testcase issue

--------------------------------------end---------------------