You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@cloudstack.apache.org by Raja Pullela <ra...@citrix.com> on 2015/10/13 21:16:56 UTC
BVT Report 10/14
BVT Report - 10/14; No change from earlier report - 10/5
- Simulator Basic - 100%
- Simulator Adv - 100%
- XS Basic - 98.6%, 1 failure
- XS Adv - 95.5%, 5 failures
- KVM Basic - 94.2%, 4 failures
- KVM Adv - 92.6%, 8 failures
Working with Kishan, Rajani on failures related to test_ssvm/reboot_ssvm/cpvm (2 tests) and test_loadbalance failures (3 tests).
Hope to see KVM and XS - Adv passrates to improve in the next day or two?
best,
Raja
Tests failed
XS Basic - 1 failure
- integration.smoke.test_volumes.TestVolumes.test_02_attach_volume
XS Adv - 5 failures
- <nose.suite.ContextSuite context=TestNiciraContoller>:setup
- integration.smoke.test_loadbalance.TestLoadBalance.test_01_create_lb_rule_src_nat
- integration.smoke.test_loadbalance.TestLoadBalance.test_02_create_lb_rule_non_nat
- integration.smoke.test_loadbalance.TestLoadBalance.test_assign_and_removal_lb
- integration.smoke.test_internal_lb.TestInternalLb.test_internallb
KVM Basic - 4 Failures
- integration.smoke.test_vm_life_cycle.TestVMLifeCycle.test_10_attachAndDetach_iso
- integration.smoke.test_volumes.TestVolumes.test_02_attach_volume
- integration.smoke.test_ssvm.TestSSVMs.test_07_reboot_ssvm
- integration.smoke.test_ssvm.TestSSVMs.test_08_reboot_cpvm
KVM Advanced - 8 Failures
- integration.smoke.test_loadbalance.TestLoadBalance.test_01_create_lb_rule_src_nat
- integration.smoke.test_loadbalance.TestLoadBalance.test_02_create_lb_rule_non_nat
- integration.smoke.test_loadbalance.TestLoadBalance.test_assign_and_removal_lb
- <nose.suite.ContextSuite context=TestNiciraContoller>:setup
- integration.smoke.test_snapshots.TestSnapshotRootDisk.test_01_snapshot_root_disk
- integration.smoke.test_ssvm.TestSSVMs.test_07_reboot_ssvm
- integration.smoke.test_ssvm.TestSSVMs.test_08_reboot_cpvm
- integration.smoke.test_internal_lb.TestInternalLb.test_internallb
Re: BVT Report 10/14
Posted by Remi Bergsma <RB...@schubergphilis.com>.
Hi Raja,
Would it be possible to share the output of another run, preferably from current master? I merged some PRs last night that fix blockers.
I'm sure there are issues left, but the list in Jira is almost done. Is everything in there?
Thanks; Remi
Sent from my iPhone
> On 13 Oct 2015, at 21:17, Raja Pullela <ra...@citrix.com> wrote:
>
> BVT Report - 10/14; No change from earlier report - 10/5
>
> - Simulator Basic - 100%
>
> - Simulator Adv - 100%
>
> - XS Basic - 98.6%, 1 failure
>
> - XS Adv - 95.5%, 5 failures
>
> - KVM Basic - 94.2%, 4 failures
>
> - KVM Adv - 92.6%, 8 failures
>
> Working with Kishan, Rajani on failures related to test_ssvm/reboot_ssvm/cpvm (2 tests) and test_loadbalance failures (3 tests).
> Hope to see KVM and XS - Adv passrates to improve in the next day or two?
>
> best,
> Raja
>
>
> Tests failed
>
> XS Basic - 1 failure
>
> - integration.smoke.test_volumes.TestVolumes.test_02_attach_volume
>
> XS Adv - 5 failures
>
> - <nose.suite.ContextSuite context=TestNiciraContoller>:setup
>
> - integration.smoke.test_loadbalance.TestLoadBalance.test_01_create_lb_rule_src_nat
>
> - integration.smoke.test_loadbalance.TestLoadBalance.test_02_create_lb_rule_non_nat
>
> - integration.smoke.test_loadbalance.TestLoadBalance.test_assign_and_removal_lb
>
> - integration.smoke.test_internal_lb.TestInternalLb.test_internallb
>
> KVM Basic - 4 Failures
>
> - integration.smoke.test_vm_life_cycle.TestVMLifeCycle.test_10_attachAndDetach_iso
>
> - integration.smoke.test_volumes.TestVolumes.test_02_attach_volume
>
> - integration.smoke.test_ssvm.TestSSVMs.test_07_reboot_ssvm
>
> - integration.smoke.test_ssvm.TestSSVMs.test_08_reboot_cpvm
>
> KVM Advanced - 8 Failures
>
> - integration.smoke.test_loadbalance.TestLoadBalance.test_01_create_lb_rule_src_nat
>
> - integration.smoke.test_loadbalance.TestLoadBalance.test_02_create_lb_rule_non_nat
>
> - integration.smoke.test_loadbalance.TestLoadBalance.test_assign_and_removal_lb
>
> - <nose.suite.ContextSuite context=TestNiciraContoller>:setup
>
> - integration.smoke.test_snapshots.TestSnapshotRootDisk.test_01_snapshot_root_disk
>
> - integration.smoke.test_ssvm.TestSSVMs.test_07_reboot_ssvm
>
> - integration.smoke.test_ssvm.TestSSVMs.test_08_reboot_cpvm
>
> - integration.smoke.test_internal_lb.TestInternalLb.test_internallb
>
Re: BVT Report 10/14
Posted by Wilder Rodrigues <WR...@schubergphilis.com>.
I will run test_network on latest master with the following environment now
Advance Zone
2 KVM hosts
Basic Zone
1 KVM host
Cheers,
Wilder
> On 22 Oct 2015, at 09:01, Remi Bergsma <RB...@schubergphilis.com> wrote:
>
> Thanks!
>
> FYI: 1) is fixed by PR 959 that was merged last night. The tests should now pass, as shown in the PR.
>
> The others we'll have to look into once we have the details. Will also see if I can run those on my dev environment.
>
> Regards, Remi
>
> Sent from my iPhone
>
>> On 22 Oct 2015, at 08:28, Raja Pullela <ra...@citrix.com> wrote:
>>
>> sure Remi - I will post the details around end of the day.
>>
>> 1) reboot SSVM, CPVM - 2 tests; Bharat has a fix
>> 2) listISOs - 1 test
>> 3) test_network - 3 tests
>> integration.smoke.test_network.TestRouterRules.test_network_rules_acquired_public_ip_1_static_nat_rule
>> integration.smoke.test_network.TestRouterRules.test_network_rules_acquired_public_ip_2_nat_rule
>> integration.smoke.test_network.TestRouterRules.test_network_rules_acquired_public_ip_3_Load_Balancer_Rule
>>
>> fixing these we would hit 100% passrate!
>>
>> best,
>> Raja
>> -----Original Message-----
>> From: Remi Bergsma [mailto:RBergsma@schubergphilis.com]
>> Sent: Thursday, October 22, 2015 11:34 AM
>> To: dev@cloudstack.apache.org
>> Subject: Re: BVT Report 10/14
>>
>> Hi Raja,
>>
>> Would it be possible to share the output of another run, preferably from current master? I merged some PRs last night that fix blockers.
>>
>> I'm sure there are issues left, but the list in Jira is almost done. Is everything in there?
>>
>> Thanks; Remi
>>
>>
>> Sent from my iPhone
>>
>>> On 13 Oct 2015, at 21:17, Raja Pullela <ra...@citrix.com> wrote:
>>>
>>> BVT Report - 10/14; No change from earlier report - 10/5
>>>
>>> - Simulator Basic - 100%
>>>
>>> - Simulator Adv - 100%
>>>
>>> - XS Basic - 98.6%, 1 failure
>>>
>>> - XS Adv - 95.5%, 5 failures
>>>
>>> - KVM Basic - 94.2%, 4 failures
>>>
>>> - KVM Adv - 92.6%, 8 failures
>>>
>>> Working with Kishan, Rajani on failures related to test_ssvm/reboot_ssvm/cpvm (2 tests) and test_loadbalance failures (3 tests).
>>> Hope to see KVM and XS - Adv passrates to improve in the next day or two?
>>>
>>> best,
>>> Raja
>>>
>>>
>>> Tests failed
>>>
>>> XS Basic - 1 failure
>>>
>>> - integration.smoke.test_volumes.TestVolumes.test_02_attach_volume
>>>
>>> XS Adv - 5 failures
>>>
>>> - <nose.suite.ContextSuite context=TestNiciraContoller>:setup
>>>
>>> - integration.smoke.test_loadbalance.TestLoadBalance.test_01_create_lb_rule_src_nat
>>>
>>> - integration.smoke.test_loadbalance.TestLoadBalance.test_02_create_lb_rule_non_nat
>>>
>>> - integration.smoke.test_loadbalance.TestLoadBalance.test_assign_and_removal_lb
>>>
>>> - integration.smoke.test_internal_lb.TestInternalLb.test_internallb
>>>
>>> KVM Basic - 4 Failures
>>>
>>> - integration.smoke.test_vm_life_cycle.TestVMLifeCycle.test_10_attachAndDetach_iso
>>>
>>> - integration.smoke.test_volumes.TestVolumes.test_02_attach_volume
>>>
>>> - integration.smoke.test_ssvm.TestSSVMs.test_07_reboot_ssvm
>>>
>>> - integration.smoke.test_ssvm.TestSSVMs.test_08_reboot_cpvm
>>>
>>> KVM Advanced - 8 Failures
>>>
>>> - integration.smoke.test_loadbalance.TestLoadBalance.test_01_create_lb_rule_src_nat
>>>
>>> - integration.smoke.test_loadbalance.TestLoadBalance.test_02_create_lb_rule_non_nat
>>>
>>> - integration.smoke.test_loadbalance.TestLoadBalance.test_assign_and_removal_lb
>>>
>>> - <nose.suite.ContextSuite context=TestNiciraContoller>:setup
>>>
>>> - integration.smoke.test_snapshots.TestSnapshotRootDisk.test_01_snapshot_root_disk
>>>
>>> - integration.smoke.test_ssvm.TestSSVMs.test_07_reboot_ssvm
>>>
>>> - integration.smoke.test_ssvm.TestSSVMs.test_08_reboot_cpvm
>>>
>>> - integration.smoke.test_internal_lb.TestInternalLb.test_internallb
>>>
Re: BVT Report 10/14
Posted by Remi Bergsma <RB...@schubergphilis.com>.
Thanks!
FYI: 1) is fixed by PR 959 that was merged last night. The tests should now pass, as shown in the PR.
The others we'll have to look into once we have the details. Will also see if I can run those on my dev environment.
Regards, Remi
Sent from my iPhone
> On 22 Oct 2015, at 08:28, Raja Pullela <ra...@citrix.com> wrote:
>
> sure Remi - I will post the details around end of the day.
>
> 1) reboot SSVM, CPVM - 2 tests; Bharat has a fix
> 2) listISOs - 1 test
> 3) test_network - 3 tests
> integration.smoke.test_network.TestRouterRules.test_network_rules_acquired_public_ip_1_static_nat_rule
> integration.smoke.test_network.TestRouterRules.test_network_rules_acquired_public_ip_2_nat_rule
> integration.smoke.test_network.TestRouterRules.test_network_rules_acquired_public_ip_3_Load_Balancer_Rule
>
> fixing these we would hit 100% passrate!
>
> best,
> Raja
> -----Original Message-----
> From: Remi Bergsma [mailto:RBergsma@schubergphilis.com]
> Sent: Thursday, October 22, 2015 11:34 AM
> To: dev@cloudstack.apache.org
> Subject: Re: BVT Report 10/14
>
> Hi Raja,
>
> Would it be possible to share the output of another run, preferably from current master? I merged some PRs last night that fix blockers.
>
> I'm sure there are issues left, but the list in Jira is almost done. Is everything in there?
>
> Thanks; Remi
>
>
> Sent from my iPhone
>
>> On 13 Oct 2015, at 21:17, Raja Pullela <ra...@citrix.com> wrote:
>>
>> BVT Report - 10/14; No change from earlier report - 10/5
>>
>> - Simulator Basic - 100%
>>
>> - Simulator Adv - 100%
>>
>> - XS Basic - 98.6%, 1 failure
>>
>> - XS Adv - 95.5%, 5 failures
>>
>> - KVM Basic - 94.2%, 4 failures
>>
>> - KVM Adv - 92.6%, 8 failures
>>
>> Working with Kishan, Rajani on failures related to test_ssvm/reboot_ssvm/cpvm (2 tests) and test_loadbalance failures (3 tests).
>> Hope to see KVM and XS - Adv passrates to improve in the next day or two?
>>
>> best,
>> Raja
>>
>>
>> Tests failed
>>
>> XS Basic - 1 failure
>>
>> - integration.smoke.test_volumes.TestVolumes.test_02_attach_volume
>>
>> XS Adv - 5 failures
>>
>> - <nose.suite.ContextSuite context=TestNiciraContoller>:setup
>>
>> - integration.smoke.test_loadbalance.TestLoadBalance.test_01_create_lb_rule_src_nat
>>
>> - integration.smoke.test_loadbalance.TestLoadBalance.test_02_create_lb_rule_non_nat
>>
>> - integration.smoke.test_loadbalance.TestLoadBalance.test_assign_and_removal_lb
>>
>> - integration.smoke.test_internal_lb.TestInternalLb.test_internallb
>>
>> KVM Basic - 4 Failures
>>
>> - integration.smoke.test_vm_life_cycle.TestVMLifeCycle.test_10_attachAndDetach_iso
>>
>> - integration.smoke.test_volumes.TestVolumes.test_02_attach_volume
>>
>> - integration.smoke.test_ssvm.TestSSVMs.test_07_reboot_ssvm
>>
>> - integration.smoke.test_ssvm.TestSSVMs.test_08_reboot_cpvm
>>
>> KVM Advanced - 8 Failures
>>
>> - integration.smoke.test_loadbalance.TestLoadBalance.test_01_create_lb_rule_src_nat
>>
>> - integration.smoke.test_loadbalance.TestLoadBalance.test_02_create_lb_rule_non_nat
>>
>> - integration.smoke.test_loadbalance.TestLoadBalance.test_assign_and_removal_lb
>>
>> - <nose.suite.ContextSuite context=TestNiciraContoller>:setup
>>
>> - integration.smoke.test_snapshots.TestSnapshotRootDisk.test_01_snapshot_root_disk
>>
>> - integration.smoke.test_ssvm.TestSSVMs.test_07_reboot_ssvm
>>
>> - integration.smoke.test_ssvm.TestSSVMs.test_08_reboot_cpvm
>>
>> - integration.smoke.test_internal_lb.TestInternalLb.test_internallb
>>
RE: BVT Report 10/14
Posted by Raja Pullela <ra...@citrix.com>.
sure Remi - I will post the details around end of the day.
1) reboot SSVM, CPVM - 2 tests; Bharat has a fix
2) listISOs - 1 test
3) test_network - 3 tests
integration.smoke.test_network.TestRouterRules.test_network_rules_acquired_public_ip_1_static_nat_rule
integration.smoke.test_network.TestRouterRules.test_network_rules_acquired_public_ip_2_nat_rule
integration.smoke.test_network.TestRouterRules.test_network_rules_acquired_public_ip_3_Load_Balancer_Rule
fixing these we would hit 100% passrate!
best,
Raja
-----Original Message-----
From: Remi Bergsma [mailto:RBergsma@schubergphilis.com]
Sent: Thursday, October 22, 2015 11:34 AM
To: dev@cloudstack.apache.org
Subject: Re: BVT Report 10/14
Hi Raja,
Would it be possible to share the output of another run, preferably from current master? I merged some PRs last night that fix blockers.
I'm sure there are issues left, but the list in Jira is almost done. Is everything in there?
Thanks; Remi
Sent from my iPhone
> On 13 Oct 2015, at 21:17, Raja Pullela <ra...@citrix.com> wrote:
>
> BVT Report - 10/14; No change from earlier report - 10/5
>
> - Simulator Basic - 100%
>
> - Simulator Adv - 100%
>
> - XS Basic - 98.6%, 1 failure
>
> - XS Adv - 95.5%, 5 failures
>
> - KVM Basic - 94.2%, 4 failures
>
> - KVM Adv - 92.6%, 8 failures
>
> Working with Kishan, Rajani on failures related to test_ssvm/reboot_ssvm/cpvm (2 tests) and test_loadbalance failures (3 tests).
> Hope to see KVM and XS - Adv passrates to improve in the next day or two?
>
> best,
> Raja
>
>
> Tests failed
>
> XS Basic - 1 failure
>
> - integration.smoke.test_volumes.TestVolumes.test_02_attach_volume
>
> XS Adv - 5 failures
>
> - <nose.suite.ContextSuite context=TestNiciraContoller>:setup
>
> - integration.smoke.test_loadbalance.TestLoadBalance.test_01_create_lb_rule_src_nat
>
> - integration.smoke.test_loadbalance.TestLoadBalance.test_02_create_lb_rule_non_nat
>
> - integration.smoke.test_loadbalance.TestLoadBalance.test_assign_and_removal_lb
>
> - integration.smoke.test_internal_lb.TestInternalLb.test_internallb
>
> KVM Basic - 4 Failures
>
> - integration.smoke.test_vm_life_cycle.TestVMLifeCycle.test_10_attachAndDetach_iso
>
> - integration.smoke.test_volumes.TestVolumes.test_02_attach_volume
>
> - integration.smoke.test_ssvm.TestSSVMs.test_07_reboot_ssvm
>
> - integration.smoke.test_ssvm.TestSSVMs.test_08_reboot_cpvm
>
> KVM Advanced - 8 Failures
>
> - integration.smoke.test_loadbalance.TestLoadBalance.test_01_create_lb_rule_src_nat
>
> - integration.smoke.test_loadbalance.TestLoadBalance.test_02_create_lb_rule_non_nat
>
> - integration.smoke.test_loadbalance.TestLoadBalance.test_assign_and_removal_lb
>
> - <nose.suite.ContextSuite context=TestNiciraContoller>:setup
>
> - integration.smoke.test_snapshots.TestSnapshotRootDisk.test_01_snapshot_root_disk
>
> - integration.smoke.test_ssvm.TestSSVMs.test_07_reboot_ssvm
>
> - integration.smoke.test_ssvm.TestSSVMs.test_08_reboot_cpvm
>
> - integration.smoke.test_internal_lb.TestInternalLb.test_internallb
>
Re: BVT Report 10/14
Posted by Remi Bergsma <RB...@schubergphilis.com>.
Hi Raja,
Would it be possible to share the output of another run, preferably from current master? I merged some PRs last night that fix blockers.
I'm sure there are issues left, but the list in Jira is almost done. Is everything in there?
Thanks; Remi
Sent from my iPhone
> On 13 Oct 2015, at 21:17, Raja Pullela <ra...@citrix.com> wrote:
>
> BVT Report - 10/14; No change from earlier report - 10/5
>
> - Simulator Basic - 100%
>
> - Simulator Adv - 100%
>
> - XS Basic - 98.6%, 1 failure
>
> - XS Adv - 95.5%, 5 failures
>
> - KVM Basic - 94.2%, 4 failures
>
> - KVM Adv - 92.6%, 8 failures
>
> Working with Kishan, Rajani on failures related to test_ssvm/reboot_ssvm/cpvm (2 tests) and test_loadbalance failures (3 tests).
> Hope to see KVM and XS - Adv passrates to improve in the next day or two?
>
> best,
> Raja
>
>
> Tests failed
>
> XS Basic - 1 failure
>
> - integration.smoke.test_volumes.TestVolumes.test_02_attach_volume
>
> XS Adv - 5 failures
>
> - <nose.suite.ContextSuite context=TestNiciraContoller>:setup
>
> - integration.smoke.test_loadbalance.TestLoadBalance.test_01_create_lb_rule_src_nat
>
> - integration.smoke.test_loadbalance.TestLoadBalance.test_02_create_lb_rule_non_nat
>
> - integration.smoke.test_loadbalance.TestLoadBalance.test_assign_and_removal_lb
>
> - integration.smoke.test_internal_lb.TestInternalLb.test_internallb
>
> KVM Basic - 4 Failures
>
> - integration.smoke.test_vm_life_cycle.TestVMLifeCycle.test_10_attachAndDetach_iso
>
> - integration.smoke.test_volumes.TestVolumes.test_02_attach_volume
>
> - integration.smoke.test_ssvm.TestSSVMs.test_07_reboot_ssvm
>
> - integration.smoke.test_ssvm.TestSSVMs.test_08_reboot_cpvm
>
> KVM Advanced - 8 Failures
>
> - integration.smoke.test_loadbalance.TestLoadBalance.test_01_create_lb_rule_src_nat
>
> - integration.smoke.test_loadbalance.TestLoadBalance.test_02_create_lb_rule_non_nat
>
> - integration.smoke.test_loadbalance.TestLoadBalance.test_assign_and_removal_lb
>
> - <nose.suite.ContextSuite context=TestNiciraContoller>:setup
>
> - integration.smoke.test_snapshots.TestSnapshotRootDisk.test_01_snapshot_root_disk
>
> - integration.smoke.test_ssvm.TestSSVMs.test_07_reboot_ssvm
>
> - integration.smoke.test_ssvm.TestSSVMs.test_08_reboot_cpvm
>
> - integration.smoke.test_internal_lb.TestInternalLb.test_internallb
>