You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@cloudstack.apache.org by Gaurav Aradhye <ga...@clogeny.com> on 2013/10/23 16:34:02 UTC
Review Request 14876: CLOUDSTACK 2233: Automation test cases for Add Remove
Networks to VM
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/14876/
-----------------------------------------------------------
Review request for cloudstack, Girish Shilamkar and SrikanteswaraRao Talluri.
Repository: cloudstack-git
Description
-------
Adding first set of Automation test cases for Add Remove Network to VM.
Total 21 scenarios covered. (12 Test cases).
Two test cases skipped due to issue: 4935
https://issues.apache.org/jira/browse/CLOUDSTACK-4935
Test Plan: https://cwiki.apache.org/confluence/display/CLOUDSTACK/Add+Remove+networks+to+VM+Test+cases
Issue Link: https://issues.apache.org/jira/browse/CLOUDSTACK-645
Feature Specifications: https://cwiki.apache.org/confluence/display/CLOUDSTACK/Add+Remove+Networks+to+VMs
Diffs
-----
test/integration/component/test_add_remove_network.py PRE-CREATION
tools/marvin/marvin/integration/lib/base.py 4f15137
Diff: https://reviews.apache.org/r/14876/diff/
Testing
-------
Tested locally:
Log:
test_01_add_nw_running_vm_isolated (test_add_remove_network.TestAddNetworkToVirtualMachine)
ok
test_01_add_nw_running_vm_shared (test_add_remove_network.TestAddNetworkToVirtualMachine)
ok
test_02_add_nw_stopped_vm_isolated (test_add_remove_network.TestAddNetworkToVirtualMachine)
ok
test_02_add_nw_stopped_vm_shared (test_add_remove_network.TestAddNetworkToVirtualMachine)
ok
test_03_add_nw_multiple_times_isolated (test_add_remove_network.TestAddNetworkToVirtualMachine)
Add same network multiple times to running VM ... skipped 'Skip - Failing due to issue CS-4935'#
test_03_add_nw_multiple_times_shared (test_add_remove_network.TestAddNetworkToVirtualMachine)
Add same network multiple times to running VM ... skipped 'Skip - Failing due to issue CS-4935'
test_04_vpc_nw_running_vm_isolated (test_add_remove_network.TestAddNetworkToVirtualMachine)
ok
test_05_add_vpc_nw_stopped_vm_isolated (test_add_remove_network.TestAddNetworkToVirtualMachine)
ok
test_06_add_nw_ipaddress_running_vm (test_add_remove_network.TestAddNetworkToVirtualMachine)
ok
test_07_remove_nic_running_vm (test_add_remove_network.TestRemoveNetworkFromVirtualMachine)
ok
test_08_remove_default_nic (test_add_remove_network.TestRemoveNetworkFromVirtualMachine)
ok
test_09_remove_foreign_nic (test_add_remove_network.TestRemoveNetworkFromVirtualMachine)
ok
----------------------------------------------------------------------
Ran 12 tests in 2493.857s
OK (skipped=2)
Thanks,
Gaurav Aradhye
Re: Review Request 14876: CLOUDSTACK-2233: Automation test cases for Add
Remove Networks to VM
Posted by Gaurav Aradhye <ga...@clogeny.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/14876/
-----------------------------------------------------------
(Updated Nov. 25, 2013, 12:43 p.m.)
Review request for cloudstack, Girish Shilamkar and SrikanteswaraRao Talluri.
Changes
-------
Adding ddt information to setup file
Bugs: CLOUDSTACK-2233
https://issues.apache.org/jira/browse/CLOUDSTACK-2233
Repository: cloudstack-git
Description
-------
Automation test cases for Add Remove Network to VM.
Total 32 Test cases.
Two test cases skipped due to issue: 4935
https://issues.apache.org/jira/browse/CLOUDSTACK-4935
Test Plan: https://cwiki.apache.org/confluence/display/CLOUDSTACK/Add+Remove+networks+to+VM+Test+cases
Issue Link: https://issues.apache.org/jira/browse/CLOUDSTACK-645
Feature Specifications: https://cwiki.apache.org/confluence/display/CLOUDSTACK/Add+Remove+Networks+to+VMs
Diffs (updated)
-----
test/integration/component/test_add_remove_network.py PRE-CREATION
tools/marvin/marvin/integration/lib/base.py b03c552
tools/marvin/setup.py eeed3bf
Diff: https://reviews.apache.org/r/14876/diff/
Testing
-------
Tested locally:
Log:
test_01_add_nw_running_vm_isolated (test_add_remove_network.TestAddNetworkToVirtualMachine)
Add network to running VM ... ok
test_01_add_nw_running_vm_shared (test_add_remove_network.TestAddNetworkToVirtualMachine)
Add network to running VM ... ok
test_02_add_nw_stopped_vm_isolated (test_add_remove_network.TestAddNetworkToVirtualMachine)
Add network to stopped VM ... ok
test_02_add_nw_stopped_vm_shared (test_add_remove_network.TestAddNetworkToVirtualMachine)
Add network to stopped VM ... ok
test_03_add_nw_multiple_times_isolated (test_add_remove_network.TestAddNetworkToVirtualMachine)
Add same network multiple times to running VM ... ok
test_03_add_nw_multiple_times_shared (test_add_remove_network.TestAddNetworkToVirtualMachine)
Add same network multiple times to running VM ... ok
test_04_vpc_nw_running_vm_isolated (test_add_remove_network.TestAddNetworkToVirtualMachine)
Add VPC network to running VM belonging to isolated network ... ok
test_05_add_vpc_nw_stopped_vm_isolated (test_add_remove_network.TestAddNetworkToVirtualMachine)
Add VPC network to stopped VM belonging to isolated network ... ok
test_06_add_nw_ipaddress_running_vm (test_add_remove_network.TestAddNetworkToVirtualMachine)
Add network and ip address to running VM ... ok
test_10_add_nw_invalid_ipaddress_running_vm (test_add_remove_network.TestAddNetworkToVirtualMachine)
Add network with invalid ip address to running VM ... ok
test_14_add_nw_different_account_isolated (test_add_remove_network.TestAddNetworkToVirtualMachine)
Add network to running VM ... ok
test_14_add_nw_different_account_shared (test_add_remove_network.TestAddNetworkToVirtualMachine)
Add network to running VM ... ok
test_24_add_nw_different_domain (test_add_remove_network.TestAddNetworkToVirtualMachine)
Add network to running VM ... ok
test_25_add_nw_above_account_limit (test_add_remove_network.TestAddNetworkToVirtualMachine)
Add network to VM with maximum network limit reached ... ok
test_15_add_nic_wrong_vm_id (test_add_remove_network.TestFailureScenariosAddNetworkToVM)
Add network to vm with wrong vm id ... ok
test_16_add_nic_wrong_network_id (test_add_remove_network.TestFailureScenariosAddNetworkToVM)
Add network to vm with wrong network id ... ok
test_17_add_nic_different_zone (test_add_remove_network.TestFailureScenariosAddNetworkToVM)
Add network to vm where both belong to different zones ... ok
test_18_add_nic_basic_zone (test_add_remove_network.TestFailureScenariosAddNetworkToVM)
Add network to vm in basic zone ... skipped 'This test requires at least one basic zone to be present in the setup'
test_26_add_nic_insufficient_permission (test_add_remove_network.TestFailureScenariosAddNetworkToVM)
Try to add network to vm with insufficient permission ... ok
test_19_remove_nic_wrong_vm_id (test_add_remove_network.TestFailureScenariosRemoveNicFromVM)
Try to remove nic from a vm providing wrong vm id to API ... ok
test_20_remove_nic_wrong_nic_id (test_add_remove_network.TestFailureScenariosRemoveNicFromVM)
Try to remove nic from a vm providing wrong nic id to API ... ok
test_27_remove_nic_insufficient_permission (test_add_remove_network.TestFailureScenariosRemoveNicFromVM)
Try to remove nic from vm with insufficient permission ... ok
test_21_update_nic_wrong_vm_id (test_add_remove_network.TestFailureScenariosUpdateVirtualMachineNIC)
update default nic of vm providing wrong vm id to the API ... ok
test_22_update_nic_wrong_nic_id (test_add_remove_network.TestFailureScenariosUpdateVirtualMachineNIC)
update default nic of vm providing wrong nic id to the API ... ok
test_23_update_nic_incorrect_vm_state (test_add_remove_network.TestFailureScenariosUpdateVirtualMachineNIC)
update default nic of vm when vm is state is not Running or Stopped ... ok
test_28_update_nic_insufficient_permission (test_add_remove_network.TestFailureScenariosUpdateVirtualMachineNIC)
Try to update default nic of vm with insufficient permission ... ok
test_07_remove_nic_running_vm (test_add_remove_network.TestRemoveNetworkFromVirtualMachine)
Remove nic from running VM ... ok
test_08_remove_default_nic (test_add_remove_network.TestRemoveNetworkFromVirtualMachine)
Test Remove default nic of running VM ... ok
test_09_remove_foreign_nic (test_add_remove_network.TestRemoveNetworkFromVirtualMachine)
Remove nic which does not belong to VM ... ok
test_11_update_nic_running_vm (test_add_remove_network.TestUpdateVirtualMachineNIC)
update default nic of running VM ... ok
test_12_make_default_nic_as_default (test_add_remove_network.TestUpdateVirtualMachineNIC)
Try to set default nic of vm again as default ... ok
test_13_set_foreign_nic_as_default (test_add_remove_network.TestUpdateVirtualMachineNIC)
set nic which does not belong to VM as its default one ... ok
----------------------------------------------------------------------
Ran 32 tests in 4088.039s
OK
Thanks,
Gaurav Aradhye
Re: Review Request 14876: CLOUDSTACK-2233: Automation test cases for Add
Remove Networks to VM
Posted by Gaurav Aradhye <ga...@clogeny.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/14876/
-----------------------------------------------------------
(Updated Nov. 23, 2013, 4:13 p.m.)
Review request for cloudstack, Girish Shilamkar and SrikanteswaraRao Talluri.
Changes
-------
Adding remaining test cases. Total 32 test cases for add-delete network to/from VM.
Summary (updated)
-----------------
CLOUDSTACK-2233: Automation test cases for Add Remove Networks to VM
Bugs: CLOUDSTACK-2233
https://issues.apache.org/jira/browse/CLOUDSTACK-2233
Repository: cloudstack-git
Description (updated)
-------
Automation test cases for Add Remove Network to VM.
Total 32 Test cases.
Two test cases skipped due to issue: 4935
https://issues.apache.org/jira/browse/CLOUDSTACK-4935
Test Plan: https://cwiki.apache.org/confluence/display/CLOUDSTACK/Add+Remove+networks+to+VM+Test+cases
Issue Link: https://issues.apache.org/jira/browse/CLOUDSTACK-645
Feature Specifications: https://cwiki.apache.org/confluence/display/CLOUDSTACK/Add+Remove+Networks+to+VMs
Diffs (updated)
-----
test/integration/component/test_add_remove_network.py PRE-CREATION
tools/marvin/marvin/integration/lib/base.py b03c552
Diff: https://reviews.apache.org/r/14876/diff/
Testing (updated)
-------
Tested locally:
Log:
test_01_add_nw_running_vm_isolated (test_add_remove_network.TestAddNetworkToVirtualMachine)
Add network to running VM ... ok
test_01_add_nw_running_vm_shared (test_add_remove_network.TestAddNetworkToVirtualMachine)
Add network to running VM ... ok
test_02_add_nw_stopped_vm_isolated (test_add_remove_network.TestAddNetworkToVirtualMachine)
Add network to stopped VM ... ok
test_02_add_nw_stopped_vm_shared (test_add_remove_network.TestAddNetworkToVirtualMachine)
Add network to stopped VM ... ok
test_03_add_nw_multiple_times_isolated (test_add_remove_network.TestAddNetworkToVirtualMachine)
Add same network multiple times to running VM ... ok
test_03_add_nw_multiple_times_shared (test_add_remove_network.TestAddNetworkToVirtualMachine)
Add same network multiple times to running VM ... ok
test_04_vpc_nw_running_vm_isolated (test_add_remove_network.TestAddNetworkToVirtualMachine)
Add VPC network to running VM belonging to isolated network ... ok
test_05_add_vpc_nw_stopped_vm_isolated (test_add_remove_network.TestAddNetworkToVirtualMachine)
Add VPC network to stopped VM belonging to isolated network ... ok
test_06_add_nw_ipaddress_running_vm (test_add_remove_network.TestAddNetworkToVirtualMachine)
Add network and ip address to running VM ... ok
test_10_add_nw_invalid_ipaddress_running_vm (test_add_remove_network.TestAddNetworkToVirtualMachine)
Add network with invalid ip address to running VM ... ok
test_14_add_nw_different_account_isolated (test_add_remove_network.TestAddNetworkToVirtualMachine)
Add network to running VM ... ok
test_14_add_nw_different_account_shared (test_add_remove_network.TestAddNetworkToVirtualMachine)
Add network to running VM ... ok
test_24_add_nw_different_domain (test_add_remove_network.TestAddNetworkToVirtualMachine)
Add network to running VM ... ok
test_25_add_nw_above_account_limit (test_add_remove_network.TestAddNetworkToVirtualMachine)
Add network to VM with maximum network limit reached ... ok
test_15_add_nic_wrong_vm_id (test_add_remove_network.TestFailureScenariosAddNetworkToVM)
Add network to vm with wrong vm id ... ok
test_16_add_nic_wrong_network_id (test_add_remove_network.TestFailureScenariosAddNetworkToVM)
Add network to vm with wrong network id ... ok
test_17_add_nic_different_zone (test_add_remove_network.TestFailureScenariosAddNetworkToVM)
Add network to vm where both belong to different zones ... ok
test_18_add_nic_basic_zone (test_add_remove_network.TestFailureScenariosAddNetworkToVM)
Add network to vm in basic zone ... skipped 'This test requires at least one basic zone to be present in the setup'
test_26_add_nic_insufficient_permission (test_add_remove_network.TestFailureScenariosAddNetworkToVM)
Try to add network to vm with insufficient permission ... ok
test_19_remove_nic_wrong_vm_id (test_add_remove_network.TestFailureScenariosRemoveNicFromVM)
Try to remove nic from a vm providing wrong vm id to API ... ok
test_20_remove_nic_wrong_nic_id (test_add_remove_network.TestFailureScenariosRemoveNicFromVM)
Try to remove nic from a vm providing wrong nic id to API ... ok
test_27_remove_nic_insufficient_permission (test_add_remove_network.TestFailureScenariosRemoveNicFromVM)
Try to remove nic from vm with insufficient permission ... ok
test_21_update_nic_wrong_vm_id (test_add_remove_network.TestFailureScenariosUpdateVirtualMachineNIC)
update default nic of vm providing wrong vm id to the API ... ok
test_22_update_nic_wrong_nic_id (test_add_remove_network.TestFailureScenariosUpdateVirtualMachineNIC)
update default nic of vm providing wrong nic id to the API ... ok
test_23_update_nic_incorrect_vm_state (test_add_remove_network.TestFailureScenariosUpdateVirtualMachineNIC)
update default nic of vm when vm is state is not Running or Stopped ... ok
test_28_update_nic_insufficient_permission (test_add_remove_network.TestFailureScenariosUpdateVirtualMachineNIC)
Try to update default nic of vm with insufficient permission ... ok
test_07_remove_nic_running_vm (test_add_remove_network.TestRemoveNetworkFromVirtualMachine)
Remove nic from running VM ... ok
test_08_remove_default_nic (test_add_remove_network.TestRemoveNetworkFromVirtualMachine)
Test Remove default nic of running VM ... ok
test_09_remove_foreign_nic (test_add_remove_network.TestRemoveNetworkFromVirtualMachine)
Remove nic which does not belong to VM ... ok
test_11_update_nic_running_vm (test_add_remove_network.TestUpdateVirtualMachineNIC)
update default nic of running VM ... ok
test_12_make_default_nic_as_default (test_add_remove_network.TestUpdateVirtualMachineNIC)
Try to set default nic of vm again as default ... ok
test_13_set_foreign_nic_as_default (test_add_remove_network.TestUpdateVirtualMachineNIC)
set nic which does not belong to VM as its default one ... ok
----------------------------------------------------------------------
Ran 32 tests in 4088.039s
OK
Thanks,
Gaurav Aradhye
Re: Review Request 14876: CLOUDSTACK 2233: Automation test cases for Add
Remove Networks to VM
Posted by Gaurav Aradhye <ga...@clogeny.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/14876/
-----------------------------------------------------------
(Updated Oct. 25, 2013, 1:22 p.m.)
Review request for cloudstack, Girish Shilamkar and SrikanteswaraRao Talluri.
Changes
-------
Unskipping skipped test which were blocked due to Issue 4935. Issue 4935 Resolved. Test case changed accordingly.
Repository: cloudstack-git
Description
-------
Adding first set of Automation test cases for Add Remove Network to VM.
Total 21 scenarios covered. (12 Test cases).
Two test cases skipped due to issue: 4935
https://issues.apache.org/jira/browse/CLOUDSTACK-4935
Test Plan: https://cwiki.apache.org/confluence/display/CLOUDSTACK/Add+Remove+networks+to+VM+Test+cases
Issue Link: https://issues.apache.org/jira/browse/CLOUDSTACK-645
Feature Specifications: https://cwiki.apache.org/confluence/display/CLOUDSTACK/Add+Remove+Networks+to+VMs
Diffs (updated)
-----
test/integration/component/test_add_remove_network.py PRE-CREATION
tools/marvin/marvin/integration/lib/base.py 4f15137
Diff: https://reviews.apache.org/r/14876/diff/
Testing (updated)
-------
Tested locally:
Log:
test_01_add_nw_running_vm_isolated (test_add_remove_network.TestAddNetworkToVirtualMachine)
Add network to running VM ... ok
test_01_add_nw_running_vm_shared (test_add_remove_network.TestAddNetworkToVirtualMachine)
Add network to running VM ... ok
test_02_add_nw_stopped_vm_isolated (test_add_remove_network.TestAddNetworkToVirtualMachine)
Add network to stopped VM ... ok
test_02_add_nw_stopped_vm_shared (test_add_remove_network.TestAddNetworkToVirtualMachine)
Add network to stopped VM ... ok
test_03_add_nw_multiple_times_isolated (test_add_remove_network.TestAddNetworkToVirtualMachine)
Add same network multiple times to running VM ... ok
test_03_add_nw_multiple_times_shared (test_add_remove_network.TestAddNetworkToVirtualMachine)
Add same network multiple times to running VM ... ok
test_04_vpc_nw_running_vm_isolated (test_add_remove_network.TestAddNetworkToVirtualMachine)
Add VPC network to running VM belonging to isolated network ... ok
test_05_add_vpc_nw_stopped_vm_isolated (test_add_remove_network.TestAddNetworkToVirtualMachine)
Add VPC network to stopped VM belonging to isolated network ... ok
test_06_add_nw_ipaddress_running_vm (test_add_remove_network.TestAddNetworkToVirtualMachine)
Add network and ip address to running VM ... ok
test_07_remove_nic_running_vm (test_add_remove_network.TestRemoveNetworkFromVirtualMachine)
Remove nic from running VM ... ok
test_08_remove_default_nic (test_add_remove_network.TestRemoveNetworkFromVirtualMachine)
Test Remove default nic of running VM ... ok
test_09_remove_foreign_nic (test_add_remove_network.TestRemoveNetworkFromVirtualMachine)
Remove nic which does not belong to VM ... ok
----------------------------------------------------------------------
Ran 12 tests in 2151.885s
OK
Thanks,
Gaurav Aradhye