You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@cloudstack.apache.org by runseb <gi...@git.apache.org> on 2015/10/09 17:16:33 UTC
[GitHub] cloudstack pull request: Add all tests in /test/integration/smoke ...
GitHub user runseb opened a pull request:
https://github.com/apache/cloudstack/pull/920
Add all tests in /test/integration/smoke to Travis run
This modified .travis.yml file to include missing tests in /test/integration/smoke.
It expands the coverage of the Travis runs.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/runseb/cloudstack master
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/cloudstack/pull/920.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #920
----
commit 3b526b3d13ddbdbc281fe52d3f0c08ead41a592a
Author: runseb <ru...@gmail.com>
Date: 2015-10-09T15:14:08Z
Add all tests in /test/integration/smoke to Travis run
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] cloudstack pull request: Add all tests in /test/integration/smoke ...
Posted by runseb <gi...@git.apache.org>.
Github user runseb commented on the pull request:
https://github.com/apache/cloudstack/pull/920#issuecomment-147706546
Sanjeev, good point, Travis only runs advanced zone tests. Maybe we should figure out a way to also run the tests with a basic config.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
Re: [GitHub] cloudstack pull request: Add all tests in
/test/integration/smoke ...
Posted by Sanjeev N <sa...@apache.org>.
Hi,
travis/script.sh uses following nose command to pick the tests.
nosetests --with-xunit --xunit-file=integration-test-results/$suite.xml
--with-marvin --marvin-config=setup/dev/advanced.cfg
test/integration/$suite.py -s -a tags=advanced,required_hardware=false
--zone=Sandbox-simulator --hypervisor=simulator || true ;
CI is running on advanced zone and it is picking the tests that are tagged
for running on simulator. That is the reason we don't see all tests
running since some of them require hardware to run.
PR looks good. LTGM !!
@pvr9711, we don't need to add .py at the end.
Thanks,
Sanjeev
On Tue, Oct 13, 2015 at 11:01 AM, pvr9711 <gi...@git.apache.org> wrote:
> Github user pvr9711 commented on the pull request:
>
> https://github.com/apache/cloudstack/pull/920#issuecomment-147607738
>
> Following are the tests that run on Simulator basic and adv -
> separately, please add ".py" to the end.
> Simulator Basic -
> integration.smoke.test_affinity_groups
> integration.smoke.test_deploy_vms_with_varied_deploymentplanners
> integration.smoke.test_disk_offerings
> integration.smoke.test_global_settings
> integration.smoke.test_iso
> integration.smoke.test_multipleips_per_nic
> integration.smoke.test_over_provisioning
> integration.smoke.test_portable_publicip
> integration.smoke.test_primary_storage
> integration.smoke.test_reset_vm_on_reboot
> integration.smoke.test_scale_vm
> integration.smoke.test_secondary_storage
> integration.smoke.test_service_offerings
> integration.smoke.test_ssvm
> integration.smoke.test_templates
> integration.smoke.test_vm_life_cycle
> integration.smoke.test_volumes
>
> Simulator Adv -
> integration.smoke.test_affinity_groups
> integration.smoke.test_deploy_vms_with_varied_deploymentplanners
> integration.smoke.test_disk_offerings
> integration.smoke.test_global_settings
> integration.smoke.test_guest_vlan_range
> integration.smoke.test_iso
> integration.smoke.test_multipleips_per_nic
> integration.smoke.test_network
> integration.smoke.test_nic_adapter_type
> integration.smoke.test_non_contigiousvlan
> integration.smoke.test_over_provisioning
> integration.smoke.test_portable_publicip
> integration.smoke.test_primary_storage
> integration.smoke.test_privategw_acl
> integration.smoke.test_public_ip_range
> integration.smoke.test_pvlan
> integration.smoke.test_reset_vm_on_reboot
> integration.smoke.test_resource_detail
> integration.smoke.test_routers
> integration.smoke.test_scale_vm
> integration.smoke.test_secondary_storage
> integration.smoke.test_service_offerings
> integration.smoke.test_ssvm
> integration.smoke.test_templates
> integration.smoke.test_vm_life_cycle
> integration.smoke.test_volumes
> ntegration.smoke.test_vpc_vpn
>
>
>
>
>
> ---
> If your project is set up for it, you can reply to this email and have your
> reply appear on GitHub as well. If your project does not have this feature
> enabled and wishes so, or if the feature is enabled but not working, please
> contact infrastructure at infrastructure@apache.org or file a JIRA ticket
> with INFRA.
> ---
>
[GitHub] cloudstack pull request: Add all tests in /test/integration/smoke ...
Posted by pvr9711 <gi...@git.apache.org>.
Github user pvr9711 commented on the pull request:
https://github.com/apache/cloudstack/pull/920#issuecomment-147607738
Following are the tests that run on Simulator basic and adv - separately, please add ".py" to the end.
Simulator Basic -
integration.smoke.test_affinity_groups
integration.smoke.test_deploy_vms_with_varied_deploymentplanners
integration.smoke.test_disk_offerings
integration.smoke.test_global_settings
integration.smoke.test_iso
integration.smoke.test_multipleips_per_nic
integration.smoke.test_over_provisioning
integration.smoke.test_portable_publicip
integration.smoke.test_primary_storage
integration.smoke.test_reset_vm_on_reboot
integration.smoke.test_scale_vm
integration.smoke.test_secondary_storage
integration.smoke.test_service_offerings
integration.smoke.test_ssvm
integration.smoke.test_templates
integration.smoke.test_vm_life_cycle
integration.smoke.test_volumes
Simulator Adv -
integration.smoke.test_affinity_groups
integration.smoke.test_deploy_vms_with_varied_deploymentplanners
integration.smoke.test_disk_offerings
integration.smoke.test_global_settings
integration.smoke.test_guest_vlan_range
integration.smoke.test_iso
integration.smoke.test_multipleips_per_nic
integration.smoke.test_network
integration.smoke.test_nic_adapter_type
integration.smoke.test_non_contigiousvlan
integration.smoke.test_over_provisioning
integration.smoke.test_portable_publicip
integration.smoke.test_primary_storage
integration.smoke.test_privategw_acl
integration.smoke.test_public_ip_range
integration.smoke.test_pvlan
integration.smoke.test_reset_vm_on_reboot
integration.smoke.test_resource_detail
integration.smoke.test_routers
integration.smoke.test_scale_vm
integration.smoke.test_secondary_storage
integration.smoke.test_service_offerings
integration.smoke.test_ssvm
integration.smoke.test_templates
integration.smoke.test_vm_life_cycle
integration.smoke.test_volumes
ntegration.smoke.test_vpc_vpn
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] cloudstack pull request: Add all tests in /test/integration/smoke ...
Posted by runseb <gi...@git.apache.org>.
Github user runseb closed the pull request at:
https://github.com/apache/cloudstack/pull/920
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] cloudstack pull request: Add all tests in /test/integration/smoke ...
Posted by runseb <gi...@git.apache.org>.
Github user runseb commented on the pull request:
https://github.com/apache/cloudstack/pull/920#issuecomment-147081834
looks like all tests passed but in fact some did not run...someone needs to check what happened exactly
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] cloudstack pull request: Add all tests in /test/integration/smoke ...
Posted by kishankavala <gi...@git.apache.org>.
Github user kishankavala commented on the pull request:
https://github.com/apache/cloudstack/pull/920#issuecomment-147947974
@sanjeevneelarapu
1. We should look at ways to improve the simulator to run faster.
2. We have PRs open for more than a day in most cases. I would rather wait for 6hrs than to have code which might break some functionality.
When we get CI based on real hardware in future, it'll take even more time. At that point we can look at running it once a day on latest master instead of per PR.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
Re: [GitHub] cloudstack pull request: Add all tests in
/test/integration/smoke ...
Posted by Sanjeev N <sa...@apache.org>.
@kishankavala,
Big no , because simulator regression suite takes almost 6 hours to
complete.
On Wed, Oct 14, 2015 at 11:24 AM, kishankavala <gi...@git.apache.org> wrote:
> Github user kishankavala commented on the pull request:
>
> https://github.com/apache/cloudstack/pull/920#issuecomment-147944007
>
> @runseb @pvr9711 @sanjeevneelarapu
> Can we include all regression simulator tests also?
>
>
> ---
> If your project is set up for it, you can reply to this email and have your
> reply appear on GitHub as well. If your project does not have this feature
> enabled and wishes so, or if the feature is enabled but not working, please
> contact infrastructure at infrastructure@apache.org or file a JIRA ticket
> with INFRA.
> ---
>
[GitHub] cloudstack pull request: Add all tests in /test/integration/smoke ...
Posted by kishankavala <gi...@git.apache.org>.
Github user kishankavala commented on the pull request:
https://github.com/apache/cloudstack/pull/920#issuecomment-147944007
@runseb @pvr9711 @sanjeevneelarapu
Can we include all regression simulator tests also?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] cloudstack pull request: Add all tests in /test/integration/smoke ...
Posted by borisroman <gi...@git.apache.org>.
Github user borisroman commented on the pull request:
https://github.com/apache/cloudstack/pull/920#issuecomment-151115924
@runseb Could you rebase and push again? If so, and Travis and Jenkins are green, we can merge.
Ping @remibergsma @karuturi
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] cloudstack pull request: Add all tests in /test/integration/smoke ...
Posted by runseb <gi...@git.apache.org>.
Github user runseb commented on the pull request:
https://github.com/apache/cloudstack/pull/920#issuecomment-151585450
@borisroman yes will do tonight
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---