You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cloudstack.apache.org by GitBox <gi...@apache.org> on 2021/02/24 12:50:30 UTC

[GitHub] [cloudstack] DaanHoogland opened a new pull request #4727: Marvin3

DaanHoogland opened a new pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727


   ### Description
   
   This PR prepares marvin and tests for python3. it was part of #4479, until nose2 was decided to be abandoned from that PR.
   
   re-PR of #4543 and #3730  to enable cooperation
   
   <!--- Describe your changes in DETAIL - And how has behaviour functionally changed. -->
   
   <!-- For new features, provide link to FS, dev ML discussion etc. -->
   <!-- In case of bug fix, the expected and actual behaviours, steps to reproduce. -->
   
   <!-- When "Fixes: #<id>" is specified, the issue/PR will automatically be closed when this PR gets merged -->
   <!-- For addressing multiple issues/PRs, use multiple "Fixes: #<id>" -->
   <!-- Fixes: # -->
   
   <!--- ********************************************************************************* -->
   <!--- NOTE: AUTOMATATION USES THE DESCRIPTIONS TO SET LABELS AND PRODUCE DOCUMENTATION. -->
   <!--- PLEASE PUT AN 'X' in only **ONE** box -->
   <!--- ********************************************************************************* -->
   
   ### Types of changes
   
   - [ ] Breaking change (fix or feature that would cause existing functionality to change)
   - [ ] New feature (non-breaking change which adds functionality)
   - [ ] Bug fix (non-breaking change which fixes an issue)
   - [ ] Enhancement (improves an existing feature and functionality)
   - [x] Cleanup (Code refactoring and cleanup, that may add test cases)
   
   ### Feature/Enhancement Scale or Bug Severity
   
   #### Feature/Enhancement Scale
   
   - [x] Major
   - [ ] Minor
   
   #### Bug Severity
   
   - [ ] BLOCKER
   - [ ] Critical
   - [x] Major
   - [ ] Minor
   - [ ] Trivial
   
   
   ### Screenshots (if appropriate):
   
   
   ### How Has This Been Tested?
   <!-- Please describe in detail how you tested your changes. -->
   <!-- Include details of your testing environment, and the tests you ran to -->
   <!-- see how your change affects other areas of the code, etc. -->
   
   
   <!-- Please read the [CONTRIBUTING](https://github.com/apache/cloudstack/blob/master/CONTRIBUTING.md) document -->
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-830299642


   <b>Trillian test result (tid-568)</b>
   Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
   Total time taken: 33729 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t568-kvm-centos7.zip
   Smoke tests completed. 88 look OK, 0 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] DaanHoogland commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
DaanHoogland commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-788748753


   @blueorangutan test matrix


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan removed a comment on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan removed a comment on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-799467560






-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-786974469


   <b>Trillian test result (tid-3615)</b>
   Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
   Total time taken: 157422 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t3615-kvm-centos7.zip
   Intermittent failure detected: /marvin/tests/smoke/test_vm_life_cycle.py
   Smoke tests completed. 85 look OK, 1 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   test_01_migrate_VM_and_root_volume | `Error` | 67.17 | test_vm_life_cycle.py
   test_02_migrate_VM_with_two_data_disks | `Error` | 51.16 | test_vm_life_cycle.py
   ContextSuite context=TestSecuredVmMigration>:teardown | `Error` | 186.32 | test_vm_life_cycle.py
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] DaanHoogland commented on a change in pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
DaanHoogland commented on a change in pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#discussion_r582644042



##########
File path: systemvm/test/runtests.sh
##########
@@ -22,17 +22,19 @@ export PYTHONPATH="../debian/opt/cloud/bin/"
 export PYTHONDONTWRITEBYTECODE=False
 
 echo "Running pycodestyle to check systemvm/python code for errors"
-pycodestyle --max-line-length=179 *py
-pycodestyle --max-line-length=179 --exclude=monitorServices.py,baremetal-vr.py,passwd_server_ip.py `find ../debian -name \*.py`
+python3 -m pycodestyle --max-line-length=179 *py
+python3 -m pycodestyle --max-line-length=179 --exclude=monitorServices.py,baremetal-vr.py,passwd_server_ip.py `find ../debian -name \*.py`
 if [ $? -gt 0 ]
 then
     echo "pycodestyle failed, please check your code"
     exit 1
 fi
 
 echo "Running pylint to check systemvm/python code for errors"
-pylint --disable=R,C,W *.py
-pylint --disable=R,C,W `find ../debian -name \*.py`
+python --version
+pyenv versions
+pylint3 --disable=R,C,W *.py
+pylint3 --disable=R,C,W `find ../debian -name \*.py`

Review comment:
       ```suggestion
   pylint --disable=R,C,W *.py
   pylint --disable=R,C,W `find ../debian -name \*.py`
   ```




----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan removed a comment on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan removed a comment on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-791804534






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-797490189


   Packaging result: :heavy_multiplication_x: centos7 :heavy_check_mark: centos8 :heavy_check_mark: debian. SL-JID 99


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-799348123


   Packaging result: :heavy_check_mark: centos7 :heavy_multiplication_x: centos8 :heavy_multiplication_x: debian. SL-JID 120


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan removed a comment on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan removed a comment on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-786050341






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan removed a comment on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan removed a comment on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-785276473


   Packaging result: ✔centos7 ✔centos8 ✔debian. JID-2823


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-797844165


   <b>[S] Trillian test result (tid-105)</b>
   Environment: kvm-centos8 (x2), Advanced Networking with Mgmt server 8
   Total time taken: 39528 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t105-kvm-centos8.zip
   Intermittent failure detected: /marvin/tests/smoke/test_accounts.py
   Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_clusters.py
   Intermittent failure detected: /marvin/tests/smoke/test_outofbandmanagement.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_life_cycle.py
   Intermittent failure detected: /marvin/tests/smoke/test_hostha_kvm.py
   Smoke tests completed. 82 look OK, 4 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   test_DeleteDomain | `Error` | 168.55 | test_accounts.py
   test_oobm_background_powerstate_sync | `Failure` | 21.75 | test_outofbandmanagement.py
   test_oobm_enabledisable_across_clusterzones | `Error` | 32.24 | test_outofbandmanagement.py
   test_oobm_issue_power_cycle | `Error` | 19.72 | test_outofbandmanagement.py
   test_oobm_issue_power_off | `Error` | 19.72 | test_outofbandmanagement.py
   test_oobm_issue_power_on | `Error` | 18.72 | test_outofbandmanagement.py
   test_oobm_issue_power_reset | `Error` | 19.70 | test_outofbandmanagement.py
   test_oobm_issue_power_soft | `Error` | 19.74 | test_outofbandmanagement.py
   test_oobm_issue_power_status | `Error` | 18.71 | test_outofbandmanagement.py
   test_oobm_multiple_mgmt_server_ownership | `Failure` | 27.89 | test_outofbandmanagement.py
   test_oobm_zchange_password | `Error` | 6.34 | test_outofbandmanagement.py
   ContextSuite context=TestSecuredVmMigration>:teardown | `Error` | 198.30 | test_vm_life_cycle.py
   test_hostha_kvm_host_degraded | `Error` | 9.96 | test_hostha_kvm.py
   test_hostha_kvm_host_fencing | `Error` | 10.99 | test_hostha_kvm.py
   test_hostha_kvm_host_recovering | `Error` | 9.92 | test_hostha_kvm.py
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-799921562


   <b>[S] Trillian test result (tid-139)</b>
   Environment: xenserver-72 (x2), Advanced Networking with Mgmt server 7
   Total time taken: 41165 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t139-xenserver-72.zip
   Intermittent failure detected: /marvin/tests/smoke/test_diagnostics.py
   Intermittent failure detected: /marvin/tests/smoke/test_scale_vm.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
   Smoke tests completed. 85 look OK, 1 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   test_01_scale_vm | `Failure` | 9.26 | test_scale_vm.py
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-791774767


   <b>Trillian test result (tid-3664)</b>
   Environment: kvm-ubuntu20 (x2), Advanced Networking with Mgmt server u20
   Total time taken: 44519 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t3664-kvm-ubuntu20.zip
   Intermittent failure detected: /marvin/tests/smoke/test_accounts.py
   Intermittent failure detected: /marvin/tests/smoke/test_deploy_virtio_scsi_vm.py
   Intermittent failure detected: /marvin/tests/smoke/test_deploy_vm_with_userdata.py
   Intermittent failure detected: /marvin/tests/smoke/test_diagnostics.py
   Intermittent failure detected: /marvin/tests/smoke/test_domain_vpc_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_internal_lb.py
   Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_clusters.py
   Intermittent failure detected: /marvin/tests/smoke/test_loadbalance.py
   Intermittent failure detected: /marvin/tests/smoke/test_migration.py
   Intermittent failure detected: /marvin/tests/smoke/test_network_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_network.py
   Intermittent failure detected: /marvin/tests/smoke/test_password_server.py
   Intermittent failure detected: /marvin/tests/smoke/test_portforwardingrules.py
   Intermittent failure detected: /marvin/tests/smoke/test_privategw_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dhcphosts.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dns.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dnsservice.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_iptables_default_policy.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_network_ops.py
   Intermittent failure detected: /marvin/tests/smoke/test_service_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_usage.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_life_cycle.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_snapshots.py
   Intermittent failure detected: /marvin/tests/smoke/test_volumes.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_router_nics.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_vpn.py
   Smoke tests completed. 59 look OK, 27 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   test_DeleteDomain | `Error` | 130.16 | test_accounts.py
   test_DeleteDomain | `Error` | 130.17 | test_accounts.py
   test_forceDeleteDomain | `Failure` | 131.07 | test_accounts.py
   test_forceDeleteDomain | `Error` | 131.07 | test_accounts.py
   ContextSuite context=TestLoadBalance>:setup | `Error` | 0.00 | test_loadbalance.py
   test_04_verify_guest_lspci | `Error` | 715.43 | test_deploy_virtio_scsi_vm.py
   test_06_verify_guest_lspci_again | `Error` | 715.74 | test_deploy_virtio_scsi_vm.py
   test_01_native_to_native_network_migration | `Error` | 38.14 | test_migration.py
   test_02_native_to_native_vpc_migration | `Error` | 23.43 | test_migration.py
   test_network_acl | `Error` | 20.82 | test_network_acl.py
   test_delete_account | `Error` | 59.00 | test_network.py
   test_01_port_fwd_on_src_nat | `Error` | 1.20 | test_network.py
   test_02_port_fwd_on_non_src_nat | `Error` | 6.62 | test_network.py
   test_reboot_router | `Error` | 176.07 | test_network.py
   test_releaseIP | `Error` | 57.97 | test_network.py
   test_network_rules_acquired_public_ip_1_static_nat_rule | `Error` | 3.29 | test_network.py
   test_network_rules_acquired_public_ip_2_nat_rule | `Error` | 3.28 | test_network.py
   test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | `Error` | 3.29 | test_network.py
   test_deployvm_userdata | `Error` | 25.01 | test_deploy_vm_with_userdata.py
   test_deployvm_userdata_post | `Error` | 6.47 | test_deploy_vm_with_userdata.py
   test_13_retrieve_vr_default_files | `Error` | 1.13 | test_diagnostics.py
   test_14_retrieve_vr_one_file | `Error` | 1.12 | test_diagnostics.py
   test_15_retrieve_ssvm_default_files | `Error` | 1.12 | test_diagnostics.py
   test_16_retrieve_ssvm_single_file | `Error` | 1.14 | test_diagnostics.py
   test_17_retrieve_cpvm_default_files | `Error` | 1.14 | test_diagnostics.py
   test_18_retrieve_cpvm_single_file | `Error` | 1.13 | test_diagnostics.py
   test_03_create_vpc_domain_vpc_offering | `Error` | 22.83 | test_domain_vpc_offerings.py
   test_isolate_network_password_server | `Error` | 2.19 | test_password_server.py
   test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 | `Failure` | 25.57 | test_internal_lb.py
   test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 | `Failure` | 25.53 | test_internal_lb.py
   test_03_vpc_internallb_haproxy_stats_on_all_interfaces | `Failure` | 22.17 | test_internal_lb.py
   test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | `Failure` | 23.22 | test_internal_lb.py
   test_01_vpc_privategw_acl | `Failure` | 23.36 | test_privategw_acl.py
   test_02_vpc_privategw_static_routes | `Failure` | 20.27 | test_privategw_acl.py
   test_03_vpc_privategw_restart_vpc_cleanup | `Failure` | 22.35 | test_privategw_acl.py
   test_04_rvpc_privategw_static_routes | `Failure` | 25.47 | test_privategw_acl.py
   test_01_deploy_kubernetes_cluster | `Failure` | 25.29 | test_kubernetes_clusters.py
   test_02_invalid_upgrade_kubernetes_cluster | `Failure` | 26.11 | test_kubernetes_clusters.py
   test_03_deploy_and_upgrade_kubernetes_cluster | `Failure` | 24.21 | test_kubernetes_clusters.py
   test_04_deploy_and_scale_kubernetes_cluster | `Failure` | 23.93 | test_kubernetes_clusters.py
   test_05_delete_kubernetes_cluster | `Failure` | 23.95 | test_kubernetes_clusters.py
   test_07_deploy_kubernetes_ha_cluster | `Failure` | 23.95 | test_kubernetes_clusters.py
   test_08_deploy_and_upgrade_kubernetes_ha_cluster | `Failure` | 23.98 | test_kubernetes_clusters.py
   test_09_delete_kubernetes_ha_cluster | `Failure` | 23.99 | test_kubernetes_clusters.py
   ContextSuite context=TestKubernetesCluster>:teardown | `Error` | 168.04 | test_kubernetes_clusters.py
   test_01_create_delete_portforwarding_fornonvpc | `Error` | 102.05 | test_portforwardingrules.py
   test_01_create_delete_portforwarding_fornonvpc | `Error` | 102.06 | test_portforwardingrules.py
   test_router_dhcphosts | `Error` | 1.18 | test_router_dhcphosts.py
   ContextSuite context=TestRouterDHCPHosts>:teardown | `Error` | 10.57 | test_router_dhcphosts.py
   test_router_dhcp_opts | `Error` | 2.27 | test_router_dhcphosts.py
   test_router_dns_guestipquery | `Error` | 2.22 | test_router_dns.py
   test_router_dns_guestipquery | `Error` | 2.20 | test_router_dnsservice.py
   test_01_single_VPC_iptables_policies | `Error` | 21.90 | test_routers_iptables_default_policy.py
   test_01_isolate_network_FW_PF_default_routes_egress_true | `Error` | 67.05 | test_routers_network_ops.py
   test_02_isolate_network_FW_PF_default_routes_egress_false | `Error` | 65.98 | test_routers_network_ops.py
   test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true | `Error` | 100.05 | test_routers_network_ops.py
   test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false | `Error` | 98.78 | test_routers_network_ops.py
   test_03_RVR_Network_check_router_state | `Failure` | 97.22 | test_routers_network_ops.py
   test_01_service_offering_cpu_limit_use | `Error` | 716.59 | test_service_offerings.py
   test_04_change_offering_small | `Failure` | 817.54 | test_service_offerings.py
   test_01_lb_usage | `Error` | 1.22 | test_usage.py
   test_01_nat_usage | `Error` | 3.19 | test_usage.py
   test_01_vpn_usage | `Error` | 4.67 | test_usage.py
   ContextSuite context=TestSecuredVmMigration>:teardown | `Error` | 316.05 | test_vm_life_cycle.py
   ContextSuite context=TestVMLifeCycle>:setup | `Error` | 4.02 | test_vm_life_cycle.py
   test_01_create_vm_snapshots | `Failure` | 715.55 | test_vm_snapshots.py
   test_02_revert_vm_snapshots | `Failure` | 719.96 | test_vm_snapshots.py
   test_03_delete_vm_snapshots | `Failure` | 0.02 | test_vm_snapshots.py
   test_01_create_volume | `Failure` | 720.25 | test_volumes.py
   test_02_attach_volume | `Failure` | 752.74 | test_volumes.py
   test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | `Error` | 25.48 | test_vpc_redundant.py
   test_02_redundant_VPC_default_routes | `Error` | 24.41 | test_vpc_redundant.py
   test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | `Error` | 23.39 | test_vpc_redundant.py
   test_04_rvpc_network_garbage_collector_nics | `Error` | 24.55 | test_vpc_redundant.py
   test_05_rvpc_multi_tiers | `Error` | 23.38 | test_vpc_redundant.py
   test_01_VPC_nics_after_destroy | `Error` | 22.35 | test_vpc_router_nics.py
   test_02_VPC_default_routes | `Error` | 21.31 | test_vpc_router_nics.py
   test_01_redundant_vpc_site2site_vpn | `Failure` | 25.05 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn_multiple_options | `Failure` | 23.99 | test_vpc_vpn.py
   test_01_vpc_remote_access_vpn | `Failure` | 19.68 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn | `Failure` | 23.00 | test_vpc_vpn.py
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-829755611


   <b>Trillian test result (tid-559)</b>
   Environment: vmware-65u2 (x2), Advanced Networking with Mgmt server 7
   Total time taken: 39006 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t559-vmware-65u2.zip
   Intermittent failure detected: /marvin/tests/smoke/test_scale_vm.py
   Smoke tests completed. 87 look OK, 1 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   ContextSuite context=TestScaleVm>:setup | `Error` | 0.00 | test_scale_vm.py
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] DaanHoogland commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
DaanHoogland commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-796883992


   up to 50 failing suites now, :facepalm: not sure how to address this anymore.
   I think these are all due to the router scripts, but diagnostics is very bad, so I can't be sure.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] GabrielBrascher removed a comment on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
GabrielBrascher removed a comment on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-786244698


   @blueorangutan package


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-789208660


   <b>Trillian test result (tid-3633)</b>
   Environment: xenserver-71 (x2), Advanced Networking with Mgmt server 7
   Total time taken: 40605 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t3633-xenserver-71.zip
   Intermittent failure detected: /marvin/tests/smoke/test_accounts.py
   Intermittent failure detected: /marvin/tests/smoke/test_deploy_vm_with_userdata.py
   Intermittent failure detected: /marvin/tests/smoke/test_diagnostics.py
   Intermittent failure detected: /marvin/tests/smoke/test_domain_vpc_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_internal_lb.py
   Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_clusters.py
   Intermittent failure detected: /marvin/tests/smoke/test_loadbalance.py
   Intermittent failure detected: /marvin/tests/smoke/test_network_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_network.py
   Intermittent failure detected: /marvin/tests/smoke/test_password_server.py
   Intermittent failure detected: /marvin/tests/smoke/test_portforwardingrules.py
   Intermittent failure detected: /marvin/tests/smoke/test_privategw_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dhcphosts.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dns.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dnsservice.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_iptables_default_policy.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_network_ops.py
   Intermittent failure detected: /marvin/tests/smoke/test_scale_vm.py
   Intermittent failure detected: /marvin/tests/smoke/test_service_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_usage.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_life_cycle.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_snapshots.py
   Intermittent failure detected: /marvin/tests/smoke/test_volumes.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_router_nics.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_vpn.py
   Smoke tests completed. 60 look OK, 26 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   test_DeleteDomain | `Error` | 185.59 | test_accounts.py
   test_DeleteDomain | `Error` | 185.60 | test_accounts.py
   test_forceDeleteDomain | `Failure` | 174.35 | test_accounts.py
   test_forceDeleteDomain | `Error` | 174.35 | test_accounts.py
   ContextSuite context=TestLoadBalance>:setup | `Error` | 0.00 | test_loadbalance.py
   test_network_acl | `Error` | 36.94 | test_network_acl.py
   test_delete_account | `Error` | 88.72 | test_network.py
   test_01_port_fwd_on_src_nat | `Error` | 2.12 | test_network.py
   test_02_port_fwd_on_non_src_nat | `Error` | 7.31 | test_network.py
   test_reboot_router | `Error` | 193.57 | test_network.py
   test_releaseIP | `Error` | 75.50 | test_network.py
   test_network_rules_acquired_public_ip_1_static_nat_rule | `Error` | 3.17 | test_network.py
   test_network_rules_acquired_public_ip_2_nat_rule | `Error` | 3.16 | test_network.py
   test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | `Error` | 3.19 | test_network.py
   test_deployvm_userdata | `Error` | 40.09 | test_deploy_vm_with_userdata.py
   test_deployvm_userdata_post | `Error` | 7.42 | test_deploy_vm_with_userdata.py
   test_13_retrieve_vr_default_files | `Error` | 1.07 | test_diagnostics.py
   test_14_retrieve_vr_one_file | `Error` | 1.09 | test_diagnostics.py
   test_15_retrieve_ssvm_default_files | `Error` | 1.07 | test_diagnostics.py
   test_16_retrieve_ssvm_single_file | `Error` | 1.08 | test_diagnostics.py
   test_17_retrieve_cpvm_default_files | `Error` | 1.07 | test_diagnostics.py
   test_18_retrieve_cpvm_single_file | `Error` | 1.07 | test_diagnostics.py
   test_03_create_vpc_domain_vpc_offering | `Error` | 41.53 | test_domain_vpc_offerings.py
   test_isolate_network_password_server | `Error` | 2.10 | test_password_server.py
   test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 | `Failure` | 36.12 | test_internal_lb.py
   test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 | `Failure` | 37.15 | test_internal_lb.py
   test_03_vpc_internallb_haproxy_stats_on_all_interfaces | `Failure` | 39.13 | test_internal_lb.py
   test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | `Failure` | 40.08 | test_internal_lb.py
   test_01_vpc_privategw_acl | `Failure` | 36.12 | test_privategw_acl.py
   test_02_vpc_privategw_static_routes | `Failure` | 38.18 | test_privategw_acl.py
   test_03_vpc_privategw_restart_vpc_cleanup | `Failure` | 38.15 | test_privategw_acl.py
   test_04_rvpc_privategw_static_routes | `Failure` | 39.22 | test_privategw_acl.py
   test_01_deploy_kubernetes_cluster | `Failure` | 43.17 | test_kubernetes_clusters.py
   test_02_invalid_upgrade_kubernetes_cluster | `Failure` | 42.03 | test_kubernetes_clusters.py
   test_03_deploy_and_upgrade_kubernetes_cluster | `Failure` | 39.96 | test_kubernetes_clusters.py
   test_04_deploy_and_scale_kubernetes_cluster | `Failure` | 39.89 | test_kubernetes_clusters.py
   test_05_delete_kubernetes_cluster | `Failure` | 39.96 | test_kubernetes_clusters.py
   test_07_deploy_kubernetes_ha_cluster | `Failure` | 39.98 | test_kubernetes_clusters.py
   test_08_deploy_and_upgrade_kubernetes_ha_cluster | `Failure` | 46.26 | test_kubernetes_clusters.py
   test_09_delete_kubernetes_ha_cluster | `Failure` | 43.97 | test_kubernetes_clusters.py
   ContextSuite context=TestKubernetesCluster>:teardown | `Error` | 204.85 | test_kubernetes_clusters.py
   test_01_create_delete_portforwarding_fornonvpc | `Error` | 148.88 | test_portforwardingrules.py
   test_01_create_delete_portforwarding_fornonvpc | `Error` | 148.89 | test_portforwardingrules.py
   test_router_dhcphosts | `Error` | 2.12 | test_router_dhcphosts.py
   ContextSuite context=TestRouterDHCPHosts>:teardown | `Error` | 14.44 | test_router_dhcphosts.py
   test_router_dhcp_opts | `Error` | 2.15 | test_router_dhcphosts.py
   test_router_dns_guestipquery | `Error` | 2.13 | test_router_dns.py
   test_router_dns_guestipquery | `Error` | 2.11 | test_router_dnsservice.py
   test_01_single_VPC_iptables_policies | `Error` | 37.82 | test_routers_iptables_default_policy.py
   test_01_isolate_network_FW_PF_default_routes_egress_true | `Error` | 99.70 | test_routers_network_ops.py
   test_02_isolate_network_FW_PF_default_routes_egress_false | `Error` | 95.68 | test_routers_network_ops.py
   test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true | `Error` | 136.25 | test_routers_network_ops.py
   test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false | `Error` | 138.56 | test_routers_network_ops.py
   test_03_RVR_Network_check_router_state | `Failure` | 133.74 | test_routers_network_ops.py
   test_01_scale_vm | `Failure` | 10.28 | test_scale_vm.py
   test_04_change_offering_small | `Failure` | 820.09 | test_service_offerings.py
   test_01_lb_usage | `Error` | 2.13 | test_usage.py
   test_01_nat_usage | `Error` | 4.14 | test_usage.py
   test_01_vpn_usage | `Error` | 5.30 | test_usage.py
   test_10_attachAndDetach_iso | `Failure` | 722.72 | test_vm_life_cycle.py
   test_change_service_offering_for_vm_with_snapshots | `Failure` | 933.83 | test_vm_snapshots.py
   test_01_create_vm_snapshots | `Failure` | 715.51 | test_vm_snapshots.py
   test_02_revert_vm_snapshots | `Failure` | 720.08 | test_vm_snapshots.py
   test_03_delete_vm_snapshots | `Failure` | 0.02 | test_vm_snapshots.py
   test_01_create_volume | `Failure` | 721.90 | test_volumes.py
   test_02_attach_volume | `Failure` | 719.88 | test_volumes.py
   test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | `Error` | 40.20 | test_vpc_redundant.py
   test_02_redundant_VPC_default_routes | `Error` | 38.20 | test_vpc_redundant.py
   test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | `Error` | 37.16 | test_vpc_redundant.py
   test_04_rvpc_network_garbage_collector_nics | `Error` | 40.28 | test_vpc_redundant.py
   test_05_rvpc_multi_tiers | `Error` | 40.21 | test_vpc_redundant.py
   test_01_VPC_nics_after_destroy | `Error` | 39.20 | test_vpc_router_nics.py
   test_02_VPC_default_routes | `Error` | 35.14 | test_vpc_router_nics.py
   test_01_redundant_vpc_site2site_vpn | `Failure` | 36.95 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn_multiple_options | `Failure` | 34.87 | test_vpc_vpn.py
   test_01_vpc_remote_access_vpn | `Failure` | 35.88 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn | `Failure` | 35.85 | test_vpc_vpn.py
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan removed a comment on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan removed a comment on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-828244169






-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-794536302


   <b>Trillian test result (tid-3674)</b>
   Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
   Total time taken: 44526 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t3674-kvm-centos7.zip
   Intermittent failure detected: /marvin/tests/smoke/test_accounts.py
   Intermittent failure detected: /marvin/tests/smoke/test_deploy_virtio_scsi_vm.py
   Intermittent failure detected: /marvin/tests/smoke/test_deploy_vm_with_userdata.py
   Intermittent failure detected: /marvin/tests/smoke/test_diagnostics.py
   Intermittent failure detected: /marvin/tests/smoke/test_domain_vpc_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_internal_lb.py
   Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_clusters.py
   Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_supported_versions.py
   Intermittent failure detected: /marvin/tests/smoke/test_loadbalance.py
   Intermittent failure detected: /marvin/tests/smoke/test_migration.py
   Intermittent failure detected: /marvin/tests/smoke/test_network_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_network.py
   Intermittent failure detected: /marvin/tests/smoke/test_password_server.py
   Intermittent failure detected: /marvin/tests/smoke/test_portforwardingrules.py
   Intermittent failure detected: /marvin/tests/smoke/test_privategw_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dhcphosts.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dns.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dnsservice.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_iptables_default_policy.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_network_ops.py
   Intermittent failure detected: /marvin/tests/smoke/test_service_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_usage.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_life_cycle.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_snapshots.py
   Intermittent failure detected: /marvin/tests/smoke/test_volumes.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_router_nics.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_vpn.py
   Smoke tests completed. 59 look OK, 27 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   test_DeleteDomain | `Error` | 142.16 | test_accounts.py
   test_DeleteDomain | `Error` | 142.18 | test_accounts.py
   test_forceDeleteDomain | `Failure` | 141.12 | test_accounts.py
   test_forceDeleteDomain | `Error` | 141.13 | test_accounts.py
   ContextSuite context=TestLoadBalance>:setup | `Error` | 0.00 | test_loadbalance.py
   test_04_verify_guest_lspci | `Error` | 715.46 | test_deploy_virtio_scsi_vm.py
   test_06_verify_guest_lspci_again | `Error` | 715.68 | test_deploy_virtio_scsi_vm.py
   test_01_native_to_native_network_migration | `Error` | 38.69 | test_migration.py
   test_02_native_to_native_vpc_migration | `Error` | 22.82 | test_migration.py
   test_network_acl | `Error` | 21.98 | test_network_acl.py
   test_deployvm_userdata | `Error` | 24.22 | test_deploy_vm_with_userdata.py
   test_deployvm_userdata_post | `Error` | 5.52 | test_deploy_vm_with_userdata.py
   test_delete_account | `Error` | 59.31 | test_network.py
   test_01_port_fwd_on_src_nat | `Error` | 2.22 | test_network.py
   test_02_port_fwd_on_non_src_nat | `Error` | 6.51 | test_network.py
   test_reboot_router | `Error` | 175.36 | test_network.py
   test_releaseIP | `Error` | 56.19 | test_network.py
   test_network_rules_acquired_public_ip_1_static_nat_rule | `Error` | 3.35 | test_network.py
   test_network_rules_acquired_public_ip_2_nat_rule | `Error` | 3.32 | test_network.py
   test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | `Error` | 3.38 | test_network.py
   test_13_retrieve_vr_default_files | `Error` | 1.13 | test_diagnostics.py
   test_14_retrieve_vr_one_file | `Error` | 1.15 | test_diagnostics.py
   test_15_retrieve_ssvm_default_files | `Error` | 1.14 | test_diagnostics.py
   test_16_retrieve_ssvm_single_file | `Error` | 1.16 | test_diagnostics.py
   test_17_retrieve_cpvm_default_files | `Error` | 1.16 | test_diagnostics.py
   test_18_retrieve_cpvm_single_file | `Error` | 1.14 | test_diagnostics.py
   test_03_create_vpc_domain_vpc_offering | `Error` | 24.34 | test_domain_vpc_offerings.py
   test_isolate_network_password_server | `Error` | 2.23 | test_password_server.py
   test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 | `Failure` | 23.98 | test_internal_lb.py
   test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 | `Failure` | 25.32 | test_internal_lb.py
   test_03_vpc_internallb_haproxy_stats_on_all_interfaces | `Failure` | 21.48 | test_internal_lb.py
   test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | `Failure` | 27.77 | test_internal_lb.py
   test_01_vpc_privategw_acl | `Failure` | 21.64 | test_privategw_acl.py
   test_02_vpc_privategw_static_routes | `Failure` | 21.58 | test_privategw_acl.py
   test_03_vpc_privategw_restart_vpc_cleanup | `Failure` | 21.57 | test_privategw_acl.py
   test_04_rvpc_privategw_static_routes | `Failure` | 23.72 | test_privategw_acl.py
   test_01_deploy_kubernetes_cluster | `Failure` | 25.71 | test_kubernetes_clusters.py
   test_02_invalid_upgrade_kubernetes_cluster | `Failure` | 24.24 | test_kubernetes_clusters.py
   test_03_deploy_and_upgrade_kubernetes_cluster | `Failure` | 26.20 | test_kubernetes_clusters.py
   test_04_deploy_and_scale_kubernetes_cluster | `Failure` | 26.16 | test_kubernetes_clusters.py
   test_05_delete_kubernetes_cluster | `Failure` | 22.04 | test_kubernetes_clusters.py
   test_07_deploy_kubernetes_ha_cluster | `Failure` | 24.17 | test_kubernetes_clusters.py
   test_08_deploy_and_upgrade_kubernetes_ha_cluster | `Failure` | 23.07 | test_kubernetes_clusters.py
   test_09_delete_kubernetes_ha_cluster | `Failure` | 28.21 | test_kubernetes_clusters.py
   ContextSuite context=TestKubernetesCluster>:teardown | `Error` | 261.38 | test_kubernetes_clusters.py
   test_01_create_delete_portforwarding_fornonvpc | `Error` | 99.59 | test_portforwardingrules.py
   test_01_create_delete_portforwarding_fornonvpc | `Error` | 99.60 | test_portforwardingrules.py
   test_router_dhcphosts | `Error` | 2.24 | test_router_dhcphosts.py
   ContextSuite context=TestRouterDHCPHosts>:teardown | `Error` | 11.67 | test_router_dhcphosts.py
   test_router_dhcp_opts | `Error` | 1.26 | test_router_dhcphosts.py
   test_router_dns_guestipquery | `Error` | 2.22 | test_router_dns.py
   test_router_dns_guestipquery | `Error` | 2.22 | test_router_dnsservice.py
   test_01_single_VPC_iptables_policies | `Error` | 20.96 | test_routers_iptables_default_policy.py
   test_01_isolate_network_FW_PF_default_routes_egress_true | `Error` | 66.99 | test_routers_network_ops.py
   test_02_isolate_network_FW_PF_default_routes_egress_false | `Error` | 68.06 | test_routers_network_ops.py
   test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true | `Error` | 97.39 | test_routers_network_ops.py
   test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false | `Error` | 96.03 | test_routers_network_ops.py
   test_03_RVR_Network_check_router_state | `Failure` | 93.82 | test_routers_network_ops.py
   test_01_service_offering_cpu_limit_use | `Error` | 715.99 | test_service_offerings.py
   test_04_change_offering_small | `Failure` | 819.72 | test_service_offerings.py
   test_01_lb_usage | `Error` | 1.23 | test_usage.py
   test_01_nat_usage | `Error` | 3.21 | test_usage.py
   test_01_vpn_usage | `Error` | 4.51 | test_usage.py
   ContextSuite context=TestSecuredVmMigration>:teardown | `Error` | 310.08 | test_vm_life_cycle.py
   ContextSuite context=TestVMLifeCycle>:setup | `Error` | 6.36 | test_vm_life_cycle.py
   test_01_create_vm_snapshots | `Failure` | 715.71 | test_vm_snapshots.py
   test_02_revert_vm_snapshots | `Failure` | 720.40 | test_vm_snapshots.py
   test_03_delete_vm_snapshots | `Failure` | 0.02 | test_vm_snapshots.py
   test_01_create_volume | `Failure` | 721.25 | test_volumes.py
   test_02_attach_volume | `Failure` | 751.20 | test_volumes.py
   test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | `Error` | 24.75 | test_vpc_redundant.py
   test_02_redundant_VPC_default_routes | `Error` | 23.67 | test_vpc_redundant.py
   test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | `Error` | 23.69 | test_vpc_redundant.py
   test_04_rvpc_network_garbage_collector_nics | `Error` | 24.72 | test_vpc_redundant.py
   test_05_rvpc_multi_tiers | `Error` | 23.71 | test_vpc_redundant.py
   test_01_VPC_nics_after_destroy | `Error` | 21.61 | test_vpc_router_nics.py
   test_02_VPC_default_routes | `Error` | 22.62 | test_vpc_router_nics.py
   test_01_redundant_vpc_site2site_vpn | `Failure` | 24.29 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn_multiple_options | `Failure` | 22.12 | test_vpc_vpn.py
   test_01_vpc_remote_access_vpn | `Failure` | 20.87 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn | `Failure` | 23.16 | test_vpc_vpn.py
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-795182629


   Packaging result: :heavy_check_mark: centos7 :heavy_check_mark: centos8 :heavy_check_mark: debian. SL-JID 71


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] GabrielBrascher commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
GabrielBrascher commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-791489934


   It is worthy to mention that my tests have been executed only on _Advanced network with Security groups_; which means that I tested the simplest VR scenario where most of the work is done on the KVM side.
   
   We need to test other services from VR in order to verify if there are missing changes on VR scripts.
   Any help with that is very welcome :-)


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-791823884


   <b>Trillian test result (tid-3662)</b>
   Environment: xenserver-74 (x2), Advanced Networking with Mgmt server 7
   Total time taken: 53599 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t3662-xenserver-74.zip
   Intermittent failure detected: /marvin/tests/smoke/test_accounts.py
   Intermittent failure detected: /marvin/tests/smoke/test_deploy_vm_with_userdata.py
   Intermittent failure detected: /marvin/tests/smoke/test_diagnostics.py
   Intermittent failure detected: /marvin/tests/smoke/test_domain_vpc_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_internal_lb.py
   Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_clusters.py
   Intermittent failure detected: /marvin/tests/smoke/test_loadbalance.py
   Intermittent failure detected: /marvin/tests/smoke/test_network_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_network.py
   Intermittent failure detected: /marvin/tests/smoke/test_password_server.py
   Intermittent failure detected: /marvin/tests/smoke/test_portforwardingrules.py
   Intermittent failure detected: /marvin/tests/smoke/test_privategw_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dhcphosts.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dns.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dnsservice.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_iptables_default_policy.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_network_ops.py
   Intermittent failure detected: /marvin/tests/smoke/test_scale_vm.py
   Intermittent failure detected: /marvin/tests/smoke/test_service_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_usage.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_life_cycle.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_snapshots.py
   Intermittent failure detected: /marvin/tests/smoke/test_volumes.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_router_nics.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_vpn.py
   Smoke tests completed. 60 look OK, 26 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   test_DeleteDomain | `Error` | 292.54 | test_accounts.py
   test_DeleteDomain | `Error` | 292.55 | test_accounts.py
   test_forceDeleteDomain | `Failure` | 283.22 | test_accounts.py
   test_forceDeleteDomain | `Error` | 283.23 | test_accounts.py
   ContextSuite context=TestLoadBalance>:setup | `Error` | 0.00 | test_loadbalance.py
   test_network_acl | `Error` | 70.43 | test_network_acl.py
   test_delete_account | `Error` | 150.70 | test_network.py
   test_01_port_fwd_on_src_nat | `Error` | 4.17 | test_network.py
   test_02_port_fwd_on_non_src_nat | `Error` | 12.42 | test_network.py
   test_reboot_router | `Error` | 237.32 | test_network.py
   test_releaseIP | `Error` | 120.23 | test_network.py
   test_network_rules_acquired_public_ip_1_static_nat_rule | `Error` | 5.20 | test_network.py
   test_network_rules_acquired_public_ip_2_nat_rule | `Error` | 5.20 | test_network.py
   test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | `Error` | 5.20 | test_network.py
   test_deployvm_userdata | `Error` | 78.73 | test_deploy_vm_with_userdata.py
   test_deployvm_userdata_post | `Error` | 12.46 | test_deploy_vm_with_userdata.py
   test_13_retrieve_vr_default_files | `Error` | 1.07 | test_diagnostics.py
   test_14_retrieve_vr_one_file | `Error` | 1.07 | test_diagnostics.py
   test_15_retrieve_ssvm_default_files | `Error` | 1.08 | test_diagnostics.py
   test_16_retrieve_ssvm_single_file | `Error` | 1.09 | test_diagnostics.py
   test_17_retrieve_cpvm_default_files | `Error` | 1.07 | test_diagnostics.py
   test_18_retrieve_cpvm_single_file | `Error` | 1.07 | test_diagnostics.py
   test_03_create_vpc_domain_vpc_offering | `Error` | 73.05 | test_domain_vpc_offerings.py
   test_isolate_network_password_server | `Error` | 4.14 | test_password_server.py
   test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 | `Failure` | 76.89 | test_internal_lb.py
   test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 | `Failure` | 77.95 | test_internal_lb.py
   test_03_vpc_internallb_haproxy_stats_on_all_interfaces | `Failure` | 74.73 | test_internal_lb.py
   test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | `Failure` | 77.88 | test_internal_lb.py
   test_01_vpc_privategw_acl | `Failure` | 72.68 | test_privategw_acl.py
   test_02_vpc_privategw_static_routes | `Failure` | 75.79 | test_privategw_acl.py
   test_03_vpc_privategw_restart_vpc_cleanup | `Failure` | 75.77 | test_privategw_acl.py
   test_04_rvpc_privategw_static_routes | `Failure` | 83.95 | test_privategw_acl.py
   test_01_deploy_kubernetes_cluster | `Failure` | 81.07 | test_kubernetes_clusters.py
   test_02_invalid_upgrade_kubernetes_cluster | `Failure` | 83.81 | test_kubernetes_clusters.py
   test_03_deploy_and_upgrade_kubernetes_cluster | `Failure` | 81.81 | test_kubernetes_clusters.py
   test_04_deploy_and_scale_kubernetes_cluster | `Failure` | 79.69 | test_kubernetes_clusters.py
   test_05_delete_kubernetes_cluster | `Failure` | 82.72 | test_kubernetes_clusters.py
   test_07_deploy_kubernetes_ha_cluster | `Failure` | 83.73 | test_kubernetes_clusters.py
   test_08_deploy_and_upgrade_kubernetes_ha_cluster | `Failure` | 82.82 | test_kubernetes_clusters.py
   test_09_delete_kubernetes_ha_cluster | `Failure` | 82.67 | test_kubernetes_clusters.py
   ContextSuite context=TestKubernetesCluster>:teardown | `Error` | 258.06 | test_kubernetes_clusters.py
   test_01_create_delete_portforwarding_fornonvpc | `Error` | 202.76 | test_portforwardingrules.py
   test_01_create_delete_portforwarding_fornonvpc | `Error` | 202.77 | test_portforwardingrules.py
   test_router_dhcphosts | `Error` | 4.15 | test_router_dhcphosts.py
   ContextSuite context=TestRouterDHCPHosts>:teardown | `Error` | 18.49 | test_router_dhcphosts.py
   test_router_dhcp_opts | `Error` | 4.22 | test_router_dhcphosts.py
   test_router_dns_guestipquery | `Error` | 4.18 | test_router_dns.py
   test_router_dns_guestipquery | `Error` | 4.15 | test_router_dnsservice.py
   test_01_single_VPC_iptables_policies | `Error` | 69.44 | test_routers_iptables_default_policy.py
   test_01_isolate_network_FW_PF_default_routes_egress_true | `Error` | 157.65 | test_routers_network_ops.py
   test_02_isolate_network_FW_PF_default_routes_egress_false | `Error` | 133.22 | test_routers_network_ops.py
   test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true | `Error` | 250.35 | test_routers_network_ops.py
   test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false | `Error` | 246.99 | test_routers_network_ops.py
   test_03_RVR_Network_check_router_state | `Failure` | 229.02 | test_routers_network_ops.py
   test_01_scale_vm | `Failure` | 14.29 | test_scale_vm.py
   test_04_change_offering_small | `Failure` | 830.82 | test_service_offerings.py
   test_01_lb_usage | `Error` | 3.18 | test_usage.py
   test_01_nat_usage | `Error` | 7.32 | test_usage.py
   test_01_vpn_usage | `Error` | 10.35 | test_usage.py
   test_10_attachAndDetach_iso | `Failure` | 725.67 | test_vm_life_cycle.py
   test_change_service_offering_for_vm_with_snapshots | `Failure` | 995.87 | test_vm_snapshots.py
   test_01_create_vm_snapshots | `Failure` | 715.45 | test_vm_snapshots.py
   test_02_revert_vm_snapshots | `Failure` | 720.28 | test_vm_snapshots.py
   test_03_delete_vm_snapshots | `Failure` | 0.02 | test_vm_snapshots.py
   test_01_create_volume | `Failure` | 721.81 | test_volumes.py
   test_02_attach_volume | `Failure` | 722.86 | test_volumes.py
   test_11_migrate_volume_and_change_offering | `Error` | 9.36 | test_volumes.py
   test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | `Error` | 71.82 | test_vpc_redundant.py
   test_02_redundant_VPC_default_routes | `Error` | 71.79 | test_vpc_redundant.py
   test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | `Error` | 75.87 | test_vpc_redundant.py
   test_04_rvpc_network_garbage_collector_nics | `Error` | 71.76 | test_vpc_redundant.py
   test_05_rvpc_multi_tiers | `Error` | 72.79 | test_vpc_redundant.py
   test_01_VPC_nics_after_destroy | `Error` | 70.75 | test_vpc_router_nics.py
   test_02_VPC_default_routes | `Error` | 73.83 | test_vpc_router_nics.py
   test_01_redundant_vpc_site2site_vpn | `Failure` | 77.77 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn_multiple_options | `Failure` | 74.58 | test_vpc_vpn.py
   test_01_vpc_remote_access_vpn | `Failure` | 71.43 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn | `Failure` | 75.55 | test_vpc_vpn.py
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-794491782


   <b>Trillian test result (tid-3678)</b>
   Environment: xenserver-72 (x2), Advanced Networking with Mgmt server 7
   Total time taken: 42094 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t3678-xenserver-72.zip
   Intermittent failure detected: /marvin/tests/smoke/test_accounts.py
   Intermittent failure detected: /marvin/tests/smoke/test_deploy_vm_with_userdata.py
   Intermittent failure detected: /marvin/tests/smoke/test_diagnostics.py
   Intermittent failure detected: /marvin/tests/smoke/test_domain_vpc_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_human_readable_logs.py
   Intermittent failure detected: /marvin/tests/smoke/test_internal_lb.py
   Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_clusters.py
   Intermittent failure detected: /marvin/tests/smoke/test_loadbalance.py
   Intermittent failure detected: /marvin/tests/smoke/test_network_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_network.py
   Intermittent failure detected: /marvin/tests/smoke/test_password_server.py
   Intermittent failure detected: /marvin/tests/smoke/test_portforwardingrules.py
   Intermittent failure detected: /marvin/tests/smoke/test_privategw_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dhcphosts.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dns.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dnsservice.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_iptables_default_policy.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_network_ops.py
   Intermittent failure detected: /marvin/tests/smoke/test_scale_vm.py
   Intermittent failure detected: /marvin/tests/smoke/test_service_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_usage.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_life_cycle.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_snapshots.py
   Intermittent failure detected: /marvin/tests/smoke/test_volumes.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_router_nics.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_vpn.py
   Smoke tests completed. 60 look OK, 26 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   test_DeleteDomain | `Error` | 200.67 | test_accounts.py
   test_DeleteDomain | `Error` | 200.68 | test_accounts.py
   test_forceDeleteDomain | `Failure` | 181.24 | test_accounts.py
   test_forceDeleteDomain | `Error` | 181.24 | test_accounts.py
   ContextSuite context=TestLoadBalance>:setup | `Error` | 0.00 | test_loadbalance.py
   test_network_acl | `Error` | 37.31 | test_network_acl.py
   test_delete_account | `Error` | 91.25 | test_network.py
   test_01_port_fwd_on_src_nat | `Error` | 2.22 | test_network.py
   test_02_port_fwd_on_non_src_nat | `Error` | 7.59 | test_network.py
   test_reboot_router | `Error` | 195.78 | test_network.py
   test_releaseIP | `Error` | 77.87 | test_network.py
   test_network_rules_acquired_public_ip_1_static_nat_rule | `Error` | 3.31 | test_network.py
   test_network_rules_acquired_public_ip_2_nat_rule | `Error` | 3.30 | test_network.py
   test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | `Error` | 3.34 | test_network.py
   test_deployvm_userdata | `Error` | 41.95 | test_deploy_vm_with_userdata.py
   test_deployvm_userdata_post | `Error` | 9.94 | test_deploy_vm_with_userdata.py
   test_13_retrieve_vr_default_files | `Error` | 1.12 | test_diagnostics.py
   test_14_retrieve_vr_one_file | `Error` | 1.16 | test_diagnostics.py
   test_15_retrieve_ssvm_default_files | `Error` | 1.12 | test_diagnostics.py
   test_16_retrieve_ssvm_single_file | `Error` | 1.13 | test_diagnostics.py
   test_17_retrieve_cpvm_default_files | `Error` | 1.13 | test_diagnostics.py
   test_18_retrieve_cpvm_single_file | `Error` | 1.14 | test_diagnostics.py
   test_03_create_vpc_domain_vpc_offering | `Error` | 45.92 | test_domain_vpc_offerings.py
   test_isolate_network_password_server | `Error` | 3.24 | test_password_server.py
   test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 | `Failure` | 43.22 | test_internal_lb.py
   test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 | `Failure` | 40.02 | test_internal_lb.py
   test_03_vpc_internallb_haproxy_stats_on_all_interfaces | `Failure` | 38.81 | test_internal_lb.py
   test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | `Failure` | 40.09 | test_internal_lb.py
   test_01_vpc_privategw_acl | `Failure` | 38.12 | test_privategw_acl.py
   test_02_vpc_privategw_static_routes | `Failure` | 38.19 | test_privategw_acl.py
   test_03_vpc_privategw_restart_vpc_cleanup | `Failure` | 37.07 | test_privategw_acl.py
   test_04_rvpc_privategw_static_routes | `Failure` | 40.34 | test_privategw_acl.py
   test_01_deploy_kubernetes_cluster | `Failure` | 48.57 | test_kubernetes_clusters.py
   test_02_invalid_upgrade_kubernetes_cluster | `Failure` | 43.80 | test_kubernetes_clusters.py
   test_03_deploy_and_upgrade_kubernetes_cluster | `Failure` | 43.66 | test_kubernetes_clusters.py
   test_04_deploy_and_scale_kubernetes_cluster | `Failure` | 44.69 | test_kubernetes_clusters.py
   test_05_delete_kubernetes_cluster | `Failure` | 43.57 | test_kubernetes_clusters.py
   test_07_deploy_kubernetes_ha_cluster | `Failure` | 43.83 | test_kubernetes_clusters.py
   test_08_deploy_and_upgrade_kubernetes_ha_cluster | `Failure` | 48.92 | test_kubernetes_clusters.py
   test_09_delete_kubernetes_ha_cluster | `Failure` | 45.80 | test_kubernetes_clusters.py
   ContextSuite context=TestKubernetesCluster>:teardown | `Error` | 224.37 | test_kubernetes_clusters.py
   test_01_create_delete_portforwarding_fornonvpc | `Error` | 155.17 | test_portforwardingrules.py
   test_01_create_delete_portforwarding_fornonvpc | `Error` | 155.18 | test_portforwardingrules.py
   test_router_dhcphosts | `Error` | 2.21 | test_router_dhcphosts.py
   ContextSuite context=TestRouterDHCPHosts>:teardown | `Error` | 12.64 | test_router_dhcphosts.py
   test_router_dhcp_opts | `Error` | 2.27 | test_router_dhcphosts.py
   test_router_dns_guestipquery | `Error` | 2.21 | test_router_dns.py
   test_router_dns_guestipquery | `Error` | 2.21 | test_router_dnsservice.py
   test_01_single_VPC_iptables_policies | `Error` | 39.43 | test_routers_iptables_default_policy.py
   test_01_isolate_network_FW_PF_default_routes_egress_true | `Error` | 101.81 | test_routers_network_ops.py
   test_02_isolate_network_FW_PF_default_routes_egress_false | `Error` | 88.50 | test_routers_network_ops.py
   test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true | `Error` | 152.15 | test_routers_network_ops.py
   test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false | `Error` | 139.74 | test_routers_network_ops.py
   test_03_RVR_Network_check_router_state | `Failure` | 138.51 | test_routers_network_ops.py
   test_01_scale_vm | `Failure` | 9.38 | test_scale_vm.py
   test_04_change_offering_small | `Failure` | 819.91 | test_service_offerings.py
   test_01_lb_usage | `Error` | 3.29 | test_usage.py
   test_01_nat_usage | `Error` | 4.24 | test_usage.py
   test_01_vpn_usage | `Error` | 5.50 | test_usage.py
   test_10_attachAndDetach_iso | `Failure` | 722.73 | test_vm_life_cycle.py
   test_change_service_offering_for_vm_with_snapshots | `Failure` | 944.30 | test_vm_snapshots.py
   test_01_create_vm_snapshots | `Failure` | 715.52 | test_vm_snapshots.py
   test_02_revert_vm_snapshots | `Failure` | 720.09 | test_vm_snapshots.py
   test_03_delete_vm_snapshots | `Failure` | 0.02 | test_vm_snapshots.py
   test_01_create_volume | `Failure` | 721.23 | test_volumes.py
   test_02_attach_volume | `Failure` | 720.15 | test_volumes.py
   test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | `Error` | 48.43 | test_vpc_redundant.py
   test_02_redundant_VPC_default_routes | `Error` | 40.19 | test_vpc_redundant.py
   test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | `Error` | 42.32 | test_vpc_redundant.py
   test_04_rvpc_network_garbage_collector_nics | `Error` | 40.22 | test_vpc_redundant.py
   test_05_rvpc_multi_tiers | `Error` | 39.11 | test_vpc_redundant.py
   test_01_VPC_nics_after_destroy | `Error` | 39.23 | test_vpc_router_nics.py
   test_02_VPC_default_routes | `Error` | 38.05 | test_vpc_router_nics.py
   test_01_redundant_vpc_site2site_vpn | `Failure` | 42.59 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn_multiple_options | `Failure` | 35.37 | test_vpc_vpn.py
   test_01_vpc_remote_access_vpn | `Failure` | 35.20 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn | `Failure` | 39.52 | test_vpc_vpn.py
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] rhtyd commented on a change in pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
rhtyd commented on a change in pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#discussion_r588120454



##########
File path: packaging/centos7/cloud.spec
##########
@@ -418,6 +424,8 @@ fi
 # Install mysql-connector-python
 pip3 install %{_datadir}/%{name}-management/setup/wheel/six-1.15.0-py2.py3-none-any.whl %{_datadir}/%{name}-management/setup/wheel/setuptools-47.3.1-py3-none-any.whl %{_datadir}/%{name}-management/setup/wheel/protobuf-3.12.2-cp36-cp36m-manylinux1_x86_64.whl %{_datadir}/%{name}-management/setup/wheel/mysql_connector_python-8.0.20-cp36-cp36m-manylinux1_x86_64.whl
 
+pip3 install urllib3

Review comment:
       @DaanHoogland why do we need it for cloudstack-management pkg?




----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan removed a comment on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan removed a comment on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-795040999


   <b>[S] Trillian test result (tid-62)</b>
   Environment: kvm-ubuntu20 (x2), Advanced Networking with Mgmt server u20
   Total time taken: 66417 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t62-kvm-ubuntu20.zip
   Intermittent failure detected: /marvin/tests/smoke/test_accounts.py
   Intermittent failure detected: /marvin/tests/smoke/test_deploy_virtio_scsi_vm.py
   Intermittent failure detected: /marvin/tests/smoke/test_deploy_vm_with_userdata.py
   Intermittent failure detected: /marvin/tests/smoke/test_diagnostics.py
   Intermittent failure detected: /marvin/tests/smoke/test_domain_vpc_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_internal_lb.py
   Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_clusters.py
   Intermittent failure detected: /marvin/tests/smoke/test_loadbalance.py
   Intermittent failure detected: /marvin/tests/smoke/test_migration.py
   Intermittent failure detected: /marvin/tests/smoke/test_network_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_network.py
   Intermittent failure detected: /marvin/tests/smoke/test_password_server.py
   Intermittent failure detected: /marvin/tests/smoke/test_portforwardingrules.py
   Intermittent failure detected: /marvin/tests/smoke/test_privategw_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_reset_vm_on_reboot.py
   Intermittent failure detected: /marvin/tests/smoke/test_resource_accounting.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dhcphosts.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dns.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dnsservice.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_iptables_default_policy.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_network_ops.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers.py
   Intermittent failure detected: /marvin/tests/smoke/test_service_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_snapshots.py
   Intermittent failure detected: /marvin/tests/smoke/test_ssvm.py
   Intermittent failure detected: /marvin/tests/smoke/test_usage.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_life_cycle.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_snapshots.py
   Intermittent failure detected: /marvin/tests/smoke/test_volumes.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_router_nics.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_vpn.py
   Intermittent failure detected: /marvin/tests/smoke/test_hostha_kvm.py
   Smoke tests completed. 54 look OK, 32 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   ContextSuite context=TestLoadBalance>:setup | `Error` | 0.00 | test_loadbalance.py
   test_DeleteDomain | `Error` | 152.28 | test_accounts.py
   test_DeleteDomain | `Error` | 152.29 | test_accounts.py
   test_forceDeleteDomain | `Failure` | 146.99 | test_accounts.py
   test_forceDeleteDomain | `Error` | 147.00 | test_accounts.py
   test_01_native_to_native_network_migration | `Error` | 44.85 | test_migration.py
   test_02_native_to_native_vpc_migration | `Error` | 29.33 | test_migration.py
   test_04_verify_guest_lspci | `Error` | 600.65 | test_deploy_virtio_scsi_vm.py
   test_06_verify_guest_lspci_again | `Error` | 600.72 | test_deploy_virtio_scsi_vm.py
   test_network_acl | `Error` | 28.94 | test_network_acl.py
   test_delete_account | `Error` | 67.89 | test_network.py
   test_01_port_fwd_on_src_nat | `Error` | 2.21 | test_network.py
   test_02_port_fwd_on_non_src_nat | `Error` | 7.48 | test_network.py
   test_reboot_router | `Error` | 182.76 | test_network.py
   test_releaseIP | `Error` | 68.96 | test_network.py
   test_network_rules_acquired_public_ip_1_static_nat_rule | `Error` | 3.35 | test_network.py
   test_network_rules_acquired_public_ip_2_nat_rule | `Error` | 3.25 | test_network.py
   test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | `Error` | 3.25 | test_network.py
   ContextSuite context=TestDeployVmWithUserData>:setup | `Error` | 0.00 | test_deploy_vm_with_userdata.py
   test_13_retrieve_vr_default_files | `Error` | 1.15 | test_diagnostics.py
   test_14_retrieve_vr_one_file | `Error` | 1.15 | test_diagnostics.py
   test_15_retrieve_ssvm_default_files | `Error` | 1.15 | test_diagnostics.py
   test_16_retrieve_ssvm_single_file | `Error` | 1.15 | test_diagnostics.py
   test_17_retrieve_cpvm_default_files | `Error` | 1.15 | test_diagnostics.py
   test_18_retrieve_cpvm_single_file | `Error` | 1.13 | test_diagnostics.py
   test_isolate_network_password_server | `Error` | 2.20 | test_password_server.py
   test_03_create_vpc_domain_vpc_offering | `Error` | 32.93 | test_domain_vpc_offerings.py
   test_01_vpc_privategw_acl | `Failure` | 30.36 | test_privategw_acl.py
   test_02_vpc_privategw_static_routes | `Error` | 0.39 | test_privategw_acl.py
   test_03_vpc_privategw_restart_vpc_cleanup | `Failure` | 27.30 | test_privategw_acl.py
   test_04_rvpc_privategw_static_routes | `Error` | 0.46 | test_privategw_acl.py
   test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 | `Failure` | 30.69 | test_internal_lb.py
   test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 | `Failure` | 32.78 | test_internal_lb.py
   test_03_vpc_internallb_haproxy_stats_on_all_interfaces | `Failure` | 29.41 | test_internal_lb.py
   test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | `Failure` | 32.46 | test_internal_lb.py
   test_01_deploy_kubernetes_cluster | `Failure` | 34.38 | test_kubernetes_clusters.py
   test_02_invalid_upgrade_kubernetes_cluster | `Failure` | 33.19 | test_kubernetes_clusters.py
   test_03_deploy_and_upgrade_kubernetes_cluster | `Failure` | 34.19 | test_kubernetes_clusters.py
   test_04_deploy_and_scale_kubernetes_cluster | `Failure` | 34.06 | test_kubernetes_clusters.py
   test_05_delete_kubernetes_cluster | `Failure` | 34.13 | test_kubernetes_clusters.py
   test_07_deploy_kubernetes_ha_cluster | `Failure` | 34.14 | test_kubernetes_clusters.py
   test_08_deploy_and_upgrade_kubernetes_ha_cluster | `Failure` | 34.17 | test_kubernetes_clusters.py
   test_09_delete_kubernetes_ha_cluster | `Failure` | 33.13 | test_kubernetes_clusters.py
   ContextSuite context=TestKubernetesCluster>:teardown | `Error` | 166.85 | test_kubernetes_clusters.py
   test_01_create_delete_portforwarding_fornonvpc | `Error` | 111.91 | test_portforwardingrules.py
   test_01_create_delete_portforwarding_fornonvpc | `Error` | 111.92 | test_portforwardingrules.py
   ContextSuite context=TestResetVmOnReboot>:setup | `Error` | 0.00 | test_reset_vm_on_reboot.py
   runTest | `Error` | 0.00 | test_hostha_kvm.py
   ContextSuite context=TestRAMCPUResourceAccounting>:setup | `Error` | 0.00 | test_resource_accounting.py
   ContextSuite context=TestRouterDHCPHosts>:setup | `Error` | 0.00 | test_router_dhcphosts.py
   ContextSuite context=TestRouterDHCPOpts>:setup | `Error` | 0.00 | test_router_dhcphosts.py
   ContextSuite context=TestRouterDns>:setup | `Error` | 0.00 | test_router_dns.py
   ContextSuite context=TestRouterDnsService>:setup | `Error` | 0.00 | test_router_dnsservice.py
   ContextSuite context=TestRouterIpTablesPolicies>:setup | `Error` | 0.00 | test_routers_iptables_default_policy.py
   ContextSuite context=TestVPCIpTablesPolicies>:setup | `Error` | 0.00 | test_routers_iptables_default_policy.py
   ContextSuite context=TestIsolatedNetworks>:setup | `Error` | 0.00 | test_routers_network_ops.py
   ContextSuite context=TestRedundantIsolateNetworks>:setup | `Error` | 0.00 | test_routers_network_ops.py
   ContextSuite context=TestRouterServices>:setup | `Error` | 0.00 | test_routers.py
   ContextSuite context=TestCpuCapServiceOfferings>:setup | `Error` | 0.00 | test_service_offerings.py
   ContextSuite context=TestServiceOfferings>:setup | `Error` | 0.20 | test_service_offerings.py
   ContextSuite context=TestSnapshotRootDisk>:setup | `Error` | 0.00 | test_snapshots.py
   test_01_lb_usage | `Error` | 2.22 | test_usage.py
   test_01_nat_usage | `Error` | 4.21 | test_usage.py
   test_01_vpn_usage | `Error` | 5.42 | test_usage.py
   runTest | `Error` | 0.00 | test_vm_life_cycle.py
   runTest | `Error` | 0.00 | test_vm_life_cycle.py
   test_01_create_vm_snapshots | `Failure` | 600.81 | test_vm_snapshots.py
   test_02_revert_vm_snapshots | `Failure` | 600.71 | test_vm_snapshots.py
   test_03_delete_vm_snapshots | `Failure` | 0.02 | test_vm_snapshots.py
   test_01_create_volume | `Failure` | 606.09 | test_volumes.py
   test_02_attach_volume | `Failure` | 643.08 | test_volumes.py
   test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | `Error` | 30.35 | test_vpc_redundant.py
   test_02_redundant_VPC_default_routes | `Error` | 31.48 | test_vpc_redundant.py
   test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | `Error` | 32.48 | test_vpc_redundant.py
   test_04_rvpc_network_garbage_collector_nics | `Error` | 29.31 | test_vpc_redundant.py
   test_05_rvpc_multi_tiers | `Error` | 32.39 | test_vpc_redundant.py
   test_01_VPC_nics_after_destroy | `Error` | 29.35 | test_vpc_router_nics.py
   test_02_VPC_default_routes | `Error` | 30.42 | test_vpc_router_nics.py
   test_01_redundant_vpc_site2site_vpn | `Failure` | 32.16 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn_multiple_options | `Failure` | 30.00 | test_vpc_vpn.py
   test_01_vpc_remote_access_vpn | `Failure` | 28.82 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn | `Failure` | 28.05 | test_vpc_vpn.py
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan removed a comment on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan removed a comment on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-788057521


   Packaging result: ✖centos7 ✔centos8 ✔debian. JID-2849


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] resmo commented on a change in pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
resmo commented on a change in pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#discussion_r704243328



##########
File path: pom.xml
##########
@@ -974,6 +974,7 @@
                             <exclude>**/*.md</exclude>
                             <exclude>.java-version</exclude>
                             <exclude>.python-version</exclude>
+                            <exclude>systemvm/.pythen-version</exclude>

Review comment:
       @DaanHoogland typo?




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-798946291


   <b>[S] Trillian test result (tid-126)</b>
   Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
   Total time taken: 36090 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t126-kvm-centos7.zip
   Intermittent failure detected: /marvin/tests/smoke/test_accounts.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_life_cycle.py
   Smoke tests completed. 84 look OK, 2 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   test_DeleteDomain | `Error` | 156.37 | test_accounts.py
   ContextSuite context=TestSecuredVmMigration>:teardown | `Error` | 196.89 | test_vm_life_cycle.py
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan removed a comment on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan removed a comment on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-797840913






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-785276473


   Packaging result: ✔centos7 ✔centos8 ✔debian. JID-2823


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-785460815


   Packaging result: ✔centos7 ✔centos8 ✔debian. JID-2824


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-827618455


   @DaanHoogland a Trillian-Jenkins matrix job (centos7 mgmt + xs71, centos7 mgmt + vmware65, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] pdion891 commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
pdion891 commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-832123660


   +1
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-830284099


   <b>Trillian test result (tid-567)</b>
   Environment: xenserver-71 (x2), Advanced Networking with Mgmt server 7
   Total time taken: 33696 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t567-xenserver-71.zip
   Smoke tests completed. 88 look OK, 0 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-828244169


   Packaging result: :heavy_check_mark: centos7 :heavy_check_mark: centos8 :heavy_check_mark: debian. SL-JID 480


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] GabrielBrascher commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
GabrielBrascher commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-785435679


   @blueorangutan package


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-796254261


   <b>[S] Trillian test result (tid-77)</b>
   Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
   Total time taken: 17270 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t77-kvm-centos7.zip
   Intermittent failure detected: /marvin/tests/smoke/test_accounts.py
   Intermittent failure detected: /marvin/tests/smoke/test_affinity_groups_projects.py
   Intermittent failure detected: /marvin/tests/smoke/test_affinity_groups.py
   Intermittent failure detected: /marvin/tests/smoke/test_async_job.py
   Intermittent failure detected: /marvin/tests/smoke/test_deploy_virtio_scsi_vm.py
   Intermittent failure detected: /marvin/tests/smoke/test_deploy_vm_extra_config_data.py
   Intermittent failure detected: /marvin/tests/smoke/test_deploy_vm_iso.py
   Intermittent failure detected: /marvin/tests/smoke/test_deploy_vm_root_resize.py
   Intermittent failure detected: /marvin/tests/smoke/test_deploy_vms_with_varied_deploymentplanners.py
   Intermittent failure detected: /marvin/tests/smoke/test_deploy_vm_with_userdata.py
   Intermittent failure detected: /marvin/tests/smoke/test_diagnostics.py
   Intermittent failure detected: /marvin/tests/smoke/test_domain_service_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_domain_vpc_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_internal_lb.py
   Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_clusters.py
   Intermittent failure detected: /marvin/tests/smoke/test_list_ids_parameter.py
   Intermittent failure detected: /marvin/tests/smoke/test_loadbalance.py
   Intermittent failure detected: /marvin/tests/smoke/test_metrics_api.py
   Intermittent failure detected: /marvin/tests/smoke/test_migration.py
   Intermittent failure detected: /marvin/tests/smoke/test_multipleips_per_nic.py
   Intermittent failure detected: /marvin/tests/smoke/test_network_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_network.py
   Intermittent failure detected: /marvin/tests/smoke/test_nic.py
   Intermittent failure detected: /marvin/tests/smoke/test_password_server.py
   Intermittent failure detected: /marvin/tests/smoke/test_portable_publicip.py
   Intermittent failure detected: /marvin/tests/smoke/test_portforwardingrules.py
   Intermittent failure detected: /marvin/tests/smoke/test_primary_storage.py
   Intermittent failure detected: /marvin/tests/smoke/test_privategw_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_projects.py
   Intermittent failure detected: /marvin/tests/smoke/test_reset_vm_on_reboot.py
   Intermittent failure detected: /marvin/tests/smoke/test_resource_accounting.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dhcphosts.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dns.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dnsservice.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_iptables_default_policy.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_network_ops.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers.py
   Intermittent failure detected: /marvin/tests/smoke/test_service_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_snapshots.py
   Intermittent failure detected: /marvin/tests/smoke/test_templates.py
   Intermittent failure detected: /marvin/tests/smoke/test_usage.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_deployment_planner.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_life_cycle.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_snapshots.py
   Intermittent failure detected: /marvin/tests/smoke/test_volumes.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_router_nics.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_vpn.py
   Smoke tests completed. 38 look OK, 48 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   ContextSuite context=TestAddVmToSubDomain>:setup | `Error` | 32.33 | test_accounts.py
   test_DeleteDomain | `Error` | 42.14 | test_accounts.py
   test_forceDeleteDomain | `Failure` | 44.05 | test_accounts.py
   test_01_user_remove_VM_running | `Error` | 24.40 | test_accounts.py
   test_DeployVmAntiAffinityGroup_in_project | `Error` | 26.71 | test_affinity_groups_projects.py
   test_DeployVmAffinityGroup | `Error` | 23.67 | test_affinity_groups.py
   test_DeployVmAntiAffinityGroup | `Error` | 6.25 | test_affinity_groups.py
   test_query_async_job_result | `Error` | 40.38 | test_async_job.py
   ContextSuite context=TestLoadBalance>:setup | `Error` | 0.00 | test_loadbalance.py
   test_list_vms_metrics | `Error` | 23.87 | test_metrics_api.py
   ContextSuite context=TestDeployVirtioSCSIVM>:setup | `Error` | 0.00 | test_deploy_virtio_scsi_vm.py
   test_02_deploy_vm_with_extraconfig_kvm | `Error` | 28.77 | test_deploy_vm_extra_config_data.py
   test_03_update_vm_with_extraconfig_kvm | `Error` | 6.31 | test_deploy_vm_extra_config_data.py
   test_deploy_vm_from_iso | `Error` | 45.58 | test_deploy_vm_iso.py
   test_01_native_to_native_network_migration | `Error` | 41.69 | test_migration.py
   test_02_native_to_native_vpc_migration | `Error` | 28.20 | test_migration.py
   test_00_deploy_vm_root_resize | `Error` | 25.67 | test_deploy_vm_root_resize.py
   test_deployvm_firstfit | `Error` | 28.87 | test_deploy_vms_with_varied_deploymentplanners.py
   test_deployvm_userconcentrated | `Error` | 4.27 | test_deploy_vms_with_varied_deploymentplanners.py
   test_deployvm_userdispersing | `Error` | 4.30 | test_deploy_vms_with_varied_deploymentplanners.py
   test_network_acl | `Error` | 28.76 | test_network_acl.py
   test_deployvm_userdata | `Error` | 27.89 | test_deploy_vm_with_userdata.py
   test_deployvm_userdata_post | `Error` | 5.35 | test_deploy_vm_with_userdata.py
   test_01_deploy_kubernetes_cluster | `Failure` | 32.10 | test_kubernetes_clusters.py
   test_02_invalid_upgrade_kubernetes_cluster | `Failure` | 31.96 | test_kubernetes_clusters.py
   test_03_deploy_and_upgrade_kubernetes_cluster | `Failure` | 27.84 | test_kubernetes_clusters.py
   test_04_deploy_and_scale_kubernetes_cluster | `Failure` | 23.68 | test_kubernetes_clusters.py
   test_05_delete_kubernetes_cluster | `Failure` | 30.79 | test_kubernetes_clusters.py
   test_07_deploy_kubernetes_ha_cluster | `Failure` | 29.77 | test_kubernetes_clusters.py
   test_08_deploy_and_upgrade_kubernetes_ha_cluster | `Failure` | 31.93 | test_kubernetes_clusters.py
   test_09_delete_kubernetes_ha_cluster | `Failure` | 29.77 | test_kubernetes_clusters.py
   ContextSuite context=TestKubernetesCluster>:teardown | `Error` | 166.79 | test_kubernetes_clusters.py
   test_09_project_suspend | `Error` | 30.99 | test_projects.py
   test_10_project_activation | `Error` | 6.28 | test_projects.py
   ContextSuite context=TestRemoteDiagnostics>:setup | `Error` | 0.00 | test_diagnostics.py
   test_delete_account | `Error` | 32.35 | test_network.py
   ContextSuite context=TestPortForwarding>:setup | `Error` | 70.29 | test_network.py
   ContextSuite context=TestPublicIP>:setup | `Error` | 23.80 | test_network.py
   test_reboot_router | `Error` | 29.23 | test_network.py
   test_releaseIP | `Error` | 30.30 | test_network.py
   ContextSuite context=TestRouterRules>:setup | `Error` | 58.60 | test_network.py
   test_01_deployVMInSharedNetwork | `Failure` | 27.73 | test_network.py
   test_03_destroySharedNetwork | `Failure` | 1.07 | test_network.py
   ContextSuite context=TestSharedNetwork>:teardown | `Error` | 1.14 | test_network.py
   test_01_nic | `Error` | 76.90 | test_nic.py
   test_03_deploy_vm_domain_service_offering | `Error` | 44.88 | test_domain_service_offerings.py
   test_03_create_vpc_domain_vpc_offering | `Error` | 33.52 | test_domain_vpc_offerings.py
   ContextSuite context=TestIsolatedNetworksPasswdServer>:setup | `Error` | 0.00 | test_password_server.py
   test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 | `Failure` | 30.25 | test_internal_lb.py
   test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 | `Failure` | 30.16 | test_internal_lb.py
   test_03_vpc_internallb_haproxy_stats_on_all_interfaces | `Failure` | 31.09 | test_internal_lb.py
   test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | `Failure` | 32.21 | test_internal_lb.py
   ContextSuite context=TestPortablePublicIPAcquire>:teardown | `Error` | 32.47 | test_portable_publicip.py
   ContextSuite context=TestListIdsParams>:setup | `Error` | 0.00 | test_list_ids_parameter.py
   test_nic_secondaryip_add_remove | `Error` | 29.22 | test_multipleips_per_nic.py
   test_01_create_delete_portforwarding_fornonvpc | `Error` | 28.53 | test_portforwardingrules.py
   test_01_add_primary_storage_disabled_host | `Error` | 92.02 | test_primary_storage.py
   test_01_primary_storage_nfs | `Error` | 0.12 | test_primary_storage.py
   ContextSuite context=TestStorageTags>:setup | `Error` | 0.22 | test_primary_storage.py
   test_01_vpc_privategw_acl | `Failure` | 29.22 | test_privategw_acl.py
   test_02_vpc_privategw_static_routes | `Failure` | 28.15 | test_privategw_acl.py
   test_03_vpc_privategw_restart_vpc_cleanup | `Failure` | 27.12 | test_privategw_acl.py
   test_04_rvpc_privategw_static_routes | `Failure` | 30.20 | test_privategw_acl.py
   ContextSuite context=TestResetVmOnReboot>:setup | `Error` | 0.00 | test_reset_vm_on_reboot.py
   test_01_so_removal_resource_update | `Error` | 22.79 | test_resource_accounting.py
   ContextSuite context=TestRouterDHCPHosts>:setup | `Error` | 0.00 | test_router_dhcphosts.py
   ContextSuite context=TestRouterDHCPOpts>:setup | `Error` | 0.00 | test_router_dhcphosts.py
   ContextSuite context=TestRouterDns>:setup | `Error` | 0.00 | test_router_dns.py
   ContextSuite context=TestRouterDnsService>:setup | `Error` | 0.00 | test_router_dnsservice.py
   test_02_routervm_iptables_policies | `Error` | 26.69 | test_routers_iptables_default_policy.py
   test_01_single_VPC_iptables_policies | `Error` | 26.72 | test_routers_iptables_default_policy.py
   test_01_isolate_network_FW_PF_default_routes_egress_true | `Error` | 27.84 | test_routers_network_ops.py
   test_02_isolate_network_FW_PF_default_routes_egress_false | `Error` | 27.90 | test_routers_network_ops.py
   test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true | `Error` | 54.24 | test_routers_network_ops.py
   test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false | `Error` | 54.53 | test_routers_network_ops.py
   test_03_RVR_Network_check_router_state | `Error` | 55.51 | test_routers_network_ops.py
   ContextSuite context=TestRouterServices>:setup | `Error` | 0.00 | test_routers.py
   ContextSuite context=TestCpuCapServiceOfferings>:setup | `Error` | 0.00 | test_service_offerings.py
   ContextSuite context=TestServiceOfferings>:setup | `Error` | 27.22 | test_service_offerings.py
   ContextSuite context=TestSnapshotRootDisk>:setup | `Error` | 0.00 | test_snapshots.py
   test_02_deploy_vm_from_direct_download_template | `Error` | 26.74 | test_templates.py
   test_03_deploy_vm_wrong_checksum | `Error` | 5.39 | test_templates.py
   ContextSuite context=TestTemplates>:setup | `Error` | 53.54 | test_templates.py
   ContextSuite context=TestLBRuleUsage>:setup | `Error` | 30.36 | test_usage.py
   ContextSuite context=TestNatRuleUsage>:setup | `Error` | 58.50 | test_usage.py
   ContextSuite context=TestPublicIPUsage>:setup | `Error` | 86.73 | test_usage.py
   ContextSuite context=TestSnapshotUsage>:setup | `Error` | 114.00 | test_usage.py
   ContextSuite context=TestVmUsage>:setup | `Error` | 179.80 | test_usage.py
   ContextSuite context=TestVolumeUsage>:setup | `Error` | 210.16 | test_usage.py
   ContextSuite context=TestVpnUsage>:setup | `Error` | 238.49 | test_usage.py
   test_01_deploy_vm_on_specific_host | `Error` | 25.77 | test_vm_deployment_planner.py
   test_02_deploy_vm_on_specific_cluster | `Error` | 2.29 | test_vm_deployment_planner.py
   test_03_deploy_vm_on_specific_pod | `Error` | 5.35 | test_vm_deployment_planner.py
   test_04_deploy_vm_on_host_override_pod_and_cluster | `Error` | 3.26 | test_vm_deployment_planner.py
   test_05_deploy_vm_on_cluster_override_pod | `Error` | 4.29 | test_vm_deployment_planner.py
   ContextSuite context=TestDeployVM>:setup | `Error` | 0.00 | test_vm_life_cycle.py
   test_01_secure_vm_migration | `Error` | 94.73 | test_vm_life_cycle.py
   test_02_unsecure_vm_migration | `Error` | 216.78 | test_vm_life_cycle.py
   test_03_secured_to_nonsecured_vm_migration | `Error` | 175.18 | test_vm_life_cycle.py
   test_04_nonsecured_to_secured_vm_migration | `Error` | 146.05 | test_vm_life_cycle.py
   ContextSuite context=TestSecuredVmMigration>:teardown | `Error` | 146.07 | test_vm_life_cycle.py
   ContextSuite context=TestVMLifeCycle>:setup | `Error` | 29.30 | test_vm_life_cycle.py
   ContextSuite context=TestVmSnapshot>:setup | `Error` | 28.27 | test_vm_snapshots.py
   ContextSuite context=TestCreateVolume>:setup | `Error` | 0.00 | test_volumes.py
   ContextSuite context=TestVolumes>:setup | `Error` | 0.00 | test_volumes.py
   test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | `Error` | 30.22 | test_vpc_redundant.py
   test_02_redundant_VPC_default_routes | `Error` | 30.19 | test_vpc_redundant.py
   test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | `Error` | 30.36 | test_vpc_redundant.py
   test_04_rvpc_network_garbage_collector_nics | `Error` | 29.22 | test_vpc_redundant.py
   test_05_rvpc_multi_tiers | `Error` | 30.22 | test_vpc_redundant.py
   test_01_VPC_nics_after_destroy | `Error` | 29.13 | test_vpc_router_nics.py
   test_02_VPC_default_routes | `Error` | 28.27 | test_vpc_router_nics.py
   test_01_redundant_vpc_site2site_vpn | `Failure` | 27.87 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn_multiple_options | `Failure` | 26.80 | test_vpc_vpn.py
   test_01_vpc_remote_access_vpn | `Failure` | 26.70 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn | `Failure` | 28.82 | test_vpc_vpn.py
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] rhtyd commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
rhtyd commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-832126035


   +1 but we should run a test round against ubuntu and CentOS8 as well
   @blueorangutan help


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-789265981


   <b>Trillian test result (tid-3637)</b>
   Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
   Total time taken: 41878 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t3637-kvm-centos7.zip
   Test completed. 63 look ok, 108 have errors
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   ContextSuite context=TestDeployVMs>:setup | `Error` | 0.00 | test_dhcp_dns_offload.py
   test_01_1_egress_fr1 | `Error` | 67.45 | test_egress_fw_rules.py
   test_01_2_egress_fr1 | `Error` | 66.45 | test_egress_fw_rules.py
   test_01_egress_fr1 | `Error` | 65.46 | test_egress_fw_rules.py
   test_02_1_egress_fr2 | `Error` | 66.47 | test_egress_fw_rules.py
   test_02_2_egress_fr2 | `Error` | 65.41 | test_egress_fw_rules.py
   test_02_egress_fr2 | `Error` | 66.42 | test_egress_fw_rules.py
   test_03_1_egress_fr3 | `Error` | 66.39 | test_egress_fw_rules.py
   test_03_egress_fr3 | `Error` | 67.46 | test_egress_fw_rules.py
   test_04_1_egress_fr4 | `Error` | 66.45 | test_egress_fw_rules.py
   test_04_egress_fr4 | `Error` | 65.45 | test_egress_fw_rules.py
   test_06_1_egress_fr6 | `Error` | 66.53 | test_egress_fw_rules.py
   test_06_egress_fr6 | `Error` | 67.51 | test_egress_fw_rules.py
   test_07_1_egress_fr7 | `Error` | 66.45 | test_egress_fw_rules.py
   test_07_egress_fr7 | `Error` | 65.47 | test_egress_fw_rules.py
   test_09_1_egress_fr9 | `Error` | 66.44 | test_egress_fw_rules.py
   test_09_egress_fr9 | `Error` | 65.60 | test_egress_fw_rules.py
   test_10_1_egress_fr10 | `Error` | 66.49 | test_egress_fw_rules.py
   test_10_egress_fr10 | `Error` | 65.43 | test_egress_fw_rules.py
   test_11_1_egress_fr11 | `Error` | 202.38 | test_egress_fw_rules.py
   test_11_egress_fr11 | `Error` | 203.43 | test_egress_fw_rules.py
   test_12_1_egress_fr12 | `Error` | 66.57 | test_egress_fw_rules.py
   test_12_egress_fr12 | `Error` | 65.56 | test_egress_fw_rules.py
   test_13_1_egress_fr13 | `Error` | 89.97 | test_egress_fw_rules.py
   test_13_egress_fr13 | `Error` | 89.89 | test_egress_fw_rules.py
   test_02_acquire_public_ip_in_vpc | `Error` | 18.39 | test_acquire_specified_public_ip.py
   test_04_vpc_nw_running_vm_1_isolated | `Error` | 172.04 | test_add_remove_network.py
   test_05_add_vpc_nw_stopped_vm_1_isolated | `Error` | 32.87 | test_add_remove_network.py
   test_14_add_nw_different_account_1_isolated | `Failure` | 3.48 | test_add_remove_network.py
   test_14_add_nw_different_account_2_shared | `Failure` | 4.61 | test_add_remove_network.py
   test_14_add_nw_different_account_2_shared | `Error` | 4.61 | test_add_remove_network.py
   test_24_add_nw_different_domain | `Error` | 13.26 | test_add_remove_network.py
   test_25_add_nw_above_account_limit | `Error` | 10.74 | test_add_remove_network.py
   ContextSuite context=TestAddNetworkToVirtualMachine>:teardown | `Error` | 29.17 | test_add_remove_network.py
   test_29_remove_nic_CS22503 | `Error` | 210.25 | test_add_remove_network.py
   test_04_update_aff_grp_remove_all | `Error` | 0.12 | test_affinity_groups.py
   test_06_update_aff_grp_invalid_args | `Error` | 158.52 | test_affinity_groups.py
   runTest | `Error` | 0.00 | test_host_ha.py
   runTest | `Error` | 0.00 | test_host_ha.py
   test_01_create_sticky_policy_default_values | `Error` | 88.25 | test_haproxy.py
   test_02_create_sticky_policy_custom_values | `Error` | 92.29 | test_haproxy.py
   test_03_supported_policies_by_network | `Error` | 93.36 | test_haproxy.py
   test_04_delete_lb_rule | `Error` | 96.36 | test_haproxy.py
   test_05_error_alerts_after_create | `Error` | 1.47 | test_haproxy.py
   test_06_release_ip | `Error` | 1.49 | test_haproxy.py
   test_07_delete_account | `Error` | 1.50 | test_haproxy.py
   test_08_create_policy_router_stopped | `Error` | 1.47 | test_haproxy.py
   test_09_create_policy_router_destroy | `Error` | 1.51 | test_haproxy.py
   test_10_create_policy_enable_disable_vpn | `Error` | 1.50 | test_haproxy.py
   test_11_invalid_params | `Error` | 1.48 | test_haproxy.py
   test_11_move_across_subdomain_vm_pfrule | `Failure` | 207.58 | test_assign_vm.py
   runTest | `Error` | 0.00 | test_host.py
   runTest | `Error` | 0.00 | test_host.py
   ContextSuite context=TestBaseImageUpdate>:setup | `Error` | 0.00 | test_base_image_updation.py
   test_01_data_persistency_root_disk | `Error` | 715.52 | test_blocker_bugs.py
   test_01_firewall_rules_port_fw | `Error` | 0.79 | test_blocker_bugs.py
   test_02_check_size_snapshotTemplate | `Error` | 10.26 | test_blocker_bugs.py
   test_03_reuse_template_name | `Error` | 16.39 | test_blocker_bugs.py
   test_vm_create_after_reservation | `Failure` | 33.44 | test_ip_reservation.py
   test_ip_reservation_in_multiple_networks_same_account | `Failure` | 12.09 | test_ip_reservation.py
   test_nat_rules_1_nat_rule | `Failure` | 11.76 | test_ip_reservation.py
   test_nat_rules_2_static_nat_rule | `Failure` | 11.71 | test_ip_reservation.py
   test_update_cidr_multiple_vms_not_all_inclusive | `Failure` | 12.75 | test_ip_reservation.py
   test_update_cidr_single_vm_not_inclusive | `Failure` | 11.72 | test_ip_reservation.py
   test_vm_create_after_reservation | `Failure` | 11.71 | test_ip_reservation.py
   test_restart_network_with_cleanup_1_True | `Failure` | 12.73 | test_ip_reservation.py
   test_restart_network_with_cleanup_2_False | `Failure` | 12.71 | test_ip_reservation.py
   test_destroy_recreate_router | `Failure` | 11.74 | test_ip_reservation.py
   test_update_network_guestvmcidr_1_existingVmInclusive | `Failure` | 11.75 | test_ip_reservation.py
   test_update_network_guestvmcidr_2_existingVmExclusive | `Failure` | 12.73 | test_ip_reservation.py
   test_01_Browser_template_Life_cycle_tpath | `Failure` | 24.12 | test_browse_templates.py
   test_02_SSVM_Life_Cycle_With_Browser_Template_TPath | `Failure` | 104.70 | test_browse_templates.py
   test_04_Browser_template_ResetVM_With_Deleted_Template | `Failure` | 9.29 | test_browse_templates.py
   test_05_Browser_Upload_Template_with_all_API_parameters | `Failure` | 9.35 | test_browse_templates.py
   test_06_Browser_Upload_template_resource_limits | `Failure` | 8.81 | test_browse_templates.py
   test_07_Browser_Upload_template_secondary_storage_resource_limits | `Failure` | 39.80 | test_browse_templates.py
   test_08_Browser_Upload_template_resource_limits_after_deletion | `Failure` | 9.01 | test_browse_templates.py
   test_09_Browser_Upload_Volume_secondary_storage_resource_limits_after_deletion | `Failure` | 8.89 | test_browse_templates.py
   test_browser_upload_template_incomplete | `Failure` | 93.27 | test_browse_templates.py
   ContextSuite context=TestBrowseUploadVolume>:setup | `Error` | 0.00 | test_browse_volumes.py
   test_01_lb_rule_for_primary_ip | `Error` | 11.68 | test_lb_secondary_ip.py
   test_02_lb_rule_for_primary_ip | `Error` | 11.69 | test_lb_secondary_ip.py
   test_03_lb_rule_for_primary_and_secondary_ip | `Error` | 12.70 | test_lb_secondary_ip.py
   test_04_lb_rule_primary_secondary_multiple_vms | `Error` | 11.72 | test_lb_secondary_ip.py
   test_05_lb_rule_wrong_vm_id | `Error` | 11.69 | test_lb_secondary_ip.py
   test_06_lb_rule_wrong_vm_ip | `Error` | 11.80 | test_lb_secondary_ip.py
   test_08_lb_rule_remove_used_ip | `Error` | 12.70 | test_lb_secondary_ip.py
   test_11_ssh_to_secondary_ip | `Error` | 11.70 | test_lb_secondary_ip.py
   test_13_delete_lb_rule | `Error` | 11.69 | test_lb_secondary_ip.py
   test_14_remove_lb_rule_secondary_ip | `Error` | 12.71 | test_lb_secondary_ip.py
   test_15_remove_lb_rule_primary_ip | `Error` | 11.69 | test_lb_secondary_ip.py
   test_16_delete_vm_from_lb_rule | `Error` | 11.70 | test_lb_secondary_ip.py
   test_20_destroy_recover_vm | `Error` | 11.68 | test_lb_secondary_ip.py
   test_21_modify_lb_rule_algorithm | `Error` | 12.74 | test_lb_secondary_ip.py
   test_09_lbvmips_true | `Error` | 11.69 | test_lb_secondary_ip.py
   test_10_lbvmips_false | `Error` | 11.69 | test_lb_secondary_ip.py
   test_17_restart_router | `Error` | 11.70 | test_lb_secondary_ip.py
   test_18_restart_network_cleanup_true | `Error` | 12.69 | test_lb_secondary_ip.py
   test_19_restart_network_cleanup_false | `Error` | 11.74 | test_lb_secondary_ip.py
   test_22_network_gc | `Error` | 11.68 | test_lb_secondary_ip.py
   runTest | `Error` | 0.00 | test_configdrive.py
   runTest | `Error` | 0.00 | test_configdrive.py
   test_deployvm_userdata_post | `Error` | 20.55 | test_deploy_vm_userdata_reg.py
   test_deployvm_multinic | `Error` | 35.16 | test_deploy_vm_userdata_multi_nic.py
   test_listtemplate | `Failure` | 31.55 | test_escalation_listTemplateDomainAdmin.py
   test_listtemplate | `Error` | 31.55 | test_escalation_listTemplateDomainAdmin.py
   test_03_associate_ipaddress_for_vpc | `Error` | 19.84 | test_escalations_ipaddresses.py
   test_05_create_delete_lbrule_forvpc | `Error` | 20.84 | test_escalations_ipaddresses.py
   test_07_assign_remove_lbrule_toinstance | `Error` | 53.36 | test_escalations_ipaddresses.py
   test_07_assign_remove_lbrule_toinstance | `Error` | 53.37 | test_escalations_ipaddresses.py
   test_09_create_delete_portforwarding_fornonvpc | `Error` | 54.33 | test_escalations_ipaddresses.py
   test_09_create_delete_portforwarding_fornonvpc | `Error` | 54.33 | test_escalations_ipaddresses.py
   test_10_create_delete_portforwarding_forvpc | `Error` | 20.84 | test_escalations_ipaddresses.py
   test_13_add_remove_vpnusers | `Error` | 55.26 | test_escalations_ipaddresses.py
   test_13_add_remove_vpnusers | `Error` | 55.26 | test_escalations_ipaddresses.py
   test_14_enable_disable_staticnat_fornonvpc | `Error` | 54.91 | test_escalations_ipaddresses.py
   test_14_enable_disable_staticnat_fornonvpc | `Error` | 54.92 | test_escalations_ipaddresses.py
   test_15_enable_disable_staticnat_forvpc | `Error` | 19.79 | test_escalations_ipaddresses.py
   test_16_create_delete_ipforwardingrule | `Error` | 54.95 | test_escalations_ipaddresses.py
   test_16_create_delete_ipforwardingrule | `Error` | 54.95 | test_escalations_ipaddresses.py
   test_03_list_vpc_pagination | `Error` | 22.51 | test_escalations_networks.py
   test_04_create_vpc_with_networkdomain | `Error` | 21.47 | test_escalations_networks.py
   test_05_list_network_offerings_with_and_without_vpc | `Error` | 0.12 | test_escalations_networks.py
   test_06_create_network_in_vpc | `Error` | 22.49 | test_escalations_networks.py
   test_07_create_delete_network | `Error` | 0.02 | test_escalations_networks.py
   test_08_update_network | `Error` | 0.01 | test_escalations_networks.py
   test_10_list_networks_in_vpc | `Error` | 20.46 | test_escalations_networks.py
   test_11_update_vpc | `Error` | 22.50 | test_escalations_networks.py
   test_12_list_create_delete_networkACL | `Error` | 20.46 | test_escalations_networks.py
   test_13_list_vpc_byid | `Error` | 19.43 | test_escalations_networks.py
   test_15_list_privategateway_byvpcid | `Error` | 20.45 | test_escalations_networks.py
   test_17_restart_vpc | `Error` | 26.55 | test_escalations_networks.py
   test_18_create_list_vpn_gateway | `Error` | 19.42 | test_escalations_networks.py
   test_19_create_list_reset_delete_vpnconnections | `Error` | 20.44 | test_escalations_networks.py
   test_21_listNetworkacls_by_privategateway_aclid | `Error` | 21.47 | test_escalations_networks.py
   test_02_list_volume_byid | `Failure` | 64.30 | test_escalations_volumes.py
   test_05_volume_snapshot | `Error` | 74.74 | test_escalations_volumes.py
   test_10_volume_snapshots_pagination | `Error` | 77.92 | test_escalations_volumes.py
   test_01_list_vpncustomergateways_pagination | `Error` | 1.07 | test_escalations_vpncustomergateways.py
   test_02_update_vpncustomergateways | `Error` | 1.06 | test_escalations_vpncustomergateways.py
   test_list_nics | `Error` | 5.64 | test_list_nics.py
   test_01_stop_start_instance | `Failure` | 11.24 | test_memory_limits.py
   test_02_migrate_instance | `Failure` | 10.24 | test_memory_limits.py
   test_03_delete_instance | `Failure` | 11.27 | test_memory_limits.py
   test_01_stop_start_instance | `Failure` | 1.48 | test_memory_limits.py
   test_02_migrate_instance | `Failure` | 1.46 | test_memory_limits.py
   test_03_delete_instance | `Failure` | 1.50 | test_memory_limits.py
   test_04_deploy_multiple_vm | `Failure` | 1.48 | test_memory_limits.py
   ContextSuite context=TestMigrationMaintainedPool>:setup | `Error` | 0.00 | test_migrate_vol_to_maintained_pool.py
   test_01_change_service_offering | `Failure` | 11.35 | test_mm_domain_limits.py
   test_02_migrate_vm | `Failure` | 12.30 | test_mm_domain_limits.py
   test_03_delete_vm | `Failure` | 11.27 | test_mm_domain_limits.py
   test_04_deploy_multiple_vm | `Failure` | 10.27 | test_mm_domain_limits.py
   test_01_multiple_child_domains | `Failure` | 13.90 | test_mm_domain_limits.py
   test_02_deploy_vm_account_limit_reached | `Failure` | 12.38 | test_mm_max_limits.py
   test_04_deployVm__account_limit_reached | `Failure` | 11.34 | test_mm_max_limits.py
   test_01_project_vmlifecycle_start_stop_instance | `Failure` | 3.05 | test_mm_project_limits.py
   test_02_project_vmlifecycle_migrate_instance | `Failure` | 2.99 | test_mm_project_limits.py
   test_03_project_vmlifecycle_delete_instance | `Failure` | 3.08 | test_mm_project_limits.py
   test_add_ip_to_nic_1_SHARED | `Error` | 11.92 | test_multiple_ips_per_nic.py
   test_list_nics_1_ISOLATED | `Error` | 10.71 | test_multiple_ips_per_nic.py
   test_list_nics_2_SHARED | `Error` | 11.95 | test_multiple_ips_per_nic.py
   test_list_nics_3_VPC | `Error` | 2.44 | test_multiple_ips_per_nic.py
   test_operations_non_root_admin_api_client_1_ISOLATED | `Error` | 10.85 | test_multiple_ips_per_nic.py
   test_operations_non_root_admin_api_client_2_SHARED | `Error` | 13.11 | test_multiple_ips_per_nic.py
   test_operations_non_root_admin_api_client_3_VPC | `Error` | 3.73 | test_multiple_ips_per_nic.py
   test_remove_ip_from_nic_1_ISOLATED | `Error` | 10.80 | test_multiple_ips_per_nic.py
   test_remove_ip_from_nic_2_SHARED | `Error` | 10.93 | test_multiple_ips_per_nic.py
   test_remove_ip_from_nic_3_VPC | `Error` | 2.47 | test_multiple_ips_per_nic.py
   test_add_PF_rule_1_ISOLATED | `Error` | 9.71 | test_multiple_ips_per_nic.py
   test_add_PF_rule_2_SHARED | `Error` | 10.91 | test_multiple_ips_per_nic.py
   test_add_PF_rule_3_VPC | `Error` | 2.46 | test_multiple_ips_per_nic.py
   test_add_static_nat_rule_1_ISOLATED | `Error` | 10.71 | test_multiple_ips_per_nic.py
   test_add_static_nat_rule_2_SHARED | `Error` | 10.92 | test_multiple_ips_per_nic.py
   test_add_static_nat_rule_3_VPC | `Error` | 2.45 | test_multiple_ips_per_nic.py
   test_delete_PF_nat_rule_1_ISOLATED | `Error` | 10.71 | test_multiple_ips_per_nic.py
   test_delete_PF_nat_rule_2_SHARED | `Error` | 10.91 | test_multiple_ips_per_nic.py
   test_delete_PF_nat_rule_3_VPC | `Error` | 2.46 | test_multiple_ips_per_nic.py
   test_disable_static_nat_1_ISOLATED | `Error` | 10.69 | test_multiple_ips_per_nic.py
   test_disable_static_nat_2_SHARED | `Error` | 10.91 | test_multiple_ips_per_nic.py
   test_disable_static_nat_3_VPC | `Error` | 2.44 | test_multiple_ips_per_nic.py
   test_disassociate_ip_mapped_to_secondary_ip_through_PF_rule_1_ISOLATED | `Error` | 10.69 | test_multiple_ips_per_nic.py
   test_disassociate_ip_mapped_to_secondary_ip_through_PF_rule_2_SHARED | `Error` | 10.91 | test_multiple_ips_per_nic.py
   test_disassociate_ip_mapped_to_secondary_ip_through_PF_rule_3_VPC | `Error` | 2.45 | test_multiple_ips_per_nic.py
   test_delete_vm_1_ISOLATED | `Error` | 9.70 | test_multiple_ips_per_nic.py
   test_delete_vm_2_SHARED | `Error` | 10.94 | test_multiple_ips_per_nic.py
   test_delete_vm_3_VPC | `Error` | 2.46 | test_multiple_ips_per_nic.py
   test_network_restart_cleanup_false_1_ISOLATED | `Error` | 10.71 | test_multiple_ips_per_nic.py
   test_network_restart_cleanup_false_2_SHARED | `Error` | 10.92 | test_multiple_ips_per_nic.py
   test_network_restart_cleanup_false_3_VPC | `Error` | 2.44 | test_multiple_ips_per_nic.py
   test_network_restart_cleanup_true_1_ISOLATED | `Error` | 10.72 | test_multiple_ips_per_nic.py
   test_network_restart_cleanup_true_2_SHARED | `Error` | 10.95 | test_multiple_ips_per_nic.py
   test_network_restart_cleanup_true_3_VPC | `Error` | 2.46 | test_multiple_ips_per_nic.py
   test_reboot_router_VM_1_ISOLATED | `Error` | 10.71 | test_multiple_ips_per_nic.py
   test_reboot_router_VM_2_SHARED | `Error` | 10.87 | test_multiple_ips_per_nic.py
   test_reboot_router_VM_3_VPC | `Error` | 2.44 | test_multiple_ips_per_nic.py
   test_recover_vm_1_ISOLATED | `Error` | 10.71 | test_multiple_ips_per_nic.py
   test_recover_vm_2_SHARED | `Error` | 10.95 | test_multiple_ips_per_nic.py
   test_recover_vm_3_VPC | `Error` | 2.45 | test_multiple_ips_per_nic.py
   ContextSuite context=TestIptables>:setup | `Error` | 0.00 | test_multiple_public_interfaces.py
   ContextSuite context=TestPortForwarding>:setup | `Error` | 0.00 | test_multiple_public_interfaces.py
   ContextSuite context=TestRouting>:setup | `Error` | 0.00 | test_multiple_public_interfaces.py
   ContextSuite context=TestStaticNat>:setup | `Error` | 0.00 | test_multiple_public_interfaces.py
   test_network_services_VPC_CreatePF | `Error` | 2.52 | test_multiple_public_interfaces.py
   test_network_services_VPC_CreatePF | `Error` | 2.50 | test_multiple_public_interfaces.py
   test_01_acquire_public_ips_in_isolated_network_with_single_vr | `Failure` | 11.91 | test_multiple_subnets_in_isolated_network.py
   test_02_acquire_public_ips_in_isolated_network_with_redundant_vrs | `Failure` | 11.91 | test_multiple_subnets_in_isolated_network_rvr.py
   test_03_acquire_public_ips_in_vpc_with_single_vr | `Error` | 5.98 | test_multiple_subnets_in_vpc.py
   test_04_acquire_public_ips_in_vpc_with_redundant_vrs | `Error` | 5.97 | test_multiple_subnets_in_vpc_rvr.py
   test_01_network_off_without_conserve_mode | `Error` | 9.82 | test_network_offering.py
   test_02_network_off_with_conserve_mode | `Error` | 9.79 | test_network_offering.py
   test_03_network_off_CS5332 | `Error` | 9.90 | test_network_offering.py
   test_create_network_with_snat | `Error` | 10.80 | test_network_offering.py
   test_05_remove_used_range | `Failure` | 5.63 | test_non_contiguous_vlan.py
   ContextSuite context=TestOrganizationStates>:setup | `Error` | 0.00 | test_organization_states.py
   ContextSuite context=Overcommit>:setup | `Error` | 0.00 | test_overcommit.py
   test_assign_vm_different_account_VR_1_VR | `Error` | 2.88 | test_persistent_networks.py
   test_assign_vm_different_account_VR_2_RVR | `Error` | 2.86 | test_persistent_networks.py
   test_change_persistent_network_to_non_persistent | `Error` | 1.50 | test_persistent_networks.py
   test_delete_account | `Error` | 0.43 | test_persistent_networks.py
   test_network_state_after_destroying_vms | `Error` | 0.14 | test_persistent_networks.py
   test_persistent_network_with_RVR | `Error` | 1.52 | test_persistent_networks.py
   test_pf_nat_rule_persistent_network_1_LB_VR | `Error` | 1.49 | test_persistent_networks.py
   test_upgrade_network_VR_to_PersistentRVR | `Error` | 2.55 | test_persistent_networks.py
   test_upgrade_to_persistent_services_VR_1_LB_VR | `Error` | 2.51 | test_persistent_networks.py
   test_vm_deployment_persistent_and_non_persistent_networks | `Error` | 1.48 | test_persistent_networks.py
   test_vm_deployment_two_persistent_networks | `Error` | 1.47 | test_persistent_networks.py
   test_volume_delete_event_errorState | `Error` | 0.40 | test_persistent_networks.py
   ContextSuite context=TestPersistentNetworks>:teardown | `Error` | 1.49 | test_persistent_networks.py
   test_account_operations_1_locked | `Error` | 1.47 | test_persistent_networks.py
   test_account_operations_2_disabled | `Error` | 1.49 | test_persistent_networks.py
   test_project_operations | `Error` | 3.62 | test_persistent_networks.py
   test_cleanup_persistent_network_1_true | `Error` | 1.56 | test_persistent_networks.py
   test_cleanup_persistent_network_2_false | `Error` | 1.50 | test_persistent_networks.py
   test_vpc_delete_account | `Failure` | 2.44 | test_persistent_networks.py
   test_vpc_force_delete_domain | `Failure` | 4.87 | test_persistent_networks.py
   test_vpc_network_life_cycle_1_delete | `Error` | 2.45 | test_persistent_networks.py
   test_vpc_network_life_cycle_2_restart | `Error` | 2.43 | test_persistent_networks.py
   test_associate_ip_address | `Error` | 1.21 | test_portable_ip.py
   test_associate_ip_address_services_enable_disable | `Failure` | 15.38 | test_portable_ip.py
   test_delete_account_services_enabled | `Error` | 21.00 | test_portable_ip.py
   ContextSuite context=TestDisassociatePublicIp>:setup | `Error` | 16.33 | test_portable_ip.py
   ContextSuite context=TestPortableIpTransferAcrossNetworks>:setup | `Error` | 17.38 | test_portable_ip.py
   test_03_vm_per_project | `Error` | 3.27 | test_project_limits.py
   test_04_publicip_per_project | `Error` | 4.23 | test_project_limits.py
   test_05_snapshots_per_project | `Error` | 4.22 | test_project_limits.py
   test_06_volumes_per_project | `Error` | 11.51 | test_project_limits.py
   test_03_network_create | `Error` | 11.73 | test_project_resources.py
   test_01_service_offerings | `Error` | 11.51 | test_project_resources.py
   ContextSuite context=TestPublicIpAddress>:setup | `Error` | 11.12 | test_project_resources.py
   test_06_create_snapshots_in_project | `Error` | 4.29 | test_project_resources.py
   test_04_public_private_template_use_in_project | `Failure` | 3.25 | test_project_resources.py
   test_05_use_private_template_in_project | `Failure` | 4.21 | test_project_resources.py
   ContextSuite context=TestLBRuleUsage>:setup | `Error` | 9.96 | test_project_usage.py
   ContextSuite context=TestNatRuleUsage>:setup | `Error` | 15.65 | test_project_usage.py
   ContextSuite context=TestPublicIPUsage>:setup | `Error` | 21.38 | test_project_usage.py
   ContextSuite context=TestSnapshotUsage>:setup | `Error` | 27.07 | test_project_usage.py
   test_01_vm_usage | `Error` | 4.28 | test_project_usage.py
   ContextSuite context=TestVolumeUsage>:setup | `Error` | 16.27 | test_project_usage.py
   ContextSuite context=TestVpnUsage>:setup | `Error` | 21.98 | test_project_usage.py
   test_01_multiple_domains_primary_storage_limits | `Failure` | 7.32 | test_ps_domain_limits.py
   test_02_multiple_domains_primary_storage_limits | `Failure` | 15.82 | test_ps_domain_limits.py
   test_03_multiple_domains_multiple_volumes | `Failure` | 15.83 | test_ps_domain_limits.py
   test_04_create_template_snapshot | `Failure` | 15.82 | test_ps_domain_limits.py
   test_05_assign_virtual_machine_different_domain | `Failure` | 15.83 | test_ps_domain_limits.py
   test_06_destroy_recover_vm | `Failure` | 16.72 | test_ps_domain_limits.py
   test_assign_vm_different_account_1_root_domain_admin | `Failure` | 10.74 | test_ps_limits.py
   test_assign_vm_different_account_2_child_domain_admin | `Failure` | 10.85 | test_ps_limits.py
   test_attach_detach_volume_1_root_domain_admin | `Failure` | 10.77 | test_ps_limits.py
   test_attach_detach_volume_2_child_domain_admin | `Failure` | 10.83 | test_ps_limits.py
   test_create_multiple_volumes_1_root_domain_admin | `Failure` | 9.77 | test_ps_limits.py
   test_create_multiple_volumes_2_child_domain_admin | `Failure` | 10.84 | test_ps_limits.py
   test_create_template_snapshot_1_root_domain_admin | `Failure` | 10.74 | test_ps_limits.py
   test_create_template_snapshot_2_child_domain_admin | `Failure` | 10.82 | test_ps_limits.py
   test_deploy_multiple_vm_1_root_domain_admin | `Failure` | 10.76 | test_ps_limits.py
   test_deploy_multiple_vm_2_child_domain_admin | `Failure` | 11.83 | test_ps_limits.py
   test_stop_start_vm_1_root_domain_admin | `Failure` | 10.79 | test_ps_limits.py
   test_stop_start_vm_2_child_domain_admin | `Failure` | 10.83 | test_ps_limits.py
   test_01_deploy_vm_domain_limit_reached | `Error` | 13.98 | test_ps_max_limits.py
   test_02_deploy_vm_account_limit_reached | `Error` | 13.96 | test_ps_max_limits.py
   test_03_deploy_vm_project_limit_reached | `Error` | 12.96 | test_ps_max_limits.py
   test_01_increase_volume_size_within_account_limit | `Failure` | 2.52 | test_ps_resize_volume.py
   test_02_increase_volume_size_above_account_limit | `Failure` | 2.43 | test_ps_resize_volume.py
   test_03_increase_volume_size_above_domain_limit | `Failure` | 2.42 | test_ps_resize_volume.py
   test_attach_volume_exceeding_primary_limits | `Failure` | 10.79 | test_ps_resource_limits_volume.py
   ContextSuite context=TestRecurringSnapshots>:setup | `Error` | 0.00 | test_recurring_snapshots.py
   test_network_gc | `Error` | 9.74 | test_redundant_router_cleanups.py
   test_restart_network_with_destroyed_masterVR | `Error` | 9.72 | test_redundant_router_cleanups.py
   test_restart_ntwk_no_cleanup | `Error` | 10.72 | test_redundant_router_cleanups.py
   test_restart_ntwk_with_cleanup | `Error` | 9.72 | test_redundant_router_cleanups.py
   test_enableVPNOverRvR | `Error` | 9.73 | test_redundant_router_services.py
   test_downgradeRvR_to_VR | `Error` | 9.72 | test_redundant_router_upgrades.py
   test_upgradeVR_to_redundantVR | `Error` | 9.72 | test_redundant_router_upgrades.py
   ContextSuite context=TestResetSSHKeyUserRights>:setup | `Error` | 0.00 | test_reset_ssh_keypair.py
   test_01_resource_count_vm_with_normal_offering_in_all_states | `Failure` | 3.27 | test_resource_count_running_vms.py
   test_02_resource_count_vm_with_dynamic_offering_in_all_states | `Failure` | 4.26 | test_resource_count_running_vms.py
   test_03_resource_count_vm_with_normal_offering_in_running_state | `Failure` | 4.25 | test_resource_count_running_vms.py
   test_04_resource_count_vm_with_dynamic_offering_in_running_state | `Failure` | 4.26 | test_resource_count_running_vms.py
   test_05_resource_count_vm_with_dynamic_offering_in_running_state_failed_cases | `Failure` | 7.66 | test_resource_count_running_vms.py
   test_06_resource_count_vm_with_dynamic_offering_in_all_states_failed_cases | `Failure` | 0.20 | test_resource_count_running_vms.py
   test_07_resource_count_vm_in_running_state_and_move_and_upgrade | `Failure` | 1.20 | test_resource_count_running_vms.py
   test_08_resource_count_vm_in_all_states_and_move_and_upgrade | `Failure` | 0.11 | test_resource_count_running_vms.py
   test_01_vm_per_account | `Error` | 123.36 | test_resource_limits.py
   test_02_publicip_per_account | `Error` | 124.34 | test_resource_limits.py
   test_03_snapshots_per_account | `Error` | 124.30 | test_resource_limits.py
   test_04_volumes_per_account | `Error` | 124.35 | test_resource_limits.py
   test_05_templates_per_account | `Failure` | 123.50 | test_resource_limits.py
   test_01_publicip_per_domain | `Error` | 123.38 | test_resource_limits.py
   test_01_vm_per_domain | `Error` | 124.32 | test_resource_limits.py
   test_03_snapshots_per_domain | `Error` | 123.32 | test_resource_limits.py
   test_04_volumes_per_domain | `Error` | 124.33 | test_resource_limits.py
   test_05_templates_per_domain | `Failure` | 124.43 | test_resource_limits.py
   test_01_create__snapshot_new_resized_rootvolume_size | `Error` | 5.30 | test_rootvolume_resize.py
   test_02_create__template_new_resized_rootvolume_size | `Error` | 4.75 | test_rootvolume_resize.py
   test_02_create__template_new_resized_rootvolume_size | `Error` | 4.75 | test_rootvolume_resize.py
   test_03_vmsnapshot__on_resized_rootvolume_vm | `Error` | 5.26 | test_rootvolume_resize.py
   test_04_vmreset_after_migrate_vm__rootvolume_resized | `Error` | 3.19 | test_rootvolume_resize.py
   test_08_increase_volume_size_within_account_limit | `Failure` | 1.47 | test_rootvolume_resize.py
   test_08_increase_volume_size_within_account_limit | `Error` | 1.48 | test_rootvolume_resize.py
   test_5_vmdeployment_with_size | `Error` | 5.34 | test_rootvolume_resize.py
   test_6_resized_rootvolume_with_lessvalue | `Error` | 3.21 | test_rootvolume_resize.py
   test_7_usage_events_after_rootvolume_resized_ | `Error` | 4.21 | test_rootvolume_resize.py
   ContextSuite context=TestRouterServices>:setup | `Error` | 0.00 | test_routers.py
   ContextSuite context=TestRouterStopCreateFW>:setup | `Error` | 0.00 | test_routers.py
   ContextSuite context=TestRouterStopCreateLB>:setup | `Error` | 0.00 | test_routers.py
   ContextSuite context=TestRouterStopCreatePF>:setup | `Error` | 0.00 | test_routers.py
   runTest | `Error` | 0.00 | test_secsr_mount.py
   runTest | `Error` | 0.00 | test_secsr_mount.py
   test_01_snapshot_data_disk | `Error` | 4.57 | test_separate_backup_from_snapshot.py
   test_acquire_ip | `Error` | 65.96 | test_shared_networks.py
   test_createSharedNetwork_All | `Error` | 68.53 | test_shared_networks.py
   test_createSharedNetwork_accountSpecific | `Error` | 74.69 | test_shared_networks.py
   test_createSharedNetwork_domainSpecific | `Error` | 77.16 | test_shared_networks.py
   test_createSharedNetwork_projectSpecific | `Error` | 77.56 | test_shared_networks.py
   test_deployVM_isolatedAndShared | `Error` | 72.64 | test_shared_networks.py
   test_deployVM_multipleSharedNetwork | `Error` | 74.68 | test_shared_networks.py
   test_reboot_router | `Error` | 67.05 | test_shared_networks.py
   test_restart_network_1_True | `Error` | 65.96 | test_shared_networks.py
   test_restart_network_2_False | `Error` | 65.96 | test_shared_networks.py
   test_stop_start_router | `Error` | 68.22 | test_shared_networks.py
   ContextSuite context=TestMultipleVolumeAttach>:setup | `Error` | 0.00 | test_simultaneous_volume_attach.py
   ContextSuite context=TestAccountSnapshotClean>:setup | `Error` | 0.00 | test_snapshot_gc.py
   ContextSuite context=TestSnapshotLimit>:setup | `Error` | 0.00 | test_snapshot_limits.py
   test_01_concurrent_snapshots_live_migrate | `Failure` | 9.80 | test_snapshots_improvement.py
   test_02_stop_vm_concurrent_snapshots | `Failure` | 9.78 | test_snapshots_improvement.py
   test_03_concurrent_snapshots_create_template | `Failure` | 10.80 | test_snapshots_improvement.py
   test_04_concurrent_snapshots_create_volume | `Failure` | 9.76 | test_snapshots_improvement.py
   test_01_snapshot_on_rootVolume | `Error` | 3.25 | test_snapshots_improvement.py
   test_01_createVM_snapshotTemplate | `Error` | 4.35 | test_snapshots.py
   ContextSuite context=TestSnapshotEvents>:setup | `Error` | 14.19 | test_snapshots.py
   test_01_volume_from_snapshot | `Error` | 5.59 | test_snapshots.py
   test_02_snapshot_data_disk | `Error` | 3.54 | test_snapshots.py
   test_03_snapshot_detachedDisk | `Error` | 4.58 | test_snapshots.py
   test_04_delete_snapshot | `Error` | 3.55 | test_snapshots.py
   test_07_template_from_snapshot | `Error` | 4.58 | test_snapshots.py
   runTest | `Error` | 0.00 | test_ss_domain_limits.py
   runTest | `Error` | 0.00 | test_ss_domain_limits.py
   test_01_register_template_1_root_domain_admin | `Failure` | 149.00 | test_ss_limits.py
   test_01_register_template_2_child_domain_admin | `Failure` | 150.09 | test_ss_limits.py
   test_02_create_template_snapshot_1_root_domain_admin | `Error` | 10.75 | test_ss_limits.py
   test_02_create_template_snapshot_2_child_domain_admin | `Error` | 10.81 | test_ss_limits.py
   test_03_register_iso_1_root_domain_admin | `Failure` | 61.53 | test_ss_limits.py
   test_03_register_iso_2_child_domain_admin | `Failure` | 62.60 | test_ss_limits.py
   test_01_deploy_vm_domain_limit_reached | `Failure` | 30.96 | test_ss_max_limits.py
   test_02_deploy_vm_account_limit_reached | `Failure` | 31.02 | test_ss_max_limits.py
   test_03_deploy_vm_project_limit_reached | `Failure` | 31.02 | test_ss_max_limits.py
   test_01_register_template_with_project | `Failure` | 31.96 | test_ss_project_limits.py
   test_02_register_iso | `Failure` | 67.16 | test_ss_project_limits.py
   ContextSuite context=TestSecondaryVolumeUsage>:setup | `Error` | 0.00 | test_ss_volume_usage.py
   test_02_deploy_ha_vm_from_iso | `Error` | 15.81 | test_stopped_vm.py
   test_deployVmOnGivenHost | `Failure` | 8.70 | test_stopped_vm.py
   test_01_deploy_vm_no_startvm | `Error` | 9.68 | test_stopped_vm.py
   test_02_deploy_vm_startvm_true | `Error` | 9.68 | test_stopped_vm.py
   test_05_deploy_startvm_false_change_so | `Error` | 11.88 | test_stopped_vm.py
   test_08_deploy_attached_volume | `Error` | 18.01 | test_stopped_vm.py
   test_09_stop_vm_migrate_vol | `Error` | 7.71 | test_stopped_vm.py
   test_deploy_vm_password_enabled | `Error` | 38.08 | test_stopped_vm.py
   test_01_deploy_vm_no_startvm | `Error` | 18.01 | test_stopped_vm.py
   ContextSuite context=TestStorageMotion>:setup | `Error` | 0.00 | test_storage_motion.py
   ContextSuite context=TestResourceTags>:setup | `Error` | 0.00 | test_tags.py
   test_01_create_template_snampshot | `Error` | 90.65 | test_template_from_snapshot_with_template_details.py
   test_01_create_template | `Error` | 90.66 | test_templates.py
   test_01_updateResourceCount | `Error` | 7.68 | test_updateResourceCount.py
   test_update_vm_name | `Error` | 9.78 | test_update_vm.py
   ContextSuite context=TestVRServiceFailureAlerting>:setup | `Error` | 0.00 | test_VirtualRouter_alerts.py
   ContextSuite context=TestVMPasswordEnabled>:setup | `Error` | 0.00 | test_vm_passwdenabled.py
   test_01_create_vm_with_data_disk | `Failure` | 5.24 | test_volume_destroy_recover.py
   test_03_destroy_detached_volume | `Failure` | 4.21 | test_volume_destroy_recover.py
   test_04_recover_root_volume_after_restorevm | `Failure` | 4.20 | test_volume_destroy_recover.py
   test_05_extract_root_volume_and_destroy_vm | `Failure` | 4.20 | test_volume_destroy_recover.py
   test_06_delete_network | `Error` | 1.05 | test_volume_destroy_recover.py
   ContextSuite context=TestAttachDetachVolume>:setup | `Error` | 0.00 | test_volumes.py
   ContextSuite context=TestAttachVolume>:setup | `Error` | 0.00 | test_volumes.py
   ContextSuite context=TestAttachVolumeISO>:setup | `Error` | 0.00 | test_volumes.py
   ContextSuite context=TestMigrateVolume>:setup | `Error` | 6.89 | test_volumes.py
   ContextSuite context=TestVolumes>:setup | `Error` | 11.58 | test_volumes.py
   test_01_internallb_rules | `Error` | 2.53 | test_vpc_network_internal_lbrules.py
   test_02_internallb_rules_traffic | `Error` | 3.53 | test_vpc_network_internal_lbrules.py
   test_03_internallb_rules_vpc_network_restarts_traffic | `Error` | 3.53 | test_vpc_network_internal_lbrules.py
   test_04_internallb_appliance_operations_traffic | `Error` | 3.54 | test_vpc_network_internal_lbrules.py
   test_01_VPC_LBRulesListing | `Error` | 2.49 | test_vpc_network_lbrules.py
   test_02_VPC_CreateLBRuleInMultipleNetworks | `Error` | 3.50 | test_vpc_network_lbrules.py
   test_03_VPC_CreateLBRuleInMultipleNetworksVRStoppedState | `Error` | 3.52 | test_vpc_network_lbrules.py
   test_04_VPC_CreateLBRuleInMultipleNetworksVRStoppedState | `Error` | 2.50 | test_vpc_network_lbrules.py
   test_05_VPC_CreateAndDeleteLBRule | `Error` | 2.49 | test_vpc_network_lbrules.py
   test_06_VPC_CreateAndDeleteLBRuleVRStopppedState | `Error` | 2.51 | test_vpc_network_lbrules.py
   test_07_VPC_CreateAndDeleteAllLBRule | `Error` | 3.57 | test_vpc_network_lbrules.py
   test_08_VPC_CreateAndDeleteAllLBRuleVRStoppedState | `Error` | 2.52 | test_vpc_network_lbrules.py
   test_09_VPC_LBRuleCreateFailMultipleVPC | `Error` | 2.51 | test_vpc_network_lbrules.py
   test_10_VPC_FailedToCreateLBRuleNonVPCNetwork | `Error` | 2.49 | test_vpc_network_lbrules.py
   test_11_VPC_LBRuleCreateNotAllowed | `Error` | 3.51 | test_vpc_network_lbrules.py
   test_12_VPC_LBRuleCreateFailForRouterIP | `Error` | 3.51 | test_vpc_network_lbrules.py
   test_13_VPC_LBRuleCreateFailForPFSourceNATIP | `Error` | 2.52 | test_vpc_network_lbrules.py
   test_14_VPC_LBRuleCreateFailForStaticNatRule | `Error` | 3.53 | test_vpc_network_lbrules.py
   test_15_VPC_ReleaseIPForLBRuleCreated | `Error` | 3.51 | test_vpc_network_lbrules.py
   runTest | `Error` | 0.00 | test_vpc_network_pfrules.py
   runTest | `Error` | 0.00 | test_vpc_network_pfrules.py
   ContextSuite context=TestRouterOperations>:setup | `Error` | 0.00 | test_vpc_network.py
   test_01_create_network_1_network_offering | `Error` | 2.48 | test_vpc_network.py
   test_02_create_network_fail_1_network_offering | `Error` | 2.47 | test_vpc_network.py
   test_07_create_network_unsupported_services | `Error` | 5.65 | test_vpc_network.py
   test_08_create_network_without_sourceNAT | `Error` | 4.62 | test_vpc_network.py
   test_09_create_network_shared_nwoff_1_network_off_shared | `Error` | 2.46 | test_vpc_network.py
   ContextSuite context=TestVPCNetworkGc>:setup | `Error` | 4.01 | test_vpc_network.py
   test_01_create_network_outside_range_1_network_offering | `Error` | 2.48 | test_vpc_network.py
   test_02_create_network_outside_range | `Error` | 4.66 | test_vpc_network.py
   test_03_create_network_inside_range_1_network_offering | `Error` | 2.48 | test_vpc_network.py
   test_04_create_network_overlapping_range_1_network_offering | `Error` | 2.50 | test_vpc_network.py
   test_05_create_network_diff_account_1_network_offering | `Error` | 2.47 | test_vpc_network.py
   test_01_network_services_upgrade | `Error` | 2.46 | test_vpc_network.py
   test_02_network_vpcvr2vr_upgrade | `Error` | 4.63 | test_vpc_network.py
   test_01_VPC_StaticNatRuleCreateStoppedState | `Error` | 3.51 | test_vpc_network_staticnatrule.py
   test_02_VPC_CreateStaticNatRule | `Error` | 3.52 | test_vpc_network_staticnatrule.py
   test_03_VPC_StopCreateMultipleStaticNatRuleStopppedState | `Error` | 2.50 | test_vpc_network_staticnatrule.py
   test_04_VPC_CreateMultipleStaticNatRule | `Error` | 2.51 | test_vpc_network_staticnatrule.py
   test_05_network_services_VPC_DeleteAllPF | `Error` | 3.51 | test_vpc_network_staticnatrule.py
   test_06_network_services_VPC_DeleteAllMultiplePF | `Error` | 2.50 | test_vpc_network_staticnatrule.py
   test_02_deploy_vms_in_vpc_nw | `Error` | 4.66 | test_vpc_offerings.py
   test_03_vpc_off_without_lb | `Error` | 5.83 | test_vpc_offerings.py
   test_04_vpc_off_without_static_nat | `Error` | 5.81 | test_vpc_offerings.py
   test_05_vpc_off_without_pf | `Error` | 5.80 | test_vpc_offerings.py
   test_07_update_vpc_off | `Error` | 5.73 | test_vpc_offerings.py
   test_09_create_redundant_vpc_offering | `Error` | 4.67 | test_vpc_offerings.py
   ContextSuite context=TestVPCRouterOneNetwork>:setup | `Error` | 0.00 | test_vpc_routers.py
   ContextSuite context=TestVPCRoutersBasic>:setup | `Error` | 0.00 | test_vpc_routers.py
   ContextSuite context=TestVMLifeCycleBothIsolated>:setup | `Error` | 0.00 | test_vpc_vm_life_cycle.py
   ContextSuite context=TestVMLifeCycleDiffHosts>:setup | `Error` | 0.00 | test_vpc_vm_life_cycle.py
   ContextSuite context=TestVMLifeCycleSharedNwVPC>:setup | `Error` | 0.00 | test_vpc_vm_life_cycle.py
   ContextSuite context=TestVMLifeCycleStoppedVPCVR>:setup | `Error` | 0.00 | test_vpc_vm_life_cycle.py
   ContextSuite context=TestVMLifeCycleVPC>:setup | `Error` | 0.00 | test_vpc_vm_life_cycle.py
   test_01_deploy_vms_in_network | `Error` | 4.59 | test_vpc_vms_deployment.py
   test_02_deploy_vms_delete_network | `Error` | 4.61 | test_vpc_vms_deployment.py
   test_03_deploy_vms_delete_add_network | `Error` | 4.60 | test_vpc_vms_deployment.py
   test_04_deploy_vms_delete_add_network_noLb | `Error` | 4.60 | test_vpc_vms_deployment.py
   test_05_create_network_max_limit | `Error` | 4.60 | test_vpc_vms_deployment.py
   test_06_delete_network_vm_running | `Error` | 4.62 | test_vpc_vms_deployment.py
   test_07_delete_network_with_rules | `Error` | 4.58 | test_vpc_vms_deployment.py
   test_08_ip_reallocation_CS5986 | `Error` | 2.44 | test_vpc_vms_deployment.py
   test_01_VPN_service | `Error` | 5.62 | test_vpn_service.py
   test_01_VPN_user_limit | `Error` | 3.54 | test_vpn_users.py
   test_02_use_vpn_port | `Error` | 3.54 | test_vpn_users.py
   test_03_enable_vpn_use_port | `Error` | 4.55 | test_vpn_users.py
   test_04_add_new_users | `Error` | 3.54 | test_vpn_users.py
   test_05_add_duplicate_user | `Error` | 4.55 | test_vpn_users.py
   test_06_add_VPN_user_global_admin | `Error` | 3.54 | test_vpn_users.py
   test_07_add_VPN_user_domain_admin | `Error` | 4.56 | test_vpn_users.py
   test_08_add_TCP_PF_Rule_In_VPN | `Error` | 3.55 | test_vpn_users.py
   test_deployVM_verify_metadata_in_VR | `Error` | 5.49 | test_vr_metadata.py
   test_deployVM_verify_metadata_in_VR | `Error` | 5.49 | test_vr_metadata.py
   test_deployVM_verify_metadata_in_VR_after_migration | `Error` | 5.48 | test_vr_metadata.py
   test_deployVM_verify_metadata_in_VR_after_migration | `Error` | 5.48 | test_vr_metadata.py
   test_CLOUDSTACK_6181_stoppedvm_root_resize | `Error` | 13.57 | test_bugs.py
   test_CLOUDSTACK_6181_vm_root_resize | `Error` | 5.24 | test_bugs.py
   test_es_1863_register_template_s3_domain_admin_user | `Error` | 2.55 | test_bugs.py
   test_01_dedicate_guest_vlan_range_root_domain | `Error` | 5.09 | test_dedicate_guest_vlan_ranges.py
   test_02_dedicate_guest_vlan_range_user_domain | `Error` | 6.14 | test_dedicate_guest_vlan_ranges.py
   test_03_multiple_guest_netwoks | `Error` | 4.77 | test_dedicate_guest_vlan_ranges.py
   test_02_delete_dedicated_vlan_range_vlan_in_use | `Error` | 3.71 | test_dedicate_guest_vlan_ranges.py
   test_03_delete_account | `Error` | 3.63 | test_dedicate_guest_vlan_ranges.py
   test_05_release_range_vlan_in_use | `Error` | 3.61 | test_dedicate_guest_vlan_ranges.py
   test_05_acquire_ip_single_guest_network | `Error` | 4.06 | test_dedicate_public_ip_range.py
   test_06_acquire_ip_multiple_guest_network | `Error` | 4.14 | test_dedicate_public_ip_range.py
   test_08_acquire_ip_in_vpc | `Error` | 3.86 | test_dedicate_public_ip_range.py
   test_14_release_ip_from_dedicated_range | `Error` | 1.82 | test_dedicate_public_ip_range.py
   test_16_delete_ip_range_no_network_rules | `Error` | 1.81 | test_dedicate_public_ip_range.py
   test_17_delete_ip_range_network_rules | `Error` | 1.82 | test_dedicate_public_ip_range.py
   test_18_delete_network | `Error` | 1.81 | test_dedicate_public_ip_range.py
   test_19_delete_account | `Error` | 1.79 | test_dedicate_public_ip_range.py
   test_01_op_host_capacity_disable_cluster | `Failure` | 0.02 | test_escalations_hosts.py
   test_02_op_host_capacity_disable_pod | `Failure` | 0.01 | test_escalations_hosts.py
   test_03_op_host_capacity_disable_zone | `Failure` | 0.01 | test_escalations_hosts.py
   test_04_disable_host_unmanage_cluster_check_hosts_status | `Error` | 200.19 | test_escalations_hosts.py
   test_01_CS40139_listtemplate_with_different_pagesize | `Error` | 1.06 | test_escalation_templates.py
   test_02_template_permissions | `Error` | 94.96 | test_escalation_templates.py
   test_02_template_permissions | `Error` | 94.96 | test_escalation_templates.py
   ContextSuite context=TestlistTemplates>:teardown | `Error` | 97.14 | test_escalation_templates.py
   test_01_deploy_vm_with_explicit_dedication | `Error` | 2.62 | test_explicit_dedication.py
   test_ha_with_storage_maintenance | `Error` | 0.36 | test_ha_pool_maintenance.py
   test_ha_with_storage_maintenance | `Error` | 0.37 | test_ha_pool_maintenance.py
   test_01_ip_resouce_count_vpc_network | `Error` | 3.68 | test_ip_resource_count_for_vpc.py
   test_RvR_multihosts | `Error` | 1.61 | test_redundant_router_deployment_planning.py
   test_RvR_multiprimarystorage | `Error` | 1.59 | test_redundant_router_deployment_planning.py
   test_applyNetworkRules_MasterDown_deleteNetworkRules | `Error` | 7.78 | test_redundant_router_network_rules.py
   test_applyRules_restartRvRNetwork | `Error` | 7.75 | test_redundant_router_network_rules.py
   test_apply_and__delete_NetworkRulesOnRvR | `Error` | 7.75 | test_redundant_router_network_rules.py
   test_networkRules_afterRebootRouters | `Error` | 7.76 | test_redundant_router_network_rules.py
   test_createRvRNetwork | `Error` | 7.75 | test_redundant_router.py
   test_createRvRNetwork | `Error` | 7.75 | test_redundant_router.py
   test_redundantVR_internals | `Error` | 7.76 | test_redundant_router.py
   test_01_stopMasterRvR | `Error` | 1.59 | test_redundant_router.py
   test_02_stopBackupRvR | `Error` | 1.55 | test_redundant_router.py
   test_03_rebootMasterRvR | `Error` | 1.56 | test_redundant_router.py
   test_04_rebootBackupRvR | `Error` | 1.55 | test_redundant_router.py
   test_05_stopBackupRvR_startInstance | `Error` | 1.57 | test_redundant_router.py
   ContextSuite context=TestRvRRedundancy>:teardown | `Error` | 1.70 | test_redundant_router.py
   ContextSuite context=TestVMLifeCycleHostmaintenance>:setup | `Error` | 0.00 | test_vpc_host_maintenance.py
   ContextSuite context=TestVPCHostMaintenance>:setup | `Error` | 0.00 | test_vpc_on_host_maintenance.py
   ContextSuite context=TestSystemVmLocalStorage>:setup | `Error` | 0.00 | test_zone_level_local_storage_setting.py
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] GabrielBrascher commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
GabrielBrascher commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-786244698


   @blueorangutan package


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] rhtyd merged pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
rhtyd merged pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-828885863


   <b>Trillian test result (tid-553)</b>
   Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
   Total time taken: 32754 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t553-kvm-centos7.zip
   Smoke tests completed. 88 look OK, 0 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] DaanHoogland removed a comment on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
DaanHoogland removed a comment on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-827617708


   @blueorangutan test matrix


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-786633689


   Packaging result: ✔centos7 ✔centos8 ✔debian. JID-2842


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] rhtyd commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
rhtyd commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-786500292


   @blueorangutan package


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan removed a comment on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan removed a comment on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-798945406






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-799900332


   <b>[S] Trillian test result (tid-143)</b>
   Environment: kvm-ubuntu20 (x2), Advanced Networking with Mgmt server u20
   Total time taken: 36843 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t143-kvm-ubuntu20.zip
   Intermittent failure detected: /marvin/tests/smoke/test_internal_lb.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_network_ops.py
   Smoke tests completed. 85 look OK, 1 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true | `Failure` | 138.88 | test_routers_network_ops.py
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan removed a comment on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan removed a comment on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-795474322


   Packaging result: :heavy_check_mark: centos7 :heavy_check_mark: centos8 :heavy_check_mark: debian. SL-JID 77


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-788749453


   @DaanHoogland a Trillian-Jenkins matrix job (centos7 mgmt + xs71, centos7 mgmt + vmware65, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-795474322


   Packaging result: :heavy_check_mark: centos7 :heavy_check_mark: centos8 :heavy_check_mark: debian. SL-JID 77


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan removed a comment on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan removed a comment on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-791474021


   <b>Trillian test result (tid-3667)</b>
   Environment: kvm-centos8 (x2), Advanced Networking with Mgmt server 8
   Total time taken: 1277 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t3667-kvm-centos8.zip
   Smoke tests completed. 0 look OK, 1 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-828054528


   <b>Trillian test result (tid-543)</b>
   Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
   Total time taken: 37577 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t543-kvm-centos7.zip
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_vpn.py
   Smoke tests completed. 88 look OK, 0 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] DaanHoogland commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
DaanHoogland commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-795134343


   most errors explained: str vs byte[] in python3 vr scripts. need cleaning up.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-794523506


   <b>Trillian test result (tid-3679)</b>
   Environment: kvm-ubuntu20 (x2), Advanced Networking with Mgmt server u20
   Total time taken: 43932 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t3679-kvm-ubuntu20.zip
   Intermittent failure detected: /marvin/tests/smoke/test_accounts.py
   Intermittent failure detected: /marvin/tests/smoke/test_deploy_virtio_scsi_vm.py
   Intermittent failure detected: /marvin/tests/smoke/test_deploy_vm_with_userdata.py
   Intermittent failure detected: /marvin/tests/smoke/test_diagnostics.py
   Intermittent failure detected: /marvin/tests/smoke/test_domain_vpc_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_internal_lb.py
   Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_clusters.py
   Intermittent failure detected: /marvin/tests/smoke/test_loadbalance.py
   Intermittent failure detected: /marvin/tests/smoke/test_migration.py
   Intermittent failure detected: /marvin/tests/smoke/test_network_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_network.py
   Intermittent failure detected: /marvin/tests/smoke/test_password_server.py
   Intermittent failure detected: /marvin/tests/smoke/test_portforwardingrules.py
   Intermittent failure detected: /marvin/tests/smoke/test_privategw_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dhcphosts.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dns.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dnsservice.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_iptables_default_policy.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_network_ops.py
   Intermittent failure detected: /marvin/tests/smoke/test_service_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_usage.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_life_cycle.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_snapshots.py
   Intermittent failure detected: /marvin/tests/smoke/test_volumes.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_router_nics.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_vpn.py
   Smoke tests completed. 59 look OK, 27 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   test_DeleteDomain | `Error` | 125.89 | test_accounts.py
   test_DeleteDomain | `Error` | 125.90 | test_accounts.py
   test_forceDeleteDomain | `Failure` | 124.84 | test_accounts.py
   test_forceDeleteDomain | `Error` | 124.84 | test_accounts.py
   ContextSuite context=TestLoadBalance>:setup | `Error` | 0.00 | test_loadbalance.py
   test_04_verify_guest_lspci | `Error` | 715.85 | test_deploy_virtio_scsi_vm.py
   test_06_verify_guest_lspci_again | `Error` | 715.85 | test_deploy_virtio_scsi_vm.py
   test_01_native_to_native_network_migration | `Error` | 38.53 | test_migration.py
   test_02_native_to_native_vpc_migration | `Error` | 23.10 | test_migration.py
   test_network_acl | `Error` | 20.60 | test_network_acl.py
   test_delete_account | `Error` | 57.28 | test_network.py
   test_01_port_fwd_on_src_nat | `Error` | 1.14 | test_network.py
   test_02_port_fwd_on_non_src_nat | `Error` | 6.37 | test_network.py
   test_reboot_router | `Error` | 175.43 | test_network.py
   test_releaseIP | `Error` | 55.38 | test_network.py
   test_network_rules_acquired_public_ip_1_static_nat_rule | `Error` | 3.22 | test_network.py
   test_network_rules_acquired_public_ip_2_nat_rule | `Error` | 3.22 | test_network.py
   test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | `Error` | 3.24 | test_network.py
   test_deployvm_userdata | `Error` | 21.74 | test_deploy_vm_with_userdata.py
   test_deployvm_userdata_post | `Error` | 5.33 | test_deploy_vm_with_userdata.py
   test_13_retrieve_vr_default_files | `Error` | 1.10 | test_diagnostics.py
   test_14_retrieve_vr_one_file | `Error` | 1.11 | test_diagnostics.py
   test_15_retrieve_ssvm_default_files | `Error` | 1.10 | test_diagnostics.py
   test_16_retrieve_ssvm_single_file | `Error` | 1.10 | test_diagnostics.py
   test_17_retrieve_cpvm_default_files | `Error` | 1.11 | test_diagnostics.py
   test_18_retrieve_cpvm_single_file | `Error` | 1.10 | test_diagnostics.py
   test_03_create_vpc_domain_vpc_offering | `Error` | 22.35 | test_domain_vpc_offerings.py
   test_isolate_network_password_server | `Error` | 2.14 | test_password_server.py
   test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 | `Failure` | 24.06 | test_internal_lb.py
   test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 | `Failure` | 26.08 | test_internal_lb.py
   test_03_vpc_internallb_haproxy_stats_on_all_interfaces | `Failure` | 22.91 | test_internal_lb.py
   test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | `Failure` | 23.97 | test_internal_lb.py
   test_01_vpc_privategw_acl | `Failure` | 22.00 | test_privategw_acl.py
   test_02_vpc_privategw_static_routes | `Failure` | 22.00 | test_privategw_acl.py
   test_03_vpc_privategw_restart_vpc_cleanup | `Failure` | 22.06 | test_privategw_acl.py
   test_04_rvpc_privategw_static_routes | `Failure` | 24.03 | test_privategw_acl.py
   test_01_deploy_kubernetes_cluster | `Failure` | 26.09 | test_kubernetes_clusters.py
   test_02_invalid_upgrade_kubernetes_cluster | `Failure` | 23.84 | test_kubernetes_clusters.py
   test_03_deploy_and_upgrade_kubernetes_cluster | `Failure` | 23.72 | test_kubernetes_clusters.py
   test_04_deploy_and_scale_kubernetes_cluster | `Failure` | 22.68 | test_kubernetes_clusters.py
   test_05_delete_kubernetes_cluster | `Failure` | 23.67 | test_kubernetes_clusters.py
   test_07_deploy_kubernetes_ha_cluster | `Failure` | 23.74 | test_kubernetes_clusters.py
   test_08_deploy_and_upgrade_kubernetes_ha_cluster | `Failure` | 24.71 | test_kubernetes_clusters.py
   test_09_delete_kubernetes_ha_cluster | `Failure` | 23.70 | test_kubernetes_clusters.py
   ContextSuite context=TestKubernetesCluster>:teardown | `Error` | 156.30 | test_kubernetes_clusters.py
   test_01_create_delete_portforwarding_fornonvpc | `Error` | 100.14 | test_portforwardingrules.py
   test_01_create_delete_portforwarding_fornonvpc | `Error` | 100.14 | test_portforwardingrules.py
   test_router_dhcphosts | `Error` | 2.16 | test_router_dhcphosts.py
   ContextSuite context=TestRouterDHCPHosts>:teardown | `Error` | 11.44 | test_router_dhcphosts.py
   test_router_dhcp_opts | `Error` | 1.18 | test_router_dhcphosts.py
   test_router_dns_guestipquery | `Error` | 1.12 | test_router_dns.py
   test_router_dns_guestipquery | `Error` | 1.13 | test_router_dnsservice.py
   test_01_single_VPC_iptables_policies | `Error` | 21.66 | test_routers_iptables_default_policy.py
   test_01_isolate_network_FW_PF_default_routes_egress_true | `Error` | 69.36 | test_routers_network_ops.py
   test_02_isolate_network_FW_PF_default_routes_egress_false | `Error` | 64.21 | test_routers_network_ops.py
   test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true | `Error` | 96.14 | test_routers_network_ops.py
   test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false | `Error` | 97.97 | test_routers_network_ops.py
   test_03_RVR_Network_check_router_state | `Failure` | 95.87 | test_routers_network_ops.py
   test_01_service_offering_cpu_limit_use | `Error` | 716.33 | test_service_offerings.py
   test_04_change_offering_small | `Failure` | 817.17 | test_service_offerings.py
   test_01_lb_usage | `Error` | 1.15 | test_usage.py
   test_01_nat_usage | `Error` | 3.13 | test_usage.py
   test_01_vpn_usage | `Error` | 4.37 | test_usage.py
   ContextSuite context=TestSecuredVmMigration>:teardown | `Error` | 313.83 | test_vm_life_cycle.py
   ContextSuite context=TestVMLifeCycle>:setup | `Error` | 5.72 | test_vm_life_cycle.py
   test_01_create_vm_snapshots | `Failure` | 715.70 | test_vm_snapshots.py
   test_02_revert_vm_snapshots | `Failure` | 719.98 | test_vm_snapshots.py
   test_03_delete_vm_snapshots | `Failure` | 0.01 | test_vm_snapshots.py
   test_01_create_volume | `Failure` | 720.06 | test_volumes.py
   test_02_attach_volume | `Failure` | 750.42 | test_volumes.py
   test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | `Error` | 23.02 | test_vpc_redundant.py
   test_02_redundant_VPC_default_routes | `Error` | 24.16 | test_vpc_redundant.py
   test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | `Error` | 24.11 | test_vpc_redundant.py
   test_04_rvpc_network_garbage_collector_nics | `Error` | 24.04 | test_vpc_redundant.py
   test_05_rvpc_multi_tiers | `Error` | 24.01 | test_vpc_redundant.py
   test_01_VPC_nics_after_destroy | `Error` | 21.94 | test_vpc_router_nics.py
   test_02_VPC_default_routes | `Error` | 21.93 | test_vpc_router_nics.py
   test_01_redundant_vpc_site2site_vpn | `Failure` | 21.75 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn_multiple_options | `Failure` | 21.67 | test_vpc_vpn.py
   test_01_vpc_remote_access_vpn | `Failure` | 19.56 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn | `Failure` | 21.71 | test_vpc_vpn.py
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] DaanHoogland commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
DaanHoogland commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-792579408


   too many regressions, I'm going to call those environmental but will need to investigate :(


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-829316783


   @DaanHoogland a Trillian-Jenkins matrix job (centos7 mgmt + xs71, centos7 mgmt + vmware65, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] DaanHoogland commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
DaanHoogland commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-827511951


   @GabrielBrascher @rhtyd , the travis mix of python2 and python3 does not work as we desire. I disabled the systemvm part in travis. We'll need to reenable it once we succeeded in porting the full VR - and SVM functionality.
   I suggest we merge this and continue from there.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-829735681


   <b>Trillian test result (tid-557)</b>
   Environment: xenserver-71 (x2), Advanced Networking with Mgmt server 7
   Total time taken: 35552 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t557-xenserver-71.zip
   Intermittent failure detected: /marvin/tests/smoke/test_host_maintenance.py
   Smoke tests completed. 88 look OK, 0 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-798945406


   <b>[S] Trillian test result (tid-127)</b>
   Environment: xenserver-72 (x2), Advanced Networking with Mgmt server 7
   Total time taken: 36471 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t127-xenserver-72.zip
   Intermittent failure detected: /marvin/tests/smoke/test_accounts.py
   Intermittent failure detected: /marvin/tests/smoke/test_scale_vm.py
   Intermittent failure detected: /marvin/tests/smoke/test_host_maintenance.py
   Smoke tests completed. 84 look OK, 2 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   test_DeleteDomain | `Error` | 197.95 | test_accounts.py
   test_01_scale_vm | `Failure` | 9.24 | test_scale_vm.py
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] GabrielBrascher commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
GabrielBrascher commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-790652290


   Manual tests are looking fine. Tested on Advanced network with Security groups.
   Management node and KVM nodes are running in Ubuntu 18.04.
   
   1. Build from source & upgrade zone with the respective packages
   2. re-spawn VR & monitor cloud.log for errors
   3. launch VM
   4. check KVM agent log asserting no errors
   5. assert that iptables (ipv4 and ipv6) rules have been applied accordingly to the security group
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-791251217


   Packaging result: ✔centos7 ✔centos8 ✔debian. JID-2872


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan removed a comment on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan removed a comment on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-788749453






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-829255519


   Packaging result: :heavy_check_mark: centos7 :heavy_check_mark: centos8 :heavy_check_mark: debian. SL-JID 488


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-786514262


   Packaging result: ✖centos7 ✖centos8 ✖debian. JID-2837


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-789668650


   Packaging result: :heavy_check_mark: centos7 :heavy_check_mark: centos8 :heavy_check_mark: debian. SL-JID 46


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-791804534


   <b>Trillian test result (tid-3661)</b>
   Environment: vmware-67u3 (x2), Advanced Networking with Mgmt server 7
   Total time taken: 50233 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t3661-vmware-67u3.zip
   Intermittent failure detected: /marvin/tests/smoke/test_accounts.py
   Intermittent failure detected: /marvin/tests/smoke/test_deploy_vm_with_userdata.py
   Intermittent failure detected: /marvin/tests/smoke/test_diagnostics.py
   Intermittent failure detected: /marvin/tests/smoke/test_domain_vpc_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_internal_lb.py
   Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_clusters.py
   Intermittent failure detected: /marvin/tests/smoke/test_loadbalance.py
   Intermittent failure detected: /marvin/tests/smoke/test_migration.py
   Intermittent failure detected: /marvin/tests/smoke/test_nested_virtualization.py
   Intermittent failure detected: /marvin/tests/smoke/test_network_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_network.py
   Intermittent failure detected: /marvin/tests/smoke/test_nic.py
   Intermittent failure detected: /marvin/tests/smoke/test_password_server.py
   Intermittent failure detected: /marvin/tests/smoke/test_portforwardingrules.py
   Intermittent failure detected: /marvin/tests/smoke/test_privategw_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dhcphosts.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dns.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dnsservice.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_iptables_default_policy.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_network_ops.py
   Intermittent failure detected: /marvin/tests/smoke/test_scale_vm.py
   Intermittent failure detected: /marvin/tests/smoke/test_service_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_usage.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_life_cycle.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_snapshots.py
   Intermittent failure detected: /marvin/tests/smoke/test_volumes.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_router_nics.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_vpn.py
   Smoke tests completed. 57 look OK, 29 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   test_DeleteDomain | `Error` | 236.68 | test_accounts.py
   test_DeleteDomain | `Error` | 236.69 | test_accounts.py
   test_forceDeleteDomain | `Failure` | 231.59 | test_accounts.py
   test_forceDeleteDomain | `Error` | 231.59 | test_accounts.py
   ContextSuite context=TestLoadBalance>:setup | `Error` | 0.00 | test_loadbalance.py
   test_01_native_to_native_network_migration | `Error` | 81.10 | test_migration.py
   test_02_native_to_native_vpc_migration | `Error` | 47.31 | test_migration.py
   test_network_acl | `Error` | 32.76 | test_network_acl.py
   test_delete_account | `Error` | 94.89 | test_network.py
   test_01_port_fwd_on_src_nat | `Error` | 2.13 | test_network.py
   test_02_port_fwd_on_non_src_nat | `Error` | 5.26 | test_network.py
   test_reboot_router | `Error` | 209.97 | test_network.py
   test_releaseIP | `Error` | 98.03 | test_network.py
   test_network_rules_acquired_public_ip_1_static_nat_rule | `Error` | 3.17 | test_network.py
   test_network_rules_acquired_public_ip_2_nat_rule | `Error` | 3.17 | test_network.py
   test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | `Error` | 3.17 | test_network.py
   test_deployvm_userdata | `Error` | 52.26 | test_deploy_vm_with_userdata.py
   test_deployvm_userdata_post | `Error` | 5.39 | test_deploy_vm_with_userdata.py
   test_13_retrieve_vr_default_files | `Error` | 1.06 | test_diagnostics.py
   test_14_retrieve_vr_one_file | `Error` | 1.08 | test_diagnostics.py
   test_15_retrieve_ssvm_default_files | `Error` | 1.07 | test_diagnostics.py
   test_16_retrieve_ssvm_single_file | `Error` | 1.07 | test_diagnostics.py
   test_17_retrieve_cpvm_default_files | `Error` | 1.07 | test_diagnostics.py
   test_18_retrieve_cpvm_single_file | `Error` | 1.08 | test_diagnostics.py
   test_01_nic | `Error` | 1083.00 | test_nic.py
   test_03_nic_multiple_vmware | `Error` | 74.01 | test_nic.py
   test_03_create_vpc_domain_vpc_offering | `Error` | 34.51 | test_domain_vpc_offerings.py
   test_isolate_network_password_server | `Error` | 2.12 | test_password_server.py
   test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 | `Failure` | 44.32 | test_internal_lb.py
   test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 | `Failure` | 51.52 | test_internal_lb.py
   test_03_vpc_internallb_haproxy_stats_on_all_interfaces | `Failure` | 43.14 | test_internal_lb.py
   test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | `Failure` | 42.12 | test_internal_lb.py
   test_01_vpc_privategw_acl | `Failure` | 48.32 | test_privategw_acl.py
   test_02_vpc_privategw_static_routes | `Failure` | 34.04 | test_privategw_acl.py
   test_03_vpc_privategw_restart_vpc_cleanup | `Failure` | 33.08 | test_privategw_acl.py
   test_04_rvpc_privategw_static_routes | `Failure` | 36.15 | test_privategw_acl.py
   test_01_deploy_kubernetes_cluster | `Failure` | 60.87 | test_kubernetes_clusters.py
   test_02_invalid_upgrade_kubernetes_cluster | `Failure` | 53.24 | test_kubernetes_clusters.py
   test_03_deploy_and_upgrade_kubernetes_cluster | `Failure` | 58.33 | test_kubernetes_clusters.py
   test_04_deploy_and_scale_kubernetes_cluster | `Failure` | 67.54 | test_kubernetes_clusters.py
   test_05_delete_kubernetes_cluster | `Failure` | 56.27 | test_kubernetes_clusters.py
   test_07_deploy_kubernetes_ha_cluster | `Failure` | 58.51 | test_kubernetes_clusters.py
   test_08_deploy_and_upgrade_kubernetes_ha_cluster | `Failure` | 57.22 | test_kubernetes_clusters.py
   test_09_delete_kubernetes_ha_cluster | `Failure` | 58.24 | test_kubernetes_clusters.py
   ContextSuite context=TestKubernetesCluster>:teardown | `Error` | 249.68 | test_kubernetes_clusters.py
   test_nested_virtualization_vmware | `Error` | 1054.51 | test_nested_virtualization.py
   test_01_create_delete_portforwarding_fornonvpc | `Error` | 140.96 | test_portforwardingrules.py
   test_01_create_delete_portforwarding_fornonvpc | `Error` | 140.97 | test_portforwardingrules.py
   test_router_dhcphosts | `Error` | 2.12 | test_router_dhcphosts.py
   ContextSuite context=TestRouterDHCPHosts>:teardown | `Error` | 10.36 | test_router_dhcphosts.py
   test_router_dhcp_opts | `Error` | 2.15 | test_router_dhcphosts.py
   test_router_dns_guestipquery | `Error` | 2.10 | test_router_dns.py
   test_router_dns_guestipquery | `Error` | 2.12 | test_router_dnsservice.py
   test_01_single_VPC_iptables_policies | `Error` | 33.83 | test_routers_iptables_default_policy.py
   test_01_isolate_network_FW_PF_default_routes_egress_true | `Error` | 116.06 | test_routers_network_ops.py
   test_02_isolate_network_FW_PF_default_routes_egress_false | `Error` | 110.06 | test_routers_network_ops.py
   test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true | `Error` | 187.83 | test_routers_network_ops.py
   test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false | `Error` | 181.96 | test_routers_network_ops.py
   test_03_RVR_Network_check_router_state | `Failure` | 180.32 | test_routers_network_ops.py
   test_01_scale_vm | `Error` | 715.68 | test_scale_vm.py
   test_04_change_offering_small | `Failure` | 820.09 | test_service_offerings.py
   test_01_lb_usage | `Error` | 1.12 | test_usage.py
   test_01_nat_usage | `Error` | 3.12 | test_usage.py
   test_01_vpn_usage | `Error` | 4.25 | test_usage.py
   test_01_migrate_VM_and_root_volume | `Error` | 0.01 | test_vm_life_cycle.py
   test_02_migrate_VM_with_two_data_disks | `Error` | 0.01 | test_vm_life_cycle.py
   test_03_migrate_detached_volume | `Error` | 0.01 | test_vm_life_cycle.py
   ContextSuite context=TestVAppsVM>:setup | `Error` | 46.38 | test_vm_life_cycle.py
   test_10_attachAndDetach_iso | `Failure` | 721.69 | test_vm_life_cycle.py
   test_change_service_offering_for_vm_with_snapshots | `Failure` | 962.43 | test_vm_snapshots.py
   test_01_create_vm_snapshots | `Failure` | 715.45 | test_vm_snapshots.py
   test_02_revert_vm_snapshots | `Failure` | 720.28 | test_vm_snapshots.py
   test_03_delete_vm_snapshots | `Failure` | 0.02 | test_vm_snapshots.py
   test_01_create_volume | `Failure` | 721.93 | test_volumes.py
   test_02_attach_volume | `Failure` | 723.81 | test_volumes.py
   test_10_list_volumes | `Failure` | 365.61 | test_volumes.py
   test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | `Error` | 36.12 | test_vpc_redundant.py
   test_02_redundant_VPC_default_routes | `Error` | 36.12 | test_vpc_redundant.py
   test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | `Error` | 36.12 | test_vpc_redundant.py
   test_04_rvpc_network_garbage_collector_nics | `Error` | 42.37 | test_vpc_redundant.py
   test_05_rvpc_multi_tiers | `Error` | 37.12 | test_vpc_redundant.py
   test_01_VPC_nics_after_destroy | `Error` | 42.23 | test_vpc_router_nics.py
   test_02_VPC_default_routes | `Error` | 42.28 | test_vpc_router_nics.py
   test_01_redundant_vpc_site2site_vpn | `Failure` | 34.86 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn_multiple_options | `Failure` | 40.91 | test_vpc_vpn.py
   test_01_vpc_remote_access_vpn | `Failure` | 37.72 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn | `Failure` | 39.89 | test_vpc_vpn.py
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-829022314


   Packaging result: :heavy_check_mark: centos7 :heavy_check_mark: centos8 :heavy_check_mark: debian. SL-JID 485


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-785087277


   Packaging result: ✔centos7 ✔centos8 ✔debian. JID-2822


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-786050341


   Packaging result: ✔centos7 ✔centos8 ✖debian. JID-2828


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-793257020


   <b>[S] Trillian test result (tid-56)</b>
   Environment: xenserver-74 (x2), Advanced Networking with Mgmt server 7
   Total time taken: 43299 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t56-xenserver-74.zip
   Intermittent failure detected: /marvin/tests/smoke/test_accounts.py
   Intermittent failure detected: /marvin/tests/smoke/test_deploy_vm_with_userdata.py
   Intermittent failure detected: /marvin/tests/smoke/test_diagnostics.py
   Intermittent failure detected: /marvin/tests/smoke/test_domain_vpc_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_internal_lb.py
   Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_clusters.py
   Intermittent failure detected: /marvin/tests/smoke/test_loadbalance.py
   Intermittent failure detected: /marvin/tests/smoke/test_network_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_network.py
   Intermittent failure detected: /marvin/tests/smoke/test_password_server.py
   Intermittent failure detected: /marvin/tests/smoke/test_portforwardingrules.py
   Intermittent failure detected: /marvin/tests/smoke/test_privategw_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dhcphosts.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dns.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dnsservice.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_iptables_default_policy.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_network_ops.py
   Intermittent failure detected: /marvin/tests/smoke/test_scale_vm.py
   Intermittent failure detected: /marvin/tests/smoke/test_service_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_usage.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_life_cycle.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_snapshots.py
   Intermittent failure detected: /marvin/tests/smoke/test_volumes.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_router_nics.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_vpn.py
   Intermittent failure detected: /marvin/tests/smoke/test_hostha_kvm.py
   Smoke tests completed. 59 look OK, 27 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   test_DeleteDomain | `Error` | 259.49 | test_accounts.py
   test_DeleteDomain | `Error` | 259.50 | test_accounts.py
   test_forceDeleteDomain | `Failure` | 275.86 | test_accounts.py
   test_forceDeleteDomain | `Error` | 275.88 | test_accounts.py
   ContextSuite context=TestLoadBalance>:setup | `Error` | 0.00 | test_loadbalance.py
   test_network_acl | `Error` | 58.37 | test_network_acl.py
   test_delete_account | `Error` | 132.70 | test_network.py
   test_01_port_fwd_on_src_nat | `Error` | 3.16 | test_network.py
   test_02_port_fwd_on_non_src_nat | `Error` | 10.36 | test_network.py
   test_reboot_router | `Error` | 218.24 | test_network.py
   test_releaseIP | `Error` | 108.32 | test_network.py
   test_network_rules_acquired_public_ip_1_static_nat_rule | `Error` | 4.21 | test_network.py
   test_network_rules_acquired_public_ip_2_nat_rule | `Error` | 4.18 | test_network.py
   test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | `Error` | 4.18 | test_network.py
   test_deployvm_userdata | `Error` | 63.44 | test_deploy_vm_with_userdata.py
   test_deployvm_userdata_post | `Error` | 11.44 | test_deploy_vm_with_userdata.py
   test_13_retrieve_vr_default_files | `Error` | 1.08 | test_diagnostics.py
   test_14_retrieve_vr_one_file | `Error` | 1.10 | test_diagnostics.py
   test_15_retrieve_ssvm_default_files | `Error` | 1.08 | test_diagnostics.py
   test_16_retrieve_ssvm_single_file | `Error` | 1.09 | test_diagnostics.py
   test_17_retrieve_cpvm_default_files | `Error` | 1.08 | test_diagnostics.py
   test_18_retrieve_cpvm_single_file | `Error` | 1.08 | test_diagnostics.py
   test_03_create_vpc_domain_vpc_offering | `Error` | 57.98 | test_domain_vpc_offerings.py
   test_isolate_network_password_server | `Error` | 3.15 | test_password_server.py
   test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 | `Failure` | 62.66 | test_internal_lb.py
   test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 | `Failure` | 60.71 | test_internal_lb.py
   test_03_vpc_internallb_haproxy_stats_on_all_interfaces | `Failure` | 63.66 | test_internal_lb.py
   test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | `Failure` | 57.47 | test_internal_lb.py
   test_01_vpc_privategw_acl | `Failure` | 59.74 | test_privategw_acl.py
   test_02_vpc_privategw_static_routes | `Failure` | 55.70 | test_privategw_acl.py
   test_03_vpc_privategw_restart_vpc_cleanup | `Failure` | 59.77 | test_privategw_acl.py
   test_04_rvpc_privategw_static_routes | `Failure` | 57.78 | test_privategw_acl.py
   test_01_deploy_kubernetes_cluster | `Failure` | 70.88 | test_kubernetes_clusters.py
   test_02_invalid_upgrade_kubernetes_cluster | `Failure` | 65.59 | test_kubernetes_clusters.py
   test_03_deploy_and_upgrade_kubernetes_cluster | `Failure` | 65.45 | test_kubernetes_clusters.py
   test_04_deploy_and_scale_kubernetes_cluster | `Failure` | 62.52 | test_kubernetes_clusters.py
   test_05_delete_kubernetes_cluster | `Failure` | 61.43 | test_kubernetes_clusters.py
   test_07_deploy_kubernetes_ha_cluster | `Failure` | 66.48 | test_kubernetes_clusters.py
   test_08_deploy_and_upgrade_kubernetes_ha_cluster | `Failure` | 63.40 | test_kubernetes_clusters.py
   test_09_delete_kubernetes_ha_cluster | `Failure` | 117.32 | test_kubernetes_clusters.py
   ContextSuite context=TestKubernetesCluster>:teardown | `Error` | 289.57 | test_kubernetes_clusters.py
   test_01_create_delete_portforwarding_fornonvpc | `Error` | 179.79 | test_portforwardingrules.py
   test_01_create_delete_portforwarding_fornonvpc | `Error` | 179.80 | test_portforwardingrules.py
   test_router_dhcphosts | `Error` | 3.17 | test_router_dhcphosts.py
   ContextSuite context=TestRouterDHCPHosts>:teardown | `Error` | 17.51 | test_router_dhcphosts.py
   test_router_dhcp_opts | `Error` | 4.23 | test_router_dhcphosts.py
   test_router_dns_guestipquery | `Error` | 3.12 | test_router_dns.py
   test_router_dns_guestipquery | `Error` | 3.16 | test_router_dnsservice.py
   test_01_single_VPC_iptables_policies | `Error` | 59.26 | test_routers_iptables_default_policy.py
   test_01_isolate_network_FW_PF_default_routes_egress_true | `Error` | 136.51 | test_routers_network_ops.py
   test_02_isolate_network_FW_PF_default_routes_egress_false | `Error` | 116.19 | test_routers_network_ops.py
   test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true | `Error` | 210.18 | test_routers_network_ops.py
   test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false | `Error` | 216.64 | test_routers_network_ops.py
   test_03_RVR_Network_check_router_state | `Failure` | 193.16 | test_routers_network_ops.py
   test_01_scale_vm | `Failure` | 14.39 | test_scale_vm.py
   test_04_change_offering_small | `Failure` | 712.49 | test_service_offerings.py
   test_01_lb_usage | `Error` | 2.12 | test_usage.py
   test_01_nat_usage | `Error` | 6.18 | test_usage.py
   test_01_vpn_usage | `Error` | 9.38 | test_usage.py
   runTest | `Error` | 0.00 | test_vm_life_cycle.py
   runTest | `Error` | 0.00 | test_vm_life_cycle.py
   test_change_service_offering_for_vm_with_snapshots | `Failure` | 853.38 | test_vm_snapshots.py
   test_01_create_vm_snapshots | `Failure` | 600.65 | test_vm_snapshots.py
   test_02_revert_vm_snapshots | `Failure` | 600.60 | test_vm_snapshots.py
   test_03_delete_vm_snapshots | `Failure` | 0.02 | test_vm_snapshots.py
   test_01_create_volume | `Failure` | 607.01 | test_volumes.py
   test_02_attach_volume | `Failure` | 607.90 | test_volumes.py
   test_11_migrate_volume_and_change_offering | `Error` | 10.44 | test_volumes.py
   test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | `Error` | 60.70 | test_vpc_redundant.py
   test_02_redundant_VPC_default_routes | `Error` | 57.73 | test_vpc_redundant.py
   test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | `Error` | 61.78 | test_vpc_redundant.py
   test_04_rvpc_network_garbage_collector_nics | `Error` | 60.81 | test_vpc_redundant.py
   test_05_rvpc_multi_tiers | `Error` | 57.69 | test_vpc_redundant.py
   test_01_VPC_nics_after_destroy | `Error` | 59.69 | test_vpc_router_nics.py
   test_02_VPC_default_routes | `Error` | 59.60 | test_vpc_router_nics.py
   test_01_redundant_vpc_site2site_vpn | `Failure` | 61.40 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn_multiple_options | `Failure` | 56.31 | test_vpc_vpn.py
   test_01_vpc_remote_access_vpn | `Failure` | 58.18 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn | `Failure` | 49.14 | test_vpc_vpn.py
   runTest | `Error` | 0.00 | test_hostha_kvm.py
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan removed a comment on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan removed a comment on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-791742687






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-828563699


   @DaanHoogland a Trillian-Jenkins matrix job (centos7 mgmt + xs71, centos7 mgmt + vmware65, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-789272182


   <b>Trillian test result (tid-3636)</b>
   Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
   Total time taken: 42915 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t3636-kvm-centos7.zip
   Intermittent failure detected: /marvin/tests/smoke/test_accounts.py
   Intermittent failure detected: /marvin/tests/smoke/test_deploy_virtio_scsi_vm.py
   Intermittent failure detected: /marvin/tests/smoke/test_deploy_vm_with_userdata.py
   Intermittent failure detected: /marvin/tests/smoke/test_diagnostics.py
   Intermittent failure detected: /marvin/tests/smoke/test_domain_vpc_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_internal_lb.py
   Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_clusters.py
   Intermittent failure detected: /marvin/tests/smoke/test_loadbalance.py
   Intermittent failure detected: /marvin/tests/smoke/test_migration.py
   Intermittent failure detected: /marvin/tests/smoke/test_network_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_network.py
   Intermittent failure detected: /marvin/tests/smoke/test_password_server.py
   Intermittent failure detected: /marvin/tests/smoke/test_portforwardingrules.py
   Intermittent failure detected: /marvin/tests/smoke/test_privategw_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dhcphosts.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dns.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dnsservice.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_iptables_default_policy.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_network_ops.py
   Intermittent failure detected: /marvin/tests/smoke/test_service_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_usage.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_life_cycle.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_snapshots.py
   Intermittent failure detected: /marvin/tests/smoke/test_volumes.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_router_nics.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_vpn.py
   Smoke tests completed. 59 look OK, 27 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   test_DeleteDomain | `Error` | 128.50 | test_accounts.py
   test_DeleteDomain | `Error` | 128.51 | test_accounts.py
   test_forceDeleteDomain | `Failure` | 129.56 | test_accounts.py
   test_forceDeleteDomain | `Error` | 129.56 | test_accounts.py
   ContextSuite context=TestLoadBalance>:setup | `Error` | 0.00 | test_loadbalance.py
   test_04_verify_guest_lspci | `Error` | 715.74 | test_deploy_virtio_scsi_vm.py
   test_06_verify_guest_lspci_again | `Error` | 715.46 | test_deploy_virtio_scsi_vm.py
   test_01_native_to_native_network_migration | `Error` | 36.30 | test_migration.py
   test_02_native_to_native_vpc_migration | `Error` | 21.89 | test_migration.py
   test_network_acl | `Error` | 20.66 | test_network_acl.py
   test_delete_account | `Error` | 57.11 | test_network.py
   test_01_port_fwd_on_src_nat | `Error` | 2.12 | test_network.py
   test_02_port_fwd_on_non_src_nat | `Error` | 6.26 | test_network.py
   test_reboot_router | `Error` | 174.24 | test_network.py
   test_releaseIP | `Error` | 56.25 | test_network.py
   test_network_rules_acquired_public_ip_1_static_nat_rule | `Error` | 3.17 | test_network.py
   test_network_rules_acquired_public_ip_2_nat_rule | `Error` | 3.18 | test_network.py
   test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | `Error` | 3.29 | test_network.py
   test_deployvm_userdata | `Error` | 21.59 | test_deploy_vm_with_userdata.py
   test_deployvm_userdata_post | `Error` | 6.28 | test_deploy_vm_with_userdata.py
   test_13_retrieve_vr_default_files | `Error` | 1.06 | test_diagnostics.py
   test_14_retrieve_vr_one_file | `Error` | 1.07 | test_diagnostics.py
   test_15_retrieve_ssvm_default_files | `Error` | 1.07 | test_diagnostics.py
   test_16_retrieve_ssvm_single_file | `Error` | 1.06 | test_diagnostics.py
   test_17_retrieve_cpvm_default_files | `Error` | 1.06 | test_diagnostics.py
   test_18_retrieve_cpvm_single_file | `Error` | 1.06 | test_diagnostics.py
   test_03_create_vpc_domain_vpc_offering | `Error` | 23.14 | test_domain_vpc_offerings.py
   test_isolate_network_password_server | `Error` | 2.12 | test_password_server.py
   test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 | `Failure` | 21.85 | test_internal_lb.py
   test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 | `Failure` | 25.92 | test_internal_lb.py
   test_03_vpc_internallb_haproxy_stats_on_all_interfaces | `Failure` | 20.74 | test_internal_lb.py
   test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | `Failure` | 24.79 | test_internal_lb.py
   test_01_vpc_privategw_acl | `Failure` | 21.86 | test_privategw_acl.py
   test_02_vpc_privategw_static_routes | `Failure` | 19.79 | test_privategw_acl.py
   test_03_vpc_privategw_restart_vpc_cleanup | `Failure` | 21.84 | test_privategw_acl.py
   test_04_rvpc_privategw_static_routes | `Failure` | 23.93 | test_privategw_acl.py
   test_01_deploy_kubernetes_cluster | `Failure` | 22.77 | test_kubernetes_clusters.py
   test_02_invalid_upgrade_kubernetes_cluster | `Failure` | 22.60 | test_kubernetes_clusters.py
   test_03_deploy_and_upgrade_kubernetes_cluster | `Failure` | 21.57 | test_kubernetes_clusters.py
   test_04_deploy_and_scale_kubernetes_cluster | `Failure` | 21.55 | test_kubernetes_clusters.py
   test_05_delete_kubernetes_cluster | `Failure` | 22.57 | test_kubernetes_clusters.py
   test_07_deploy_kubernetes_ha_cluster | `Failure` | 21.54 | test_kubernetes_clusters.py
   test_08_deploy_and_upgrade_kubernetes_ha_cluster | `Failure` | 22.54 | test_kubernetes_clusters.py
   test_09_delete_kubernetes_ha_cluster | `Failure` | 23.57 | test_kubernetes_clusters.py
   ContextSuite context=TestKubernetesCluster>:teardown | `Error` | 155.00 | test_kubernetes_clusters.py
   test_01_create_delete_portforwarding_fornonvpc | `Error` | 99.81 | test_portforwardingrules.py
   test_01_create_delete_portforwarding_fornonvpc | `Error` | 99.82 | test_portforwardingrules.py
   test_router_dhcphosts | `Error` | 2.12 | test_router_dhcphosts.py
   ContextSuite context=TestRouterDHCPHosts>:teardown | `Error` | 11.36 | test_router_dhcphosts.py
   test_router_dhcp_opts | `Error` | 2.15 | test_router_dhcphosts.py
   test_router_dns_guestipquery | `Error` | 2.10 | test_router_dns.py
   test_router_dns_guestipquery | `Error` | 2.12 | test_router_dnsservice.py
   test_01_single_VPC_iptables_policies | `Error` | 20.50 | test_routers_iptables_default_policy.py
   test_01_isolate_network_FW_PF_default_routes_egress_true | `Error` | 65.11 | test_routers_network_ops.py
   test_02_isolate_network_FW_PF_default_routes_egress_false | `Error` | 64.06 | test_routers_network_ops.py
   test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true | `Error` | 102.59 | test_routers_network_ops.py
   test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false | `Error` | 102.07 | test_routers_network_ops.py
   test_03_RVR_Network_check_router_state | `Failure` | 96.30 | test_routers_network_ops.py
   test_01_service_offering_cpu_limit_use | `Error` | 716.14 | test_service_offerings.py
   test_04_change_offering_small | `Failure` | 816.87 | test_service_offerings.py
   test_01_lb_usage | `Error` | 2.13 | test_usage.py
   test_01_nat_usage | `Error` | 3.11 | test_usage.py
   test_01_vpn_usage | `Error` | 4.26 | test_usage.py
   ContextSuite context=TestSecuredVmMigration>:teardown | `Error` | 310.57 | test_vm_life_cycle.py
   ContextSuite context=TestVMLifeCycle>:setup | `Error` | 4.61 | test_vm_life_cycle.py
   test_01_create_vm_snapshots | `Failure` | 715.43 | test_vm_snapshots.py
   test_02_revert_vm_snapshots | `Failure` | 720.08 | test_vm_snapshots.py
   test_03_delete_vm_snapshots | `Failure` | 0.01 | test_vm_snapshots.py
   test_01_create_volume | `Failure` | 720.91 | test_volumes.py
   test_02_attach_volume | `Failure` | 751.90 | test_volumes.py
   test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | `Error` | 30.01 | test_vpc_redundant.py
   test_02_redundant_VPC_default_routes | `Error` | 30.04 | test_vpc_redundant.py
   test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | `Error` | 30.03 | test_vpc_redundant.py
   test_04_rvpc_network_garbage_collector_nics | `Error` | 32.12 | test_vpc_redundant.py
   test_05_rvpc_multi_tiers | `Error` | 27.97 | test_vpc_redundant.py
   test_01_VPC_nics_after_destroy | `Error` | 25.89 | test_vpc_router_nics.py
   test_02_VPC_default_routes | `Error` | 23.88 | test_vpc_router_nics.py
   test_01_redundant_vpc_site2site_vpn | `Failure` | 28.77 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn_multiple_options | `Failure` | 26.70 | test_vpc_vpn.py
   test_01_vpc_remote_access_vpn | `Failure` | 23.52 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn | `Failure` | 27.71 | test_vpc_vpn.py
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-829019785


   Packaging result: :heavy_check_mark: centos7 :heavy_check_mark: centos8 :heavy_multiplication_x: debian. SL-JID 484


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan removed a comment on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan removed a comment on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-829022314


   Packaging result: :heavy_check_mark: centos7 :heavy_check_mark: centos8 :heavy_check_mark: debian. SL-JID 485


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-796469825


   <b>[S] Trillian test result (tid-69)</b>
   Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
   Total time taken: 67490 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t69-kvm-centos7.zip
   Intermittent failure detected: /marvin/tests/smoke/test_accounts.py
   Intermittent failure detected: /marvin/tests/smoke/test_deploy_virtio_scsi_vm.py
   Intermittent failure detected: /marvin/tests/smoke/test_deploy_vm_with_userdata.py
   Intermittent failure detected: /marvin/tests/smoke/test_diagnostics.py
   Intermittent failure detected: /marvin/tests/smoke/test_domain_vpc_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_internal_lb.py
   Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_clusters.py
   Intermittent failure detected: /marvin/tests/smoke/test_loadbalance.py
   Intermittent failure detected: /marvin/tests/smoke/test_migration.py
   Intermittent failure detected: /marvin/tests/smoke/test_network_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_network.py
   Intermittent failure detected: /marvin/tests/smoke/test_password_server.py
   Intermittent failure detected: /marvin/tests/smoke/test_portable_publicip.py
   Intermittent failure detected: /marvin/tests/smoke/test_portforwardingrules.py
   Intermittent failure detected: /marvin/tests/smoke/test_privategw_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_reset_vm_on_reboot.py
   Intermittent failure detected: /marvin/tests/smoke/test_resource_accounting.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dhcphosts.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dns.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dnsservice.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_iptables_default_policy.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_network_ops.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers.py
   Intermittent failure detected: /marvin/tests/smoke/test_service_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_snapshots.py
   Intermittent failure detected: /marvin/tests/smoke/test_ssvm.py
   Intermittent failure detected: /marvin/tests/smoke/test_usage.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_life_cycle.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_snapshots.py
   Intermittent failure detected: /marvin/tests/smoke/test_volumes.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_router_nics.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_vpn.py
   Smoke tests completed. 54 look OK, 32 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   test_DeleteDomain | `Error` | 135.76 | test_accounts.py
   test_DeleteDomain | `Error` | 135.77 | test_accounts.py
   test_forceDeleteDomain | `Failure` | 141.93 | test_accounts.py
   test_forceDeleteDomain | `Error` | 141.93 | test_accounts.py
   ContextSuite context=TestLoadBalance>:setup | `Error` | 0.00 | test_loadbalance.py
   test_01_native_to_native_network_migration | `Error` | 43.54 | test_migration.py
   test_02_native_to_native_vpc_migration | `Error` | 27.04 | test_migration.py
   test_04_verify_guest_lspci | `Error` | 600.69 | test_deploy_virtio_scsi_vm.py
   test_06_verify_guest_lspci_again | `Error` | 600.70 | test_deploy_virtio_scsi_vm.py
   test_network_acl | `Error` | 27.68 | test_network_acl.py
   test_delete_account | `Error` | 79.56 | test_network.py
   test_01_port_fwd_on_src_nat | `Error` | 2.12 | test_network.py
   test_02_port_fwd_on_non_src_nat | `Error` | 7.34 | test_network.py
   test_reboot_router | `Error` | 181.46 | test_network.py
   test_releaseIP | `Error` | 64.50 | test_network.py
   test_network_rules_acquired_public_ip_1_static_nat_rule | `Error` | 3.16 | test_network.py
   test_network_rules_acquired_public_ip_2_nat_rule | `Error` | 3.18 | test_network.py
   test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | `Error` | 4.19 | test_network.py
   test_deployvm_userdata | `Error` | 44.02 | test_deploy_vm_with_userdata.py
   test_deployvm_userdata_post | `Error` | 8.36 | test_deploy_vm_with_userdata.py
   test_13_retrieve_vr_default_files | `Error` | 1.08 | test_diagnostics.py
   test_14_retrieve_vr_one_file | `Error` | 1.06 | test_diagnostics.py
   test_15_retrieve_ssvm_default_files | `Error` | 1.08 | test_diagnostics.py
   test_16_retrieve_ssvm_single_file | `Error` | 1.10 | test_diagnostics.py
   test_17_retrieve_cpvm_default_files | `Error` | 1.09 | test_diagnostics.py
   test_18_retrieve_cpvm_single_file | `Error` | 1.07 | test_diagnostics.py
   test_isolate_network_password_server | `Error` | 2.15 | test_password_server.py
   test_03_create_vpc_domain_vpc_offering | `Error` | 29.44 | test_domain_vpc_offerings.py
   ContextSuite context=TestPortablePublicIPAcquire>:teardown | `Error` | 31.42 | test_portable_publicip.py
   test_01_vpc_privategw_acl | `Failure` | 29.06 | test_privategw_acl.py
   test_02_vpc_privategw_static_routes | `Failure` | 29.08 | test_privategw_acl.py
   test_03_vpc_privategw_restart_vpc_cleanup | `Failure` | 26.02 | test_privategw_acl.py
   test_04_rvpc_privategw_static_routes | `Failure` | 28.09 | test_privategw_acl.py
   test_01_deploy_kubernetes_cluster | `Failure` | 29.01 | test_kubernetes_clusters.py
   test_02_invalid_upgrade_kubernetes_cluster | `Failure` | 27.81 | test_kubernetes_clusters.py
   test_03_deploy_and_upgrade_kubernetes_cluster | `Failure` | 28.82 | test_kubernetes_clusters.py
   test_04_deploy_and_scale_kubernetes_cluster | `Failure` | 31.80 | test_kubernetes_clusters.py
   test_05_delete_kubernetes_cluster | `Failure` | 31.80 | test_kubernetes_clusters.py
   test_07_deploy_kubernetes_ha_cluster | `Failure` | 31.84 | test_kubernetes_clusters.py
   test_08_deploy_and_upgrade_kubernetes_ha_cluster | `Failure` | 31.82 | test_kubernetes_clusters.py
   test_09_delete_kubernetes_ha_cluster | `Failure` | 34.84 | test_kubernetes_clusters.py
   ContextSuite context=TestKubernetesCluster>:teardown | `Error` | 169.46 | test_kubernetes_clusters.py
   runTest | `Error` | 0.00 | test_internal_lb.py
   runTest | `Error` | 0.00 | test_internal_lb.py
   test_01_create_delete_portforwarding_fornonvpc | `Error` | 116.10 | test_portforwardingrules.py
   test_01_create_delete_portforwarding_fornonvpc | `Error` | 116.11 | test_portforwardingrules.py
   ContextSuite context=TestResetVmOnReboot>:setup | `Error` | 0.00 | test_reset_vm_on_reboot.py
   ContextSuite context=TestRAMCPUResourceAccounting>:setup | `Error` | 0.00 | test_resource_accounting.py
   ContextSuite context=TestRouterDHCPHosts>:setup | `Error` | 0.00 | test_router_dhcphosts.py
   ContextSuite context=TestRouterDHCPOpts>:setup | `Error` | 0.00 | test_router_dhcphosts.py
   ContextSuite context=TestRouterDns>:setup | `Error` | 0.00 | test_router_dns.py
   ContextSuite context=TestRouterDnsService>:setup | `Error` | 0.00 | test_router_dnsservice.py
   ContextSuite context=TestRouterIpTablesPolicies>:setup | `Error` | 0.00 | test_routers_iptables_default_policy.py
   ContextSuite context=TestVPCIpTablesPolicies>:setup | `Error` | 0.00 | test_routers_iptables_default_policy.py
   ContextSuite context=TestIsolatedNetworks>:setup | `Error` | 0.00 | test_routers_network_ops.py
   ContextSuite context=TestRedundantIsolateNetworks>:setup | `Error` | 0.00 | test_routers_network_ops.py
   ContextSuite context=TestRouterServices>:setup | `Error` | 0.00 | test_routers.py
   ContextSuite context=TestCpuCapServiceOfferings>:setup | `Error` | 0.00 | test_service_offerings.py
   ContextSuite context=TestServiceOfferings>:setup | `Error` | 0.13 | test_service_offerings.py
   ContextSuite context=TestSnapshotRootDisk>:setup | `Error` | 0.00 | test_snapshots.py
   test_01_lb_usage | `Error` | 3.16 | test_usage.py
   test_01_nat_usage | `Error` | 4.15 | test_usage.py
   test_01_vpn_usage | `Error` | 5.32 | test_usage.py
   ContextSuite context=TestSecuredVmMigration>:teardown | `Error` | 319.38 | test_vm_life_cycle.py
   ContextSuite context=TestVMLifeCycle>:setup | `Error` | 4.82 | test_vm_life_cycle.py
   test_01_create_vm_snapshots | `Failure` | 600.71 | test_vm_snapshots.py
   test_02_revert_vm_snapshots | `Failure` | 600.70 | test_vm_snapshots.py
   test_03_delete_vm_snapshots | `Failure` | 0.02 | test_vm_snapshots.py
   test_01_create_volume | `Failure` | 606.06 | test_volumes.py
   test_02_attach_volume | `Failure` | 645.72 | test_volumes.py
   test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | `Error` | 30.20 | test_vpc_redundant.py
   test_02_redundant_VPC_default_routes | `Error` | 32.32 | test_vpc_redundant.py
   test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | `Error` | 30.15 | test_vpc_redundant.py
   test_04_rvpc_network_garbage_collector_nics | `Error` | 30.13 | test_vpc_redundant.py
   test_05_rvpc_multi_tiers | `Error` | 30.10 | test_vpc_redundant.py
   test_01_VPC_nics_after_destroy | `Error` | 27.05 | test_vpc_router_nics.py
   test_02_VPC_default_routes | `Error` | 26.04 | test_vpc_router_nics.py
   test_01_redundant_vpc_site2site_vpn | `Failure` | 30.83 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn_multiple_options | `Failure` | 29.77 | test_vpc_vpn.py
   test_01_vpc_remote_access_vpn | `Failure` | 26.62 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn | `Failure` | 28.79 | test_vpc_vpn.py
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] GabrielBrascher commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
GabrielBrascher commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-786616199


   @blueorangutan package


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-794626795


   <b>Trillian test result (tid-3677)</b>
   Environment: vmware-67u3 (x2), Advanced Networking with Mgmt server 7
   Total time taken: 50668 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t3677-vmware-67u3.zip
   Intermittent failure detected: /marvin/tests/smoke/test_accounts.py
   Intermittent failure detected: /marvin/tests/smoke/test_deploy_vm_with_userdata.py
   Intermittent failure detected: /marvin/tests/smoke/test_diagnostics.py
   Intermittent failure detected: /marvin/tests/smoke/test_domain_vpc_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_internal_lb.py
   Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_clusters.py
   Intermittent failure detected: /marvin/tests/smoke/test_loadbalance.py
   Intermittent failure detected: /marvin/tests/smoke/test_migration.py
   Intermittent failure detected: /marvin/tests/smoke/test_nested_virtualization.py
   Intermittent failure detected: /marvin/tests/smoke/test_network_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_network.py
   Intermittent failure detected: /marvin/tests/smoke/test_nic.py
   Intermittent failure detected: /marvin/tests/smoke/test_password_server.py
   Intermittent failure detected: /marvin/tests/smoke/test_portforwardingrules.py
   Intermittent failure detected: /marvin/tests/smoke/test_privategw_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dhcphosts.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dns.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dnsservice.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_iptables_default_policy.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_network_ops.py
   Intermittent failure detected: /marvin/tests/smoke/test_scale_vm.py
   Intermittent failure detected: /marvin/tests/smoke/test_service_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_usage.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_life_cycle.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_snapshots.py
   Intermittent failure detected: /marvin/tests/smoke/test_volumes.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_router_nics.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_vpn.py
   Smoke tests completed. 57 look OK, 29 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   test_DeleteDomain | `Error` | 234.87 | test_accounts.py
   test_DeleteDomain | `Error` | 234.88 | test_accounts.py
   test_forceDeleteDomain | `Failure` | 228.68 | test_accounts.py
   test_forceDeleteDomain | `Error` | 228.69 | test_accounts.py
   ContextSuite context=TestLoadBalance>:setup | `Error` | 0.00 | test_loadbalance.py
   test_01_native_to_native_network_migration | `Error` | 81.17 | test_migration.py
   test_02_native_to_native_vpc_migration | `Error` | 50.49 | test_migration.py
   test_network_acl | `Error` | 34.79 | test_network_acl.py
   test_delete_account | `Error` | 95.95 | test_network.py
   test_01_port_fwd_on_src_nat | `Error` | 2.13 | test_network.py
   test_02_port_fwd_on_non_src_nat | `Error` | 6.27 | test_network.py
   test_reboot_router | `Error` | 217.09 | test_network.py
   test_releaseIP | `Error` | 97.15 | test_network.py
   test_network_rules_acquired_public_ip_1_static_nat_rule | `Error` | 3.17 | test_network.py
   test_network_rules_acquired_public_ip_2_nat_rule | `Error` | 3.16 | test_network.py
   test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | `Error` | 3.17 | test_network.py
   test_deployvm_userdata | `Error` | 51.33 | test_deploy_vm_with_userdata.py
   test_deployvm_userdata_post | `Error` | 6.44 | test_deploy_vm_with_userdata.py
   test_13_retrieve_vr_default_files | `Error` | 1.07 | test_diagnostics.py
   test_14_retrieve_vr_one_file | `Error` | 1.08 | test_diagnostics.py
   test_15_retrieve_ssvm_default_files | `Error` | 1.08 | test_diagnostics.py
   test_16_retrieve_ssvm_single_file | `Error` | 1.08 | test_diagnostics.py
   test_17_retrieve_cpvm_default_files | `Error` | 1.07 | test_diagnostics.py
   test_18_retrieve_cpvm_single_file | `Error` | 1.08 | test_diagnostics.py
   test_01_nic | `Error` | 1069.07 | test_nic.py
   test_03_nic_multiple_vmware | `Error` | 74.03 | test_nic.py
   test_03_create_vpc_domain_vpc_offering | `Error` | 40.53 | test_domain_vpc_offerings.py
   test_isolate_network_password_server | `Error` | 2.13 | test_password_server.py
   test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 | `Failure` | 36.16 | test_internal_lb.py
   test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 | `Failure` | 47.38 | test_internal_lb.py
   test_03_vpc_internallb_haproxy_stats_on_all_interfaces | `Failure` | 33.02 | test_internal_lb.py
   test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | `Failure` | 35.05 | test_internal_lb.py
   test_01_vpc_privategw_acl | `Failure` | 53.48 | test_privategw_acl.py
   test_02_vpc_privategw_static_routes | `Failure` | 34.17 | test_privategw_acl.py
   test_03_vpc_privategw_restart_vpc_cleanup | `Failure` | 36.18 | test_privategw_acl.py
   test_04_rvpc_privategw_static_routes | `Failure` | 41.22 | test_privategw_acl.py
   test_01_deploy_kubernetes_cluster | `Failure` | 56.53 | test_kubernetes_clusters.py
   test_02_invalid_upgrade_kubernetes_cluster | `Failure` | 61.41 | test_kubernetes_clusters.py
   test_03_deploy_and_upgrade_kubernetes_cluster | `Failure` | 62.40 | test_kubernetes_clusters.py
   test_04_deploy_and_scale_kubernetes_cluster | `Failure` | 58.29 | test_kubernetes_clusters.py
   test_05_delete_kubernetes_cluster | `Failure` | 57.26 | test_kubernetes_clusters.py
   test_07_deploy_kubernetes_ha_cluster | `Failure` | 58.34 | test_kubernetes_clusters.py
   test_08_deploy_and_upgrade_kubernetes_ha_cluster | `Failure` | 58.27 | test_kubernetes_clusters.py
   test_09_delete_kubernetes_ha_cluster | `Failure` | 56.18 | test_kubernetes_clusters.py
   ContextSuite context=TestKubernetesCluster>:teardown | `Error` | 225.33 | test_kubernetes_clusters.py
   test_nested_virtualization_vmware | `Error` | 1049.20 | test_nested_virtualization.py
   test_01_create_delete_portforwarding_fornonvpc | `Error` | 146.05 | test_portforwardingrules.py
   test_01_create_delete_portforwarding_fornonvpc | `Error` | 146.06 | test_portforwardingrules.py
   test_router_dhcphosts | `Error` | 2.12 | test_router_dhcphosts.py
   ContextSuite context=TestRouterDHCPHosts>:teardown | `Error` | 11.37 | test_router_dhcphosts.py
   test_router_dhcp_opts | `Error` | 2.15 | test_router_dhcphosts.py
   test_router_dns_guestipquery | `Error` | 2.11 | test_router_dns.py
   test_router_dns_guestipquery | `Error` | 2.12 | test_router_dnsservice.py
   test_01_single_VPC_iptables_policies | `Error` | 36.87 | test_routers_iptables_default_policy.py
   test_01_isolate_network_FW_PF_default_routes_egress_true | `Error` | 121.26 | test_routers_network_ops.py
   test_02_isolate_network_FW_PF_default_routes_egress_false | `Error` | 129.44 | test_routers_network_ops.py
   test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true | `Error` | 187.46 | test_routers_network_ops.py
   test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false | `Error` | 189.77 | test_routers_network_ops.py
   test_03_RVR_Network_check_router_state | `Failure` | 184.74 | test_routers_network_ops.py
   test_01_scale_vm | `Error` | 715.84 | test_scale_vm.py
   test_04_change_offering_small | `Failure` | 823.63 | test_service_offerings.py
   test_01_lb_usage | `Error` | 1.12 | test_usage.py
   test_01_nat_usage | `Error` | 3.12 | test_usage.py
   test_01_vpn_usage | `Error` | 4.27 | test_usage.py
   test_01_migrate_VM_and_root_volume | `Error` | 0.01 | test_vm_life_cycle.py
   test_02_migrate_VM_with_two_data_disks | `Error` | 0.01 | test_vm_life_cycle.py
   test_03_migrate_detached_volume | `Error` | 0.01 | test_vm_life_cycle.py
   ContextSuite context=TestVAppsVM>:setup | `Error` | 44.24 | test_vm_life_cycle.py
   test_10_attachAndDetach_iso | `Failure` | 721.64 | test_vm_life_cycle.py
   test_change_service_offering_for_vm_with_snapshots | `Failure` | 946.94 | test_vm_snapshots.py
   test_01_create_vm_snapshots | `Failure` | 715.45 | test_vm_snapshots.py
   test_02_revert_vm_snapshots | `Failure` | 719.96 | test_vm_snapshots.py
   test_03_delete_vm_snapshots | `Failure` | 0.01 | test_vm_snapshots.py
   test_01_create_volume | `Failure` | 721.82 | test_volumes.py
   test_02_attach_volume | `Failure` | 725.84 | test_volumes.py
   test_10_list_volumes | `Failure` | 365.64 | test_volumes.py
   test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | `Error` | 35.12 | test_vpc_redundant.py
   test_02_redundant_VPC_default_routes | `Error` | 36.13 | test_vpc_redundant.py
   test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | `Error` | 52.44 | test_vpc_redundant.py
   test_04_rvpc_network_garbage_collector_nics | `Error` | 42.26 | test_vpc_redundant.py
   test_05_rvpc_multi_tiers | `Error` | 43.28 | test_vpc_redundant.py
   test_01_VPC_nics_after_destroy | `Error` | 35.08 | test_vpc_router_nics.py
   test_02_VPC_default_routes | `Error` | 52.43 | test_vpc_router_nics.py
   test_01_redundant_vpc_site2site_vpn | `Failure` | 41.01 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn_multiple_options | `Failure` | 54.21 | test_vpc_vpn.py
   test_01_vpc_remote_access_vpn | `Failure` | 36.82 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn | `Failure` | 49.16 | test_vpc_vpn.py
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-789602031


   Packaging result: ✔centos7 ✔centos8 ✔debian. JID-2858


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] DaanHoogland commented on a change in pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
DaanHoogland commented on a change in pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#discussion_r704539703



##########
File path: pom.xml
##########
@@ -974,6 +974,7 @@
                             <exclude>**/*.md</exclude>
                             <exclude>.java-version</exclude>
                             <exclude>.python-version</exclude>
+                            <exclude>systemvm/.pythen-version</exclude>

Review comment:
       yes,m definitely,  but also this file is not in use anymore.




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan removed a comment on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan removed a comment on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-786263374






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-795687645


   Packaging result: :heavy_check_mark: centos7 :heavy_check_mark: centos8 :heavy_check_mark: debian. SL-JID 79


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-797872671


   <b>[S] Trillian test result (tid-119)</b>
   Environment: vmware-67u3 (x2), Advanced Networking with Mgmt server 7
   Total time taken: 39187 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t119-vmware-67u3.zip
   Intermittent failure detected: /marvin/tests/smoke/test_accounts.py
   Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_clusters.py
   Intermittent failure detected: /marvin/tests/smoke/test_nic.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_life_cycle.py
   Smoke tests completed. 82 look OK, 4 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   test_DeleteDomain | `Error` | 219.79 | test_accounts.py
   test_03_nic_multiple_vmware | `Error` | 74.09 | test_nic.py
   test_01_deploy_kubernetes_cluster | `Failure` | 0.01 | test_kubernetes_clusters.py
   test_02_invalid_upgrade_kubernetes_cluster | `Failure` | 0.01 | test_kubernetes_clusters.py
   test_03_deploy_and_upgrade_kubernetes_cluster | `Failure` | 0.01 | test_kubernetes_clusters.py
   test_04_deploy_and_scale_kubernetes_cluster | `Failure` | 0.01 | test_kubernetes_clusters.py
   test_05_delete_kubernetes_cluster | `Failure` | 0.01 | test_kubernetes_clusters.py
   test_06_deploy_invalid_kubernetes_ha_cluster | `Failure` | 0.01 | test_kubernetes_clusters.py
   test_07_deploy_kubernetes_ha_cluster | `Failure` | 0.01 | test_kubernetes_clusters.py
   test_08_deploy_and_upgrade_kubernetes_ha_cluster | `Failure` | 0.01 | test_kubernetes_clusters.py
   test_09_delete_kubernetes_ha_cluster | `Failure` | 0.01 | test_kubernetes_clusters.py
   test_01_migrate_VM_and_root_volume | `Error` | 0.01 | test_vm_life_cycle.py
   test_02_migrate_VM_with_two_data_disks | `Error` | 0.01 | test_vm_life_cycle.py
   test_03_migrate_detached_volume | `Error` | 0.01 | test_vm_life_cycle.py
   ContextSuite context=TestVAppsVM>:setup | `Error` | 44.32 | test_vm_life_cycle.py
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-796839874


   <b>[S] Trillian test result (tid-85)</b>
   Environment: kvm-centos8 (x2), Advanced Networking with Mgmt server 8
   Total time taken: 19423 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t85-kvm-centos8.zip
   Intermittent failure detected: /marvin/tests/smoke/test_accounts.py
   Intermittent failure detected: /marvin/tests/smoke/test_affinity_groups_projects.py
   Intermittent failure detected: /marvin/tests/smoke/test_affinity_groups.py
   Intermittent failure detected: /marvin/tests/smoke/test_async_job.py
   Intermittent failure detected: /marvin/tests/smoke/test_deploy_virtio_scsi_vm.py
   Intermittent failure detected: /marvin/tests/smoke/test_deploy_vm_extra_config_data.py
   Intermittent failure detected: /marvin/tests/smoke/test_deploy_vm_iso.py
   Intermittent failure detected: /marvin/tests/smoke/test_deploy_vm_root_resize.py
   Intermittent failure detected: /marvin/tests/smoke/test_deploy_vms_with_varied_deploymentplanners.py
   Intermittent failure detected: /marvin/tests/smoke/test_deploy_vm_with_userdata.py
   Intermittent failure detected: /marvin/tests/smoke/test_diagnostics.py
   Intermittent failure detected: /marvin/tests/smoke/test_domain_service_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_domain_vpc_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_internal_lb.py
   Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_clusters.py
   Intermittent failure detected: /marvin/tests/smoke/test_list_ids_parameter.py
   Intermittent failure detected: /marvin/tests/smoke/test_loadbalance.py
   Intermittent failure detected: /marvin/tests/smoke/test_metrics_api.py
   Intermittent failure detected: /marvin/tests/smoke/test_migration.py
   Intermittent failure detected: /marvin/tests/smoke/test_multipleips_per_nic.py
   Intermittent failure detected: /marvin/tests/smoke/test_network_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_network.py
   Intermittent failure detected: /marvin/tests/smoke/test_nic.py
   Intermittent failure detected: /marvin/tests/smoke/test_outofbandmanagement.py
   Intermittent failure detected: /marvin/tests/smoke/test_password_server.py
   Intermittent failure detected: /marvin/tests/smoke/test_portable_publicip.py
   Intermittent failure detected: /marvin/tests/smoke/test_portforwardingrules.py
   Intermittent failure detected: /marvin/tests/smoke/test_primary_storage.py
   Intermittent failure detected: /marvin/tests/smoke/test_privategw_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_projects.py
   Intermittent failure detected: /marvin/tests/smoke/test_reset_vm_on_reboot.py
   Intermittent failure detected: /marvin/tests/smoke/test_resource_accounting.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dhcphosts.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dns.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dnsservice.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_iptables_default_policy.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_network_ops.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers.py
   Intermittent failure detected: /marvin/tests/smoke/test_service_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_snapshots.py
   Intermittent failure detected: /marvin/tests/smoke/test_templates.py
   Intermittent failure detected: /marvin/tests/smoke/test_usage.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_deployment_planner.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_life_cycle.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_snapshots.py
   Intermittent failure detected: /marvin/tests/smoke/test_volumes.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_router_nics.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_vpn.py
   Intermittent failure detected: /marvin/tests/smoke/test_hostha_kvm.py
   Smoke tests completed. 36 look OK, 50 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   ContextSuite context=TestAddVmToSubDomain>:setup | `Error` | 34.75 | test_accounts.py
   test_DeleteDomain | `Error` | 45.30 | test_accounts.py
   test_forceDeleteDomain | `Failure` | 44.24 | test_accounts.py
   test_01_user_remove_VM_running | `Error` | 41.98 | test_accounts.py
   test_DeployVmAntiAffinityGroup_in_project | `Error` | 30.27 | test_affinity_groups_projects.py
   test_DeployVmAffinityGroup | `Error` | 28.84 | test_affinity_groups.py
   test_DeployVmAntiAffinityGroup | `Error` | 5.28 | test_affinity_groups.py
   test_query_async_job_result | `Error` | 40.61 | test_async_job.py
   ContextSuite context=TestLoadBalance>:setup | `Error` | 0.00 | test_loadbalance.py
   test_list_vms_metrics | `Error` | 31.13 | test_metrics_api.py
   ContextSuite context=TestDeployVirtioSCSIVM>:setup | `Error` | 0.00 | test_deploy_virtio_scsi_vm.py
   test_02_deploy_vm_with_extraconfig_kvm | `Error` | 31.01 | test_deploy_vm_extra_config_data.py
   test_03_update_vm_with_extraconfig_kvm | `Error` | 5.38 | test_deploy_vm_extra_config_data.py
   test_deploy_vm_from_iso | `Error` | 59.09 | test_deploy_vm_iso.py
   test_01_native_to_native_network_migration | `Error` | 66.67 | test_migration.py
   test_02_native_to_native_vpc_migration | `Error` | 36.32 | test_migration.py
   test_00_deploy_vm_root_resize | `Error` | 31.16 | test_deploy_vm_root_resize.py
   test_deployvm_firstfit | `Error` | 28.86 | test_deploy_vms_with_varied_deploymentplanners.py
   test_deployvm_userconcentrated | `Error` | 5.33 | test_deploy_vms_with_varied_deploymentplanners.py
   test_deployvm_userdispersing | `Error` | 4.29 | test_deploy_vms_with_varied_deploymentplanners.py
   test_network_acl | `Error` | 28.16 | test_network_acl.py
   test_deployvm_userdata | `Error` | 31.06 | test_deploy_vm_with_userdata.py
   test_deployvm_userdata_post | `Error` | 5.37 | test_deploy_vm_with_userdata.py
   test_01_deploy_kubernetes_cluster | `Failure` | 32.24 | test_kubernetes_clusters.py
   test_02_invalid_upgrade_kubernetes_cluster | `Failure` | 32.04 | test_kubernetes_clusters.py
   test_03_deploy_and_upgrade_kubernetes_cluster | `Failure` | 32.11 | test_kubernetes_clusters.py
   test_04_deploy_and_scale_kubernetes_cluster | `Failure` | 36.81 | test_kubernetes_clusters.py
   test_05_delete_kubernetes_cluster | `Failure` | 33.09 | test_kubernetes_clusters.py
   test_07_deploy_kubernetes_ha_cluster | `Failure` | 32.00 | test_kubernetes_clusters.py
   test_08_deploy_and_upgrade_kubernetes_ha_cluster | `Failure` | 33.21 | test_kubernetes_clusters.py
   test_09_delete_kubernetes_ha_cluster | `Failure` | 30.03 | test_kubernetes_clusters.py
   ContextSuite context=TestKubernetesCluster>:teardown | `Error` | 177.57 | test_kubernetes_clusters.py
   test_09_project_suspend | `Error` | 28.13 | test_projects.py
   test_10_project_activation | `Error` | 6.34 | test_projects.py
   ContextSuite context=TestRemoteDiagnostics>:setup | `Error` | 0.00 | test_diagnostics.py
   test_delete_account | `Error` | 45.68 | test_network.py
   ContextSuite context=TestPortForwarding>:setup | `Error` | 77.38 | test_network.py
   ContextSuite context=TestPublicIP>:setup | `Error` | 29.93 | test_network.py
   test_reboot_router | `Error` | 29.46 | test_network.py
   test_releaseIP | `Error` | 30.35 | test_network.py
   ContextSuite context=TestRouterRules>:setup | `Error` | 61.78 | test_network.py
   test_01_deployVMInSharedNetwork | `Failure` | 27.74 | test_network.py
   test_03_destroySharedNetwork | `Failure` | 1.08 | test_network.py
   ContextSuite context=TestSharedNetwork>:teardown | `Error` | 2.18 | test_network.py
   test_01_nic | `Error` | 86.43 | test_nic.py
   test_03_deploy_vm_domain_service_offering | `Error` | 48.79 | test_domain_service_offerings.py
   test_03_create_vpc_domain_vpc_offering | `Error` | 30.96 | test_domain_vpc_offerings.py
   ContextSuite context=TestIsolatedNetworksPasswdServer>:setup | `Error` | 0.00 | test_password_server.py
   test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 | `Failure` | 32.43 | test_internal_lb.py
   test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 | `Failure` | 31.44 | test_internal_lb.py
   test_03_vpc_internallb_haproxy_stats_on_all_interfaces | `Failure` | 30.34 | test_internal_lb.py
   test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | `Failure` | 31.32 | test_internal_lb.py
   ContextSuite context=TestPortablePublicIPAcquire>:teardown | `Error` | 32.58 | test_portable_publicip.py
   ContextSuite context=TestListIdsParams>:setup | `Error` | 0.00 | test_list_ids_parameter.py
   test_nic_secondaryip_add_remove | `Error` | 43.68 | test_multipleips_per_nic.py
   test_oobm_background_powerstate_sync | `Failure` | 20.71 | test_outofbandmanagement.py
   test_oobm_enabledisable_across_clusterzones | `Error` | 39.87 | test_outofbandmanagement.py
   test_oobm_issue_power_cycle | `Error` | 18.68 | test_outofbandmanagement.py
   test_oobm_issue_power_off | `Error` | 18.87 | test_outofbandmanagement.py
   test_oobm_issue_power_on | `Error` | 18.79 | test_outofbandmanagement.py
   test_oobm_issue_power_reset | `Error` | 19.09 | test_outofbandmanagement.py
   test_oobm_issue_power_soft | `Error` | 19.75 | test_outofbandmanagement.py
   test_oobm_issue_power_status | `Error` | 20.05 | test_outofbandmanagement.py
   test_oobm_multiple_mgmt_server_ownership | `Failure` | 28.34 | test_outofbandmanagement.py
   test_oobm_zchange_password | `Error` | 7.82 | test_outofbandmanagement.py
   test_01_create_delete_portforwarding_fornonvpc | `Error` | 33.85 | test_portforwardingrules.py
   test_01_add_primary_storage_disabled_host | `Error` | 95.28 | test_primary_storage.py
   test_01_primary_storage_nfs | `Error` | 0.14 | test_primary_storage.py
   ContextSuite context=TestStorageTags>:setup | `Error` | 0.25 | test_primary_storage.py
   test_01_vpc_privategw_acl | `Failure` | 29.46 | test_privategw_acl.py
   test_02_vpc_privategw_static_routes | `Failure` | 32.42 | test_privategw_acl.py
   test_03_vpc_privategw_restart_vpc_cleanup | `Failure` | 32.43 | test_privategw_acl.py
   test_04_rvpc_privategw_static_routes | `Failure` | 31.11 | test_privategw_acl.py
   ContextSuite context=TestResetVmOnReboot>:setup | `Error` | 0.00 | test_reset_vm_on_reboot.py
   test_01_so_removal_resource_update | `Error` | 30.01 | test_resource_accounting.py
   ContextSuite context=TestRouterDHCPHosts>:setup | `Error` | 0.00 | test_router_dhcphosts.py
   ContextSuite context=TestRouterDHCPOpts>:setup | `Error` | 0.00 | test_router_dhcphosts.py
   ContextSuite context=TestRouterDns>:setup | `Error` | 0.00 | test_router_dns.py
   ContextSuite context=TestRouterDnsService>:setup | `Error` | 0.00 | test_router_dnsservice.py
   test_02_routervm_iptables_policies | `Error` | 28.06 | test_routers_iptables_default_policy.py
   test_01_single_VPC_iptables_policies | `Error` | 36.03 | test_routers_iptables_default_policy.py
   test_01_isolate_network_FW_PF_default_routes_egress_true | `Error` | 32.68 | test_routers_network_ops.py
   test_02_isolate_network_FW_PF_default_routes_egress_false | `Error` | 27.98 | test_routers_network_ops.py
   test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true | `Error` | 56.40 | test_routers_network_ops.py
   test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false | `Error` | 55.05 | test_routers_network_ops.py
   test_03_RVR_Network_check_router_state | `Error` | 60.98 | test_routers_network_ops.py
   ContextSuite context=TestRouterServices>:setup | `Error` | 0.00 | test_routers.py
   ContextSuite context=TestCpuCapServiceOfferings>:setup | `Error` | 0.00 | test_service_offerings.py
   ContextSuite context=TestServiceOfferings>:setup | `Error` | 32.65 | test_service_offerings.py
   ContextSuite context=TestSnapshotRootDisk>:setup | `Error` | 0.00 | test_snapshots.py
   test_02_deploy_vm_from_direct_download_template | `Error` | 29.88 | test_templates.py
   test_03_deploy_vm_wrong_checksum | `Error` | 5.40 | test_templates.py
   ContextSuite context=TestTemplates>:setup | `Error` | 57.57 | test_templates.py
   ContextSuite context=TestLBRuleUsage>:setup | `Error` | 31.61 | test_usage.py
   ContextSuite context=TestNatRuleUsage>:setup | `Error` | 61.98 | test_usage.py
   ContextSuite context=TestPublicIPUsage>:setup | `Error` | 91.50 | test_usage.py
   ContextSuite context=TestSnapshotUsage>:setup | `Error` | 121.68 | test_usage.py
   ContextSuite context=TestVmUsage>:setup | `Error` | 191.95 | test_usage.py
   ContextSuite context=TestVolumeUsage>:setup | `Error` | 222.31 | test_usage.py
   ContextSuite context=TestVpnUsage>:setup | `Error` | 251.67 | test_usage.py
   test_01_deploy_vm_on_specific_host | `Error` | 29.04 | test_vm_deployment_planner.py
   test_02_deploy_vm_on_specific_cluster | `Error` | 3.33 | test_vm_deployment_planner.py
   test_03_deploy_vm_on_specific_pod | `Error` | 4.37 | test_vm_deployment_planner.py
   test_04_deploy_vm_on_host_override_pod_and_cluster | `Error` | 2.33 | test_vm_deployment_planner.py
   test_05_deploy_vm_on_cluster_override_pod | `Error` | 2.29 | test_vm_deployment_planner.py
   ContextSuite context=TestDeployVM>:setup | `Error` | 0.00 | test_vm_life_cycle.py
   test_01_secure_vm_migration | `Error` | 98.03 | test_vm_life_cycle.py
   test_02_unsecure_vm_migration | `Error` | 215.83 | test_vm_life_cycle.py
   test_03_secured_to_nonsecured_vm_migration | `Error` | 144.20 | test_vm_life_cycle.py
   test_04_nonsecured_to_secured_vm_migration | `Error` | 143.92 | test_vm_life_cycle.py
   ContextSuite context=TestSecuredVmMigration>:teardown | `Error` | 143.95 | test_vm_life_cycle.py
   ContextSuite context=TestVMLifeCycle>:setup | `Error` | 31.49 | test_vm_life_cycle.py
   ContextSuite context=TestVmSnapshot>:setup | `Error` | 29.53 | test_vm_snapshots.py
   ContextSuite context=TestCreateVolume>:setup | `Error` | 0.00 | test_volumes.py
   ContextSuite context=TestVolumes>:setup | `Error` | 0.00 | test_volumes.py
   test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | `Error` | 32.35 | test_vpc_redundant.py
   test_02_redundant_VPC_default_routes | `Error` | 32.41 | test_vpc_redundant.py
   test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | `Error` | 33.48 | test_vpc_redundant.py
   test_04_rvpc_network_garbage_collector_nics | `Error` | 32.38 | test_vpc_redundant.py
   test_05_rvpc_multi_tiers | `Error` | 33.43 | test_vpc_redundant.py
   test_01_VPC_nics_after_destroy | `Error` | 30.30 | test_vpc_router_nics.py
   test_02_VPC_default_routes | `Error` | 30.16 | test_vpc_router_nics.py
   test_01_redundant_vpc_site2site_vpn | `Failure` | 32.02 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn_multiple_options | `Failure` | 32.02 | test_vpc_vpn.py
   test_01_vpc_remote_access_vpn | `Failure` | 29.76 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn | `Failure` | 33.31 | test_vpc_vpn.py
   test_hostha_kvm_host_degraded | `Error` | 10.88 | test_hostha_kvm.py
   test_hostha_kvm_host_fencing | `Error` | 9.87 | test_hostha_kvm.py
   test_hostha_kvm_host_recovering | `Error` | 10.94 | test_hostha_kvm.py
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] DaanHoogland commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
DaanHoogland commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-787758904


   reference marvin on python2 component test results:
   ```
   # cat componenttest-summary.txt 
   Test completed. 114 look ok, 57 have errors
   Only failed tests results shown below:
   ```


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan removed a comment on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan removed a comment on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-788717656


   Packaging result: ✔centos7 ✔centos8 ✖debian. JID-2854


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan removed a comment on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan removed a comment on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-785087277


   Packaging result: ✔centos7 ✔centos8 ✔debian. JID-2822


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan removed a comment on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan removed a comment on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-795687645






-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] DaanHoogland commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
DaanHoogland commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-787957975


   travis green \o/ cc @GabrielBrascher @rhtyd 


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] DaanHoogland commented on a change in pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
DaanHoogland commented on a change in pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#discussion_r588144331



##########
File path: packaging/centos7/cloud.spec
##########
@@ -418,6 +424,8 @@ fi
 # Install mysql-connector-python
 pip3 install %{_datadir}/%{name}-management/setup/wheel/six-1.15.0-py2.py3-none-any.whl %{_datadir}/%{name}-management/setup/wheel/setuptools-47.3.1-py3-none-any.whl %{_datadir}/%{name}-management/setup/wheel/protobuf-3.12.2-cp36-cp36m-manylinux1_x86_64.whl %{_datadir}/%{name}-management/setup/wheel/mysql_connector_python-8.0.20-cp36-cp36m-manylinux1_x86_64.whl
 
+pip3 install urllib3

Review comment:
       I'll double check, I think it's an indirect dependency, Also it is not packaged which is mayby not what we want , I would mean internet has to be available during install. I'll look into this.




----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-786263374


   Packaging result: ✔centos7 ✔centos8 ✔debian. JID-2829


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-786616474


   @GabrielBrascher a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] GabrielBrascher commented on a change in pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
GabrielBrascher commented on a change in pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#discussion_r598923280



##########
File path: debian/cloudstack-marvin.postinst
##########
@@ -19,5 +19,6 @@
 
 set -e
 
-pip install --upgrade http://cdn.mysql.com/Downloads/Connector-Python/mysql-connector-python-2.0.4.zip#md5=3df394d89300db95163f17c843ef49df
-pip install --upgrade /usr/share/cloudstack-marvin/Marvin-*.tar.gz
+python3 -m pip install --upgrade pip
+python3 -m pip install --upgrade http://cdn.mysql.com/Downloads/Connector-Python/mysql-connector-python-2.0.4.zip#md5=3df394d89300db95163f17c843ef49df

Review comment:
       Thanks for the hint, @weizhouapache. The code has been updated.




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-791745166


   <b>Trillian test result (tid-3665)</b>
   Environment: xenserver-72 (x2), Advanced Networking with Mgmt server 7
   Total time taken: 40358 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t3665-xenserver-72.zip
   Intermittent failure detected: /marvin/tests/smoke/test_accounts.py
   Intermittent failure detected: /marvin/tests/smoke/test_deploy_vm_with_userdata.py
   Intermittent failure detected: /marvin/tests/smoke/test_diagnostics.py
   Intermittent failure detected: /marvin/tests/smoke/test_domain_vpc_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_internal_lb.py
   Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_clusters.py
   Intermittent failure detected: /marvin/tests/smoke/test_loadbalance.py
   Intermittent failure detected: /marvin/tests/smoke/test_network_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_network.py
   Intermittent failure detected: /marvin/tests/smoke/test_password_server.py
   Intermittent failure detected: /marvin/tests/smoke/test_portforwardingrules.py
   Intermittent failure detected: /marvin/tests/smoke/test_privategw_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dhcphosts.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dns.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dnsservice.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_iptables_default_policy.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_network_ops.py
   Intermittent failure detected: /marvin/tests/smoke/test_scale_vm.py
   Intermittent failure detected: /marvin/tests/smoke/test_service_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_usage.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_life_cycle.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_snapshots.py
   Intermittent failure detected: /marvin/tests/smoke/test_volumes.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_router_nics.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_vpn.py
   Smoke tests completed. 60 look OK, 26 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   test_DeleteDomain | `Error` | 183.30 | test_accounts.py
   test_DeleteDomain | `Error` | 183.31 | test_accounts.py
   test_forceDeleteDomain | `Failure` | 173.14 | test_accounts.py
   test_forceDeleteDomain | `Error` | 173.15 | test_accounts.py
   ContextSuite context=TestLoadBalance>:setup | `Error` | 0.00 | test_loadbalance.py
   test_network_acl | `Error` | 36.82 | test_network_acl.py
   test_delete_account | `Error` | 103.86 | test_network.py
   test_01_port_fwd_on_src_nat | `Error` | 2.12 | test_network.py
   test_02_port_fwd_on_non_src_nat | `Error` | 7.35 | test_network.py
   test_reboot_router | `Error` | 191.40 | test_network.py
   test_releaseIP | `Error` | 76.49 | test_network.py
   test_network_rules_acquired_public_ip_1_static_nat_rule | `Error` | 3.15 | test_network.py
   test_network_rules_acquired_public_ip_2_nat_rule | `Error` | 3.16 | test_network.py
   test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | `Error` | 3.15 | test_network.py
   test_deployvm_userdata | `Error` | 38.94 | test_deploy_vm_with_userdata.py
   test_deployvm_userdata_post | `Error` | 9.33 | test_deploy_vm_with_userdata.py
   test_13_retrieve_vr_default_files | `Error` | 1.07 | test_diagnostics.py
   test_14_retrieve_vr_one_file | `Error` | 1.07 | test_diagnostics.py
   test_15_retrieve_ssvm_default_files | `Error` | 1.08 | test_diagnostics.py
   test_16_retrieve_ssvm_single_file | `Error` | 1.08 | test_diagnostics.py
   test_17_retrieve_cpvm_default_files | `Error` | 1.07 | test_diagnostics.py
   test_18_retrieve_cpvm_single_file | `Error` | 1.07 | test_diagnostics.py
   test_03_create_vpc_domain_vpc_offering | `Error` | 37.44 | test_domain_vpc_offerings.py
   test_isolate_network_password_server | `Error` | 2.12 | test_password_server.py
   test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 | `Failure` | 38.29 | test_internal_lb.py
   test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 | `Failure` | 39.20 | test_internal_lb.py
   test_03_vpc_internallb_haproxy_stats_on_all_interfaces | `Failure` | 39.06 | test_internal_lb.py
   test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | `Failure` | 35.95 | test_internal_lb.py
   test_01_vpc_privategw_acl | `Failure` | 36.05 | test_privategw_acl.py
   test_02_vpc_privategw_static_routes | `Failure` | 34.02 | test_privategw_acl.py
   test_03_vpc_privategw_restart_vpc_cleanup | `Failure` | 36.05 | test_privategw_acl.py
   test_04_rvpc_privategw_static_routes | `Failure` | 38.10 | test_privategw_acl.py
   test_01_deploy_kubernetes_cluster | `Failure` | 45.16 | test_kubernetes_clusters.py
   test_02_invalid_upgrade_kubernetes_cluster | `Failure` | 41.97 | test_kubernetes_clusters.py
   test_03_deploy_and_upgrade_kubernetes_cluster | `Failure` | 42.09 | test_kubernetes_clusters.py
   test_04_deploy_and_scale_kubernetes_cluster | `Failure` | 43.99 | test_kubernetes_clusters.py
   test_05_delete_kubernetes_cluster | `Failure` | 39.87 | test_kubernetes_clusters.py
   test_07_deploy_kubernetes_ha_cluster | `Failure` | 41.89 | test_kubernetes_clusters.py
   test_08_deploy_and_upgrade_kubernetes_ha_cluster | `Failure` | 43.94 | test_kubernetes_clusters.py
   test_09_delete_kubernetes_ha_cluster | `Failure` | 41.92 | test_kubernetes_clusters.py
   ContextSuite context=TestKubernetesCluster>:teardown | `Error` | 173.04 | test_kubernetes_clusters.py
   test_01_create_delete_portforwarding_fornonvpc | `Error` | 133.46 | test_portforwardingrules.py
   test_01_create_delete_portforwarding_fornonvpc | `Error` | 133.47 | test_portforwardingrules.py
   test_router_dhcphosts | `Error` | 2.11 | test_router_dhcphosts.py
   ContextSuite context=TestRouterDHCPHosts>:teardown | `Error` | 13.38 | test_router_dhcphosts.py
   test_router_dhcp_opts | `Error` | 2.14 | test_router_dhcphosts.py
   test_router_dns_guestipquery | `Error` | 2.12 | test_router_dns.py
   test_router_dns_guestipquery | `Error` | 2.11 | test_router_dnsservice.py
   test_01_single_VPC_iptables_policies | `Error` | 41.85 | test_routers_iptables_default_policy.py
   test_01_isolate_network_FW_PF_default_routes_egress_true | `Error` | 91.59 | test_routers_network_ops.py
   test_02_isolate_network_FW_PF_default_routes_egress_false | `Error` | 84.36 | test_routers_network_ops.py
   test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true | `Error` | 144.31 | test_routers_network_ops.py
   test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false | `Error` | 134.19 | test_routers_network_ops.py
   test_03_RVR_Network_check_router_state | `Failure` | 131.41 | test_routers_network_ops.py
   test_01_scale_vm | `Failure` | 9.25 | test_scale_vm.py
   test_04_change_offering_small | `Failure` | 821.64 | test_service_offerings.py
   test_01_lb_usage | `Error` | 2.13 | test_usage.py
   test_01_nat_usage | `Error` | 4.12 | test_usage.py
   test_01_vpn_usage | `Error` | 5.28 | test_usage.py
   test_10_attachAndDetach_iso | `Failure` | 722.67 | test_vm_life_cycle.py
   test_change_service_offering_for_vm_with_snapshots | `Failure` | 931.62 | test_vm_snapshots.py
   test_01_create_vm_snapshots | `Failure` | 715.47 | test_vm_snapshots.py
   test_02_revert_vm_snapshots | `Failure` | 720.08 | test_vm_snapshots.py
   test_03_delete_vm_snapshots | `Failure` | 0.01 | test_vm_snapshots.py
   test_01_create_volume | `Failure` | 721.15 | test_volumes.py
   test_02_attach_volume | `Failure` | 718.94 | test_volumes.py
   test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | `Error` | 40.16 | test_vpc_redundant.py
   test_02_redundant_VPC_default_routes | `Error` | 39.10 | test_vpc_redundant.py
   test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | `Error` | 38.09 | test_vpc_redundant.py
   test_04_rvpc_network_garbage_collector_nics | `Error` | 38.11 | test_vpc_redundant.py
   test_05_rvpc_multi_tiers | `Error` | 38.07 | test_vpc_redundant.py
   test_01_VPC_nics_after_destroy | `Error` | 38.08 | test_vpc_router_nics.py
   test_02_VPC_default_routes | `Error` | 36.06 | test_vpc_router_nics.py
   test_01_redundant_vpc_site2site_vpn | `Failure` | 38.87 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn_multiple_options | `Failure` | 34.80 | test_vpc_vpn.py
   test_01_vpc_remote_access_vpn | `Failure` | 33.67 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn | `Failure` | 35.81 | test_vpc_vpn.py
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] GabrielBrascher removed a comment on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
GabrielBrascher removed a comment on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-785435679


   @blueorangutan package


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-797840913


   <b>[S] Trillian test result (tid-107)</b>
   Environment: xenserver-72 (x2), Advanced Networking with Mgmt server 7
   Total time taken: 38032 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t107-xenserver-72.zip
   Intermittent failure detected: /marvin/tests/smoke/test_accounts.py
   Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_clusters.py
   Intermittent failure detected: /marvin/tests/smoke/test_scale_vm.py
   Intermittent failure detected: /marvin/tests/smoke/test_host_maintenance.py
   Smoke tests completed. 84 look OK, 2 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   test_DeleteDomain | `Error` | 226.57 | test_accounts.py
   test_01_scale_vm | `Failure` | 10.24 | test_scale_vm.py
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-791474021


   <b>Trillian test result (tid-3667)</b>
   Environment: kvm-centos8 (x2), Advanced Networking with Mgmt server 8
   Total time taken: 1277 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t3667-kvm-centos8.zip
   Smoke tests completed. 0 look OK, 1 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] rhtyd commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
rhtyd commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-832126835


   Nevermind - I'll take my comment back, as Trilian uses CentOS7 to run tests so it wouldn't cause any change. Let's merge based on test matrix and Travis! Fantastic effort @DaanHoogland 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] DaanHoogland commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
DaanHoogland commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-831153311


   ping @GabrielBrascher @weizhouapache @rhtyd @shwstppr can we merge?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-828912809


   <b>Trillian test result (tid-554)</b>
   Environment: vmware-65u2 (x2), Advanced Networking with Mgmt server 7
   Total time taken: 38974 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t554-vmware-65u2.zip
   Intermittent failure detected: /marvin/tests/smoke/test_nic.py
   Intermittent failure detected: /marvin/tests/smoke/test_scale_vm.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_life_cycle.py
   Smoke tests completed. 85 look OK, 3 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   test_03_nic_multiple_vmware | `Error` | 74.33 | test_nic.py
   ContextSuite context=TestScaleVm>:setup | `Error` | 0.00 | test_scale_vm.py
   test_01_migrate_VM_and_root_volume | `Error` | 0.01 | test_vm_life_cycle.py
   test_02_migrate_VM_with_two_data_disks | `Error` | 0.01 | test_vm_life_cycle.py
   test_03_migrate_detached_volume | `Error` | 0.01 | test_vm_life_cycle.py
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-828894299


   <b>Trillian test result (tid-552)</b>
   Environment: xenserver-71 (x2), Advanced Networking with Mgmt server 7
   Total time taken: 35232 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t552-xenserver-71.zip
   Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_clusters.py
   Intermittent failure detected: /marvin/tests/smoke/test_host_maintenance.py
   Smoke tests completed. 88 look OK, 0 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-797845090


   <b>[S] Trillian test result (tid-106)</b>
   Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
   Total time taken: 40451 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t106-kvm-centos7.zip
   Intermittent failure detected: /marvin/tests/smoke/test_accounts.py
   Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_clusters.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_life_cycle.py
   Smoke tests completed. 84 look OK, 2 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   test_DeleteDomain | `Error` | 153.35 | test_accounts.py
   ContextSuite context=TestSecuredVmMigration>:teardown | `Error` | 198.54 | test_vm_life_cycle.py
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] DaanHoogland removed a comment on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
DaanHoogland removed a comment on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-788748753


   @blueorangutan test matrix


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] DaanHoogland commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
DaanHoogland commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-828563401


   @blueorangutan test matrix


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan removed a comment on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan removed a comment on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-796839874






-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-828048467


   <b>Trillian test result (tid-542)</b>
   Environment: xenserver-71 (x2), Advanced Networking with Mgmt server 7
   Total time taken: 35817 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t542-xenserver-71.zip
   Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_clusters.py
   Intermittent failure detected: /marvin/tests/smoke/test_scale_vm.py
   Smoke tests completed. 87 look OK, 1 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   test_01_scale_vm | `Failure` | 9.25 | test_scale_vm.py
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-827597544


   Packaging result: :heavy_check_mark: centos7 :heavy_check_mark: centos8 :heavy_check_mark: debian. SL-JID 477


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] DaanHoogland commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
DaanHoogland commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-829942550


   @blueorangutan test matrix


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-791742687


   <b>Trillian test result (tid-3660)</b>
   Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
   Total time taken: 42684 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t3660-kvm-centos7.zip
   Intermittent failure detected: /marvin/tests/smoke/test_accounts.py
   Intermittent failure detected: /marvin/tests/smoke/test_deploy_virtio_scsi_vm.py
   Intermittent failure detected: /marvin/tests/smoke/test_deploy_vm_with_userdata.py
   Intermittent failure detected: /marvin/tests/smoke/test_diagnostics.py
   Intermittent failure detected: /marvin/tests/smoke/test_domain_vpc_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_internal_lb.py
   Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_clusters.py
   Intermittent failure detected: /marvin/tests/smoke/test_loadbalance.py
   Intermittent failure detected: /marvin/tests/smoke/test_migration.py
   Intermittent failure detected: /marvin/tests/smoke/test_network_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_network.py
   Intermittent failure detected: /marvin/tests/smoke/test_password_server.py
   Intermittent failure detected: /marvin/tests/smoke/test_portforwardingrules.py
   Intermittent failure detected: /marvin/tests/smoke/test_privategw_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dhcphosts.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dns.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dnsservice.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_iptables_default_policy.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_network_ops.py
   Intermittent failure detected: /marvin/tests/smoke/test_service_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_usage.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_life_cycle.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_snapshots.py
   Intermittent failure detected: /marvin/tests/smoke/test_volumes.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_router_nics.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_vpn.py
   Smoke tests completed. 59 look OK, 27 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   test_DeleteDomain | `Error` | 128.48 | test_accounts.py
   test_DeleteDomain | `Error` | 128.48 | test_accounts.py
   test_forceDeleteDomain | `Failure` | 132.66 | test_accounts.py
   test_forceDeleteDomain | `Error` | 132.66 | test_accounts.py
   ContextSuite context=TestLoadBalance>:setup | `Error` | 0.00 | test_loadbalance.py
   test_04_verify_guest_lspci | `Error` | 715.53 | test_deploy_virtio_scsi_vm.py
   test_06_verify_guest_lspci_again | `Error` | 715.59 | test_deploy_virtio_scsi_vm.py
   test_01_native_to_native_network_migration | `Error` | 36.31 | test_migration.py
   test_02_native_to_native_vpc_migration | `Error` | 22.91 | test_migration.py
   test_network_acl | `Error` | 20.50 | test_network_acl.py
   test_delete_account | `Error` | 64.26 | test_network.py
   test_01_port_fwd_on_src_nat | `Error` | 2.12 | test_network.py
   test_02_port_fwd_on_non_src_nat | `Error` | 6.29 | test_network.py
   test_reboot_router | `Error` | 178.24 | test_network.py
   test_releaseIP | `Error` | 60.25 | test_network.py
   test_network_rules_acquired_public_ip_1_static_nat_rule | `Error` | 3.18 | test_network.py
   test_network_rules_acquired_public_ip_2_nat_rule | `Error` | 3.18 | test_network.py
   test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | `Error` | 3.17 | test_network.py
   test_deployvm_userdata | `Error` | 21.60 | test_deploy_vm_with_userdata.py
   test_deployvm_userdata_post | `Error` | 6.26 | test_deploy_vm_with_userdata.py
   test_13_retrieve_vr_default_files | `Error` | 1.07 | test_diagnostics.py
   test_14_retrieve_vr_one_file | `Error` | 1.06 | test_diagnostics.py
   test_15_retrieve_ssvm_default_files | `Error` | 1.06 | test_diagnostics.py
   test_16_retrieve_ssvm_single_file | `Error` | 1.07 | test_diagnostics.py
   test_17_retrieve_cpvm_default_files | `Error` | 1.07 | test_diagnostics.py
   test_18_retrieve_cpvm_single_file | `Error` | 1.07 | test_diagnostics.py
   test_03_create_vpc_domain_vpc_offering | `Error` | 23.22 | test_domain_vpc_offerings.py
   test_isolate_network_password_server | `Error` | 2.13 | test_password_server.py
   test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 | `Failure` | 22.93 | test_internal_lb.py
   test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 | `Failure` | 22.93 | test_internal_lb.py
   test_03_vpc_internallb_haproxy_stats_on_all_interfaces | `Failure` | 21.77 | test_internal_lb.py
   test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | `Failure` | 23.78 | test_internal_lb.py
   test_01_vpc_privategw_acl | `Failure` | 24.92 | test_privategw_acl.py
   test_02_vpc_privategw_static_routes | `Failure` | 26.08 | test_privategw_acl.py
   test_03_vpc_privategw_restart_vpc_cleanup | `Failure` | 25.96 | test_privategw_acl.py
   test_04_rvpc_privategw_static_routes | `Failure` | 24.98 | test_privategw_acl.py
   test_01_deploy_kubernetes_cluster | `Failure` | 20.72 | test_kubernetes_clusters.py
   test_02_invalid_upgrade_kubernetes_cluster | `Failure` | 21.61 | test_kubernetes_clusters.py
   test_03_deploy_and_upgrade_kubernetes_cluster | `Failure` | 20.52 | test_kubernetes_clusters.py
   test_04_deploy_and_scale_kubernetes_cluster | `Failure` | 22.54 | test_kubernetes_clusters.py
   test_05_delete_kubernetes_cluster | `Failure` | 21.55 | test_kubernetes_clusters.py
   test_07_deploy_kubernetes_ha_cluster | `Failure` | 21.54 | test_kubernetes_clusters.py
   test_08_deploy_and_upgrade_kubernetes_ha_cluster | `Failure` | 24.70 | test_kubernetes_clusters.py
   test_09_delete_kubernetes_ha_cluster | `Failure` | 23.59 | test_kubernetes_clusters.py
   ContextSuite context=TestKubernetesCluster>:teardown | `Error` | 153.93 | test_kubernetes_clusters.py
   test_01_create_delete_portforwarding_fornonvpc | `Error` | 102.98 | test_portforwardingrules.py
   test_01_create_delete_portforwarding_fornonvpc | `Error` | 102.98 | test_portforwardingrules.py
   test_router_dhcphosts | `Error` | 2.12 | test_router_dhcphosts.py
   ContextSuite context=TestRouterDHCPHosts>:teardown | `Error` | 12.36 | test_router_dhcphosts.py
   test_router_dhcp_opts | `Error` | 2.15 | test_router_dhcphosts.py
   test_router_dns_guestipquery | `Error` | 2.11 | test_router_dns.py
   test_router_dns_guestipquery | `Error` | 2.13 | test_router_dnsservice.py
   test_01_single_VPC_iptables_policies | `Error` | 21.53 | test_routers_iptables_default_policy.py
   test_01_isolate_network_FW_PF_default_routes_egress_true | `Error` | 63.04 | test_routers_network_ops.py
   test_02_isolate_network_FW_PF_default_routes_egress_false | `Error` | 64.05 | test_routers_network_ops.py
   test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true | `Error` | 95.30 | test_routers_network_ops.py
   test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false | `Error` | 95.24 | test_routers_network_ops.py
   test_03_RVR_Network_check_router_state | `Failure` | 94.25 | test_routers_network_ops.py
   test_01_service_offering_cpu_limit_use | `Error` | 716.05 | test_service_offerings.py
   test_04_change_offering_small | `Failure` | 817.02 | test_service_offerings.py
   test_01_lb_usage | `Error` | 2.14 | test_usage.py
   test_01_nat_usage | `Error` | 3.10 | test_usage.py
   test_01_vpn_usage | `Error` | 4.25 | test_usage.py
   ContextSuite context=TestSecuredVmMigration>:teardown | `Error` | 309.64 | test_vm_life_cycle.py
   ContextSuite context=TestVMLifeCycle>:setup | `Error` | 4.65 | test_vm_life_cycle.py
   test_01_create_vm_snapshots | `Failure` | 715.64 | test_vm_snapshots.py
   test_02_revert_vm_snapshots | `Failure` | 719.98 | test_vm_snapshots.py
   test_03_delete_vm_snapshots | `Failure` | 0.01 | test_vm_snapshots.py
   test_01_create_volume | `Failure` | 720.95 | test_volumes.py
   test_02_attach_volume | `Failure` | 753.52 | test_volumes.py
   test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | `Error` | 21.96 | test_vpc_redundant.py
   test_02_redundant_VPC_default_routes | `Error` | 21.85 | test_vpc_redundant.py
   test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | `Error` | 23.89 | test_vpc_redundant.py
   test_04_rvpc_network_garbage_collector_nics | `Error` | 23.90 | test_vpc_redundant.py
   test_05_rvpc_multi_tiers | `Error` | 21.89 | test_vpc_redundant.py
   test_01_VPC_nics_after_destroy | `Error` | 20.84 | test_vpc_router_nics.py
   test_02_VPC_default_routes | `Error` | 21.84 | test_vpc_router_nics.py
   test_01_redundant_vpc_site2site_vpn | `Failure` | 25.66 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn_multiple_options | `Failure` | 22.59 | test_vpc_vpn.py
   test_01_vpc_remote_access_vpn | `Failure` | 19.44 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn | `Failure` | 23.64 | test_vpc_vpn.py
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-804735470


   Packaging result: :heavy_check_mark: centos7 :heavy_check_mark: centos8 :heavy_check_mark: debian. SL-JID 205


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] DaanHoogland commented on a change in pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
DaanHoogland commented on a change in pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#discussion_r592968380



##########
File path: test/integration/smoke/test_vm_life_cycle.py
##########
@@ -1443,11 +1433,13 @@ def setUp(self):
         if len(self.hosts) < 2:
             self.skipTest("Requires at least two hosts for performing migration related tests")
 
+        for host in self.hosts:
+            print(f"=== setup() === Host.OS = {host.details['Host.OS']}")
+            if host.details['Host.OS'] in ['CentOS']:
+                self.skipTest("live migration is not stabily supported on CentOS")
+

Review comment:
       see #4801




----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-798672437


   Packaging result: :heavy_check_mark: centos7 :heavy_check_mark: centos8 :heavy_check_mark: debian. SL-JID 102


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] rhtyd removed a comment on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
rhtyd removed a comment on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-786500292


   @blueorangutan package


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-829902552


   Packaging result: :heavy_check_mark: centos7 :heavy_check_mark: centos8 :heavy_check_mark: debian. SL-JID 495


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] shwstppr commented on a change in pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
shwstppr commented on a change in pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#discussion_r592961107



##########
File path: test/integration/smoke/test_vm_life_cycle.py
##########
@@ -1443,11 +1433,13 @@ def setUp(self):
         if len(self.hosts) < 2:
             self.skipTest("Requires at least two hosts for performing migration related tests")
 
+        for host in self.hosts:
+            print(f"=== setup() === Host.OS = {host.details['Host.OS']}")
+            if host.details['Host.OS'] in ['CentOS']:
+                self.skipTest("live migration is not stabily supported on CentOS")
+

Review comment:
       @DaanHoogland can we have this in a separate PR to get this merged earlier to fix failing migration tests on Trillian https://github.com/apache/cloudstack/issues/4757?
   Assuming Marvin3 work might need some more time.
   cc @rhtyd  @weizhouapache 




----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan removed a comment on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan removed a comment on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-797872671


   <b>[S] Trillian test result (tid-119)</b>
   Environment: vmware-67u3 (x2), Advanced Networking with Mgmt server 7
   Total time taken: 39187 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t119-vmware-67u3.zip
   Intermittent failure detected: /marvin/tests/smoke/test_accounts.py
   Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_clusters.py
   Intermittent failure detected: /marvin/tests/smoke/test_nic.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_life_cycle.py
   Smoke tests completed. 82 look OK, 4 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   test_DeleteDomain | `Error` | 219.79 | test_accounts.py
   test_03_nic_multiple_vmware | `Error` | 74.09 | test_nic.py
   test_01_deploy_kubernetes_cluster | `Failure` | 0.01 | test_kubernetes_clusters.py
   test_02_invalid_upgrade_kubernetes_cluster | `Failure` | 0.01 | test_kubernetes_clusters.py
   test_03_deploy_and_upgrade_kubernetes_cluster | `Failure` | 0.01 | test_kubernetes_clusters.py
   test_04_deploy_and_scale_kubernetes_cluster | `Failure` | 0.01 | test_kubernetes_clusters.py
   test_05_delete_kubernetes_cluster | `Failure` | 0.01 | test_kubernetes_clusters.py
   test_06_deploy_invalid_kubernetes_ha_cluster | `Failure` | 0.01 | test_kubernetes_clusters.py
   test_07_deploy_kubernetes_ha_cluster | `Failure` | 0.01 | test_kubernetes_clusters.py
   test_08_deploy_and_upgrade_kubernetes_ha_cluster | `Failure` | 0.01 | test_kubernetes_clusters.py
   test_09_delete_kubernetes_ha_cluster | `Failure` | 0.01 | test_kubernetes_clusters.py
   test_01_migrate_VM_and_root_volume | `Error` | 0.01 | test_vm_life_cycle.py
   test_02_migrate_VM_with_two_data_disks | `Error` | 0.01 | test_vm_life_cycle.py
   test_03_migrate_detached_volume | `Error` | 0.01 | test_vm_life_cycle.py
   ContextSuite context=TestVAppsVM>:setup | `Error` | 44.32 | test_vm_life_cycle.py
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-829943104


   @DaanHoogland a Trillian-Jenkins matrix job (centos7 mgmt + xs71, centos7 mgmt + vmware65, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-794225017


   Packaging result: :heavy_check_mark: centos7 :heavy_check_mark: centos8 :heavy_check_mark: debian. SL-JID 66


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-793202183


   <b>[S] Trillian test result (tid-54)</b>
   Environment: kvm-centos8 (x2), Advanced Networking with Mgmt server 7
   Total time taken: 38236 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t54-kvm-centos8.zip
   Intermittent failure detected: /marvin/tests/smoke/test_accounts.py
   Intermittent failure detected: /marvin/tests/smoke/test_affinity_groups_projects.py
   Intermittent failure detected: /marvin/tests/smoke/test_affinity_groups.py
   Intermittent failure detected: /marvin/tests/smoke/test_deploy_virtio_scsi_vm.py
   Intermittent failure detected: /marvin/tests/smoke/test_deploy_vm_with_userdata.py
   Intermittent failure detected: /marvin/tests/smoke/test_diagnostics.py
   Intermittent failure detected: /marvin/tests/smoke/test_domain_vpc_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_internal_lb.py
   Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_clusters.py
   Intermittent failure detected: /marvin/tests/smoke/test_loadbalance.py
   Intermittent failure detected: /marvin/tests/smoke/test_migration.py
   Intermittent failure detected: /marvin/tests/smoke/test_network_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_network.py
   Intermittent failure detected: /marvin/tests/smoke/test_password_server.py
   Intermittent failure detected: /marvin/tests/smoke/test_portforwardingrules.py
   Intermittent failure detected: /marvin/tests/smoke/test_privategw_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dhcphosts.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dns.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dnsservice.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_iptables_default_policy.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_network_ops.py
   Intermittent failure detected: /marvin/tests/smoke/test_service_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_usage.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_life_cycle.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_snapshots.py
   Intermittent failure detected: /marvin/tests/smoke/test_volumes.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_router_nics.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_vpn.py
   Intermittent failure detected: /marvin/tests/smoke/test_hostha_kvm.py
   Smoke tests completed. 56 look OK, 30 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   test_DeleteDomain | `Error` | 155.22 | test_accounts.py
   test_DeleteDomain | `Error` | 155.24 | test_accounts.py
   test_forceDeleteDomain | `Failure` | 148.09 | test_accounts.py
   test_forceDeleteDomain | `Error` | 148.10 | test_accounts.py
   ContextSuite context=TestLoadBalance>:setup | `Error` | 0.00 | test_loadbalance.py
   test_DeployVmAntiAffinityGroup_in_project | `Error` | 60.92 | test_affinity_groups_projects.py
   test_DeployVmAntiAffinityGroup | `Error` | 35.37 | test_affinity_groups.py
   test_04_verify_guest_lspci | `Error` | 600.72 | test_deploy_virtio_scsi_vm.py
   test_06_verify_guest_lspci_again | `Error` | 600.65 | test_deploy_virtio_scsi_vm.py
   test_01_native_to_native_network_migration | `Error` | 45.50 | test_migration.py
   test_02_native_to_native_vpc_migration | `Error` | 31.18 | test_migration.py
   test_network_acl | `Error` | 28.72 | test_network_acl.py
   test_delete_account | `Error` | 76.56 | test_network.py
   test_01_port_fwd_on_src_nat | `Error` | 2.16 | test_network.py
   test_02_port_fwd_on_non_src_nat | `Error` | 7.33 | test_network.py
   test_reboot_router | `Error` | 182.48 | test_network.py
   test_releaseIP | `Error` | 64.39 | test_network.py
   test_network_rules_acquired_public_ip_1_static_nat_rule | `Error` | 2.24 | test_network.py
   test_network_rules_acquired_public_ip_2_nat_rule | `Error` | 3.18 | test_network.py
   test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | `Error` | 3.24 | test_network.py
   test_deployvm_userdata | `Error` | 36.93 | test_deploy_vm_with_userdata.py
   test_deployvm_userdata_post | `Error` | 8.35 | test_deploy_vm_with_userdata.py
   test_13_retrieve_vr_default_files | `Error` | 1.08 | test_diagnostics.py
   test_14_retrieve_vr_one_file | `Error` | 1.08 | test_diagnostics.py
   test_15_retrieve_ssvm_default_files | `Error` | 1.07 | test_diagnostics.py
   test_16_retrieve_ssvm_single_file | `Error` | 1.08 | test_diagnostics.py
   test_17_retrieve_cpvm_default_files | `Error` | 1.07 | test_diagnostics.py
   test_18_retrieve_cpvm_single_file | `Error` | 1.10 | test_diagnostics.py
   test_03_create_vpc_domain_vpc_offering | `Error` | 32.69 | test_domain_vpc_offerings.py
   test_isolate_network_password_server | `Error` | 2.12 | test_password_server.py
   test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 | `Failure` | 55.67 | test_internal_lb.py
   test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 | `Failure` | 52.70 | test_internal_lb.py
   test_03_vpc_internallb_haproxy_stats_on_all_interfaces | `Failure` | 40.26 | test_internal_lb.py
   test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | `Failure` | 37.17 | test_internal_lb.py
   test_01_vpc_privategw_acl | `Failure` | 28.09 | test_privategw_acl.py
   test_02_vpc_privategw_static_routes | `Failure` | 28.11 | test_privategw_acl.py
   test_03_vpc_privategw_restart_vpc_cleanup | `Failure` | 28.09 | test_privategw_acl.py
   test_04_rvpc_privategw_static_routes | `Failure` | 32.24 | test_privategw_acl.py
   test_01_deploy_kubernetes_cluster | `Failure` | 33.18 | test_kubernetes_clusters.py
   test_02_invalid_upgrade_kubernetes_cluster | `Failure` | 33.91 | test_kubernetes_clusters.py
   test_03_deploy_and_upgrade_kubernetes_cluster | `Failure` | 31.80 | test_kubernetes_clusters.py
   test_04_deploy_and_scale_kubernetes_cluster | `Failure` | 34.86 | test_kubernetes_clusters.py
   test_05_delete_kubernetes_cluster | `Failure` | 35.92 | test_kubernetes_clusters.py
   test_07_deploy_kubernetes_ha_cluster | `Failure` | 0.07 | test_kubernetes_clusters.py
   test_08_deploy_and_upgrade_kubernetes_ha_cluster | `Failure` | 0.05 | test_kubernetes_clusters.py
   test_09_delete_kubernetes_ha_cluster | `Failure` | 0.04 | test_kubernetes_clusters.py
   ContextSuite context=TestKubernetesCluster>:teardown | `Error` | 98.91 | test_kubernetes_clusters.py
   test_01_create_delete_portforwarding_fornonvpc | `Error` | 109.29 | test_portforwardingrules.py
   test_01_create_delete_portforwarding_fornonvpc | `Error` | 109.30 | test_portforwardingrules.py
   test_router_dhcphosts | `Error` | 2.13 | test_router_dhcphosts.py
   ContextSuite context=TestRouterDHCPHosts>:teardown | `Error` | 11.37 | test_router_dhcphosts.py
   test_router_dhcp_opts | `Error` | 2.18 | test_router_dhcphosts.py
   test_router_dns_guestipquery | `Error` | 2.12 | test_router_dns.py
   test_router_dns_guestipquery | `Error` | 2.16 | test_router_dnsservice.py
   test_01_single_VPC_iptables_policies | `Error` | 29.76 | test_routers_iptables_default_policy.py
   test_01_isolate_network_FW_PF_default_routes_egress_true | `Error` | 74.30 | test_routers_network_ops.py
   test_02_isolate_network_FW_PF_default_routes_egress_false | `Error` | 74.26 | test_routers_network_ops.py
   test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true | `Error` | 115.69 | test_routers_network_ops.py
   test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false | `Error` | 118.49 | test_routers_network_ops.py
   test_03_RVR_Network_check_router_state | `Failure` | 119.90 | test_routers_network_ops.py
   test_01_service_offering_cpu_limit_use | `Error` | 601.08 | test_service_offerings.py
   test_04_change_offering_small | `Failure` | 703.68 | test_service_offerings.py
   test_01_lb_usage | `Error` | 2.16 | test_usage.py
   test_01_nat_usage | `Error` | 4.13 | test_usage.py
   test_01_vpn_usage | `Error` | 5.29 | test_usage.py
   runTest | `Error` | 0.00 | test_vm_life_cycle.py
   runTest | `Error` | 0.00 | test_vm_life_cycle.py
   test_01_create_vm_snapshots | `Failure` | 600.71 | test_vm_snapshots.py
   test_02_revert_vm_snapshots | `Failure` | 600.67 | test_vm_snapshots.py
   test_03_delete_vm_snapshots | `Failure` | 0.01 | test_vm_snapshots.py
   test_01_create_volume | `Failure` | 604.00 | test_volumes.py
   test_02_attach_volume | `Failure` | 643.72 | test_volumes.py
   test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | `Error` | 31.12 | test_vpc_redundant.py
   test_02_redundant_VPC_default_routes | `Error` | 31.14 | test_vpc_redundant.py
   test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | `Error` | 32.09 | test_vpc_redundant.py
   test_04_rvpc_network_garbage_collector_nics | `Error` | 32.15 | test_vpc_redundant.py
   test_05_rvpc_multi_tiers | `Error` | 32.13 | test_vpc_redundant.py
   test_01_VPC_nics_after_destroy | `Error` | 30.07 | test_vpc_router_nics.py
   test_02_VPC_default_routes | `Error` | 30.06 | test_vpc_router_nics.py
   test_01_redundant_vpc_site2site_vpn | `Failure` | 31.84 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn_multiple_options | `Failure` | 28.75 | test_vpc_vpn.py
   test_01_vpc_remote_access_vpn | `Failure` | 27.62 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn | `Failure` | 28.83 | test_vpc_vpn.py
   runTest | `Error` | 0.00 | test_hostha_kvm.py
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-785436244


   @GabrielBrascher a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan removed a comment on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan removed a comment on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-790670058






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] DaanHoogland commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
DaanHoogland commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-827617708


   @blueorangutan test matrix


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] rhtyd edited a comment on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
rhtyd edited a comment on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-832126835


   Nevermind - I'll take my comment back, as Trilian uses CentOS7 to run tests so it wouldn't make a difference if we run a smoketests again with centos8/ubuntu etc. Let's merge based on test matrix and Travis! Fantastic effort @DaanHoogland 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-786035534


   Packaging result: :heavy_check_mark: centos7 :heavy_check_mark: centos8 :heavy_check_mark: debian. SL-JID 43


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-795040999


   <b>[S] Trillian test result (tid-62)</b>
   Environment: kvm-ubuntu20 (x2), Advanced Networking with Mgmt server u20
   Total time taken: 66417 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t62-kvm-ubuntu20.zip
   Intermittent failure detected: /marvin/tests/smoke/test_accounts.py
   Intermittent failure detected: /marvin/tests/smoke/test_deploy_virtio_scsi_vm.py
   Intermittent failure detected: /marvin/tests/smoke/test_deploy_vm_with_userdata.py
   Intermittent failure detected: /marvin/tests/smoke/test_diagnostics.py
   Intermittent failure detected: /marvin/tests/smoke/test_domain_vpc_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_internal_lb.py
   Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_clusters.py
   Intermittent failure detected: /marvin/tests/smoke/test_loadbalance.py
   Intermittent failure detected: /marvin/tests/smoke/test_migration.py
   Intermittent failure detected: /marvin/tests/smoke/test_network_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_network.py
   Intermittent failure detected: /marvin/tests/smoke/test_password_server.py
   Intermittent failure detected: /marvin/tests/smoke/test_portforwardingrules.py
   Intermittent failure detected: /marvin/tests/smoke/test_privategw_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_reset_vm_on_reboot.py
   Intermittent failure detected: /marvin/tests/smoke/test_resource_accounting.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dhcphosts.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dns.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dnsservice.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_iptables_default_policy.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_network_ops.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers.py
   Intermittent failure detected: /marvin/tests/smoke/test_service_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_snapshots.py
   Intermittent failure detected: /marvin/tests/smoke/test_ssvm.py
   Intermittent failure detected: /marvin/tests/smoke/test_usage.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_life_cycle.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_snapshots.py
   Intermittent failure detected: /marvin/tests/smoke/test_volumes.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_router_nics.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_vpn.py
   Intermittent failure detected: /marvin/tests/smoke/test_hostha_kvm.py
   Smoke tests completed. 54 look OK, 32 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   ContextSuite context=TestLoadBalance>:setup | `Error` | 0.00 | test_loadbalance.py
   test_DeleteDomain | `Error` | 152.28 | test_accounts.py
   test_DeleteDomain | `Error` | 152.29 | test_accounts.py
   test_forceDeleteDomain | `Failure` | 146.99 | test_accounts.py
   test_forceDeleteDomain | `Error` | 147.00 | test_accounts.py
   test_01_native_to_native_network_migration | `Error` | 44.85 | test_migration.py
   test_02_native_to_native_vpc_migration | `Error` | 29.33 | test_migration.py
   test_04_verify_guest_lspci | `Error` | 600.65 | test_deploy_virtio_scsi_vm.py
   test_06_verify_guest_lspci_again | `Error` | 600.72 | test_deploy_virtio_scsi_vm.py
   test_network_acl | `Error` | 28.94 | test_network_acl.py
   test_delete_account | `Error` | 67.89 | test_network.py
   test_01_port_fwd_on_src_nat | `Error` | 2.21 | test_network.py
   test_02_port_fwd_on_non_src_nat | `Error` | 7.48 | test_network.py
   test_reboot_router | `Error` | 182.76 | test_network.py
   test_releaseIP | `Error` | 68.96 | test_network.py
   test_network_rules_acquired_public_ip_1_static_nat_rule | `Error` | 3.35 | test_network.py
   test_network_rules_acquired_public_ip_2_nat_rule | `Error` | 3.25 | test_network.py
   test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | `Error` | 3.25 | test_network.py
   ContextSuite context=TestDeployVmWithUserData>:setup | `Error` | 0.00 | test_deploy_vm_with_userdata.py
   test_13_retrieve_vr_default_files | `Error` | 1.15 | test_diagnostics.py
   test_14_retrieve_vr_one_file | `Error` | 1.15 | test_diagnostics.py
   test_15_retrieve_ssvm_default_files | `Error` | 1.15 | test_diagnostics.py
   test_16_retrieve_ssvm_single_file | `Error` | 1.15 | test_diagnostics.py
   test_17_retrieve_cpvm_default_files | `Error` | 1.15 | test_diagnostics.py
   test_18_retrieve_cpvm_single_file | `Error` | 1.13 | test_diagnostics.py
   test_isolate_network_password_server | `Error` | 2.20 | test_password_server.py
   test_03_create_vpc_domain_vpc_offering | `Error` | 32.93 | test_domain_vpc_offerings.py
   test_01_vpc_privategw_acl | `Failure` | 30.36 | test_privategw_acl.py
   test_02_vpc_privategw_static_routes | `Error` | 0.39 | test_privategw_acl.py
   test_03_vpc_privategw_restart_vpc_cleanup | `Failure` | 27.30 | test_privategw_acl.py
   test_04_rvpc_privategw_static_routes | `Error` | 0.46 | test_privategw_acl.py
   test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 | `Failure` | 30.69 | test_internal_lb.py
   test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 | `Failure` | 32.78 | test_internal_lb.py
   test_03_vpc_internallb_haproxy_stats_on_all_interfaces | `Failure` | 29.41 | test_internal_lb.py
   test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | `Failure` | 32.46 | test_internal_lb.py
   test_01_deploy_kubernetes_cluster | `Failure` | 34.38 | test_kubernetes_clusters.py
   test_02_invalid_upgrade_kubernetes_cluster | `Failure` | 33.19 | test_kubernetes_clusters.py
   test_03_deploy_and_upgrade_kubernetes_cluster | `Failure` | 34.19 | test_kubernetes_clusters.py
   test_04_deploy_and_scale_kubernetes_cluster | `Failure` | 34.06 | test_kubernetes_clusters.py
   test_05_delete_kubernetes_cluster | `Failure` | 34.13 | test_kubernetes_clusters.py
   test_07_deploy_kubernetes_ha_cluster | `Failure` | 34.14 | test_kubernetes_clusters.py
   test_08_deploy_and_upgrade_kubernetes_ha_cluster | `Failure` | 34.17 | test_kubernetes_clusters.py
   test_09_delete_kubernetes_ha_cluster | `Failure` | 33.13 | test_kubernetes_clusters.py
   ContextSuite context=TestKubernetesCluster>:teardown | `Error` | 166.85 | test_kubernetes_clusters.py
   test_01_create_delete_portforwarding_fornonvpc | `Error` | 111.91 | test_portforwardingrules.py
   test_01_create_delete_portforwarding_fornonvpc | `Error` | 111.92 | test_portforwardingrules.py
   ContextSuite context=TestResetVmOnReboot>:setup | `Error` | 0.00 | test_reset_vm_on_reboot.py
   runTest | `Error` | 0.00 | test_hostha_kvm.py
   ContextSuite context=TestRAMCPUResourceAccounting>:setup | `Error` | 0.00 | test_resource_accounting.py
   ContextSuite context=TestRouterDHCPHosts>:setup | `Error` | 0.00 | test_router_dhcphosts.py
   ContextSuite context=TestRouterDHCPOpts>:setup | `Error` | 0.00 | test_router_dhcphosts.py
   ContextSuite context=TestRouterDns>:setup | `Error` | 0.00 | test_router_dns.py
   ContextSuite context=TestRouterDnsService>:setup | `Error` | 0.00 | test_router_dnsservice.py
   ContextSuite context=TestRouterIpTablesPolicies>:setup | `Error` | 0.00 | test_routers_iptables_default_policy.py
   ContextSuite context=TestVPCIpTablesPolicies>:setup | `Error` | 0.00 | test_routers_iptables_default_policy.py
   ContextSuite context=TestIsolatedNetworks>:setup | `Error` | 0.00 | test_routers_network_ops.py
   ContextSuite context=TestRedundantIsolateNetworks>:setup | `Error` | 0.00 | test_routers_network_ops.py
   ContextSuite context=TestRouterServices>:setup | `Error` | 0.00 | test_routers.py
   ContextSuite context=TestCpuCapServiceOfferings>:setup | `Error` | 0.00 | test_service_offerings.py
   ContextSuite context=TestServiceOfferings>:setup | `Error` | 0.20 | test_service_offerings.py
   ContextSuite context=TestSnapshotRootDisk>:setup | `Error` | 0.00 | test_snapshots.py
   test_01_lb_usage | `Error` | 2.22 | test_usage.py
   test_01_nat_usage | `Error` | 4.21 | test_usage.py
   test_01_vpn_usage | `Error` | 5.42 | test_usage.py
   runTest | `Error` | 0.00 | test_vm_life_cycle.py
   runTest | `Error` | 0.00 | test_vm_life_cycle.py
   test_01_create_vm_snapshots | `Failure` | 600.81 | test_vm_snapshots.py
   test_02_revert_vm_snapshots | `Failure` | 600.71 | test_vm_snapshots.py
   test_03_delete_vm_snapshots | `Failure` | 0.02 | test_vm_snapshots.py
   test_01_create_volume | `Failure` | 606.09 | test_volumes.py
   test_02_attach_volume | `Failure` | 643.08 | test_volumes.py
   test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | `Error` | 30.35 | test_vpc_redundant.py
   test_02_redundant_VPC_default_routes | `Error` | 31.48 | test_vpc_redundant.py
   test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | `Error` | 32.48 | test_vpc_redundant.py
   test_04_rvpc_network_garbage_collector_nics | `Error` | 29.31 | test_vpc_redundant.py
   test_05_rvpc_multi_tiers | `Error` | 32.39 | test_vpc_redundant.py
   test_01_VPC_nics_after_destroy | `Error` | 29.35 | test_vpc_router_nics.py
   test_02_VPC_default_routes | `Error` | 30.42 | test_vpc_router_nics.py
   test_01_redundant_vpc_site2site_vpn | `Failure` | 32.16 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn_multiple_options | `Failure` | 30.00 | test_vpc_vpn.py
   test_01_vpc_remote_access_vpn | `Failure` | 28.82 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn | `Failure` | 28.05 | test_vpc_vpn.py
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan removed a comment on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan removed a comment on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-785436244






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan removed a comment on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan removed a comment on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-796254261






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-799467560


   Packaging result: :heavy_check_mark: centos7 :heavy_check_mark: centos8 :heavy_check_mark: debian. SL-JID 122


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-799895949


   <b>[S] Trillian test result (tid-138)</b>
   Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
   Total time taken: 35442 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t138-kvm-centos7.zip
   Intermittent failure detected: /marvin/tests/smoke/test_diagnostics.py
   Smoke tests completed. 86 look OK, 0 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] weizhouapache commented on a change in pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
weizhouapache commented on a change in pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#discussion_r596633192



##########
File path: debian/cloudstack-marvin.postinst
##########
@@ -19,5 +19,6 @@
 
 set -e
 
-pip install --upgrade http://cdn.mysql.com/Downloads/Connector-Python/mysql-connector-python-2.0.4.zip#md5=3df394d89300db95163f17c843ef49df
-pip install --upgrade /usr/share/cloudstack-marvin/Marvin-*.tar.gz
+python3 -m pip install --upgrade pip
+python3 -m pip install --upgrade http://cdn.mysql.com/Downloads/Connector-Python/mysql-connector-python-2.0.4.zip#md5=3df394d89300db95163f17c843ef49df

Review comment:
       @GabrielBrascher line 23 is not needed, as pip3 install latest mysql-connector-python 8.0.15
   ```
   root@mgt01:~# pip3 list |grep mysql-connector-python
   mysql-connector-python 8.0.15
   ```




----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] DaanHoogland commented on a change in pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
DaanHoogland commented on a change in pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#discussion_r582644042



##########
File path: systemvm/test/runtests.sh
##########
@@ -22,17 +22,19 @@ export PYTHONPATH="../debian/opt/cloud/bin/"
 export PYTHONDONTWRITEBYTECODE=False
 
 echo "Running pycodestyle to check systemvm/python code for errors"
-pycodestyle --max-line-length=179 *py
-pycodestyle --max-line-length=179 --exclude=monitorServices.py,baremetal-vr.py,passwd_server_ip.py `find ../debian -name \*.py`
+python3 -m pycodestyle --max-line-length=179 *py
+python3 -m pycodestyle --max-line-length=179 --exclude=monitorServices.py,baremetal-vr.py,passwd_server_ip.py `find ../debian -name \*.py`
 if [ $? -gt 0 ]
 then
     echo "pycodestyle failed, please check your code"
     exit 1
 fi
 
 echo "Running pylint to check systemvm/python code for errors"
-pylint --disable=R,C,W *.py
-pylint --disable=R,C,W `find ../debian -name \*.py`
+python --version
+pyenv versions
+pylint3 --disable=R,C,W *.py
+pylint3 --disable=R,C,W `find ../debian -name \*.py`

Review comment:
       ```suggestion
   pylint --version
   pylint --disable=R,C,W *.py
   pylint --disable=R,C,W `find ../debian -name \*.py`
   ```




----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-790689281


   Packaging result: ✔centos7 ✔centos8 ✔debian. JID-2866


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-786500967


   @rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] DaanHoogland commented on a change in pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
DaanHoogland commented on a change in pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#discussion_r592964447



##########
File path: test/integration/smoke/test_vm_life_cycle.py
##########
@@ -1443,11 +1433,13 @@ def setUp(self):
         if len(self.hosts) < 2:
             self.skipTest("Requires at least two hosts for performing migration related tests")
 
+        for host in self.hosts:
+            print(f"=== setup() === Host.OS = {host.details['Host.OS']}")
+            if host.details['Host.OS'] in ['CentOS']:
+                self.skipTest("live migration is not stabily supported on CentOS")
+

Review comment:
       will do




----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan removed a comment on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan removed a comment on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-829019785


   Packaging result: :heavy_check_mark: centos7 :heavy_check_mark: centos8 :heavy_multiplication_x: debian. SL-JID 484


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] DaanHoogland commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
DaanHoogland commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-829315895


   @blueorangutan test matrix


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-790670058


   Packaging result: :heavy_check_mark: centos7 :heavy_check_mark: centos8 :heavy_check_mark: debian. SL-JID 51


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-786245095


   @GabrielBrascher a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan removed a comment on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan removed a comment on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-786616474






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-795621470


   Packaging result: :heavy_check_mark: centos7 :heavy_check_mark: centos8 :heavy_check_mark: debian. SL-JID 78


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-788057521


   Packaging result: ✖centos7 ✔centos8 ✔debian. JID-2849


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan removed a comment on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan removed a comment on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-827618455


   @DaanHoogland a Trillian-Jenkins matrix job (centos7 mgmt + xs71, centos7 mgmt + vmware65, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] rhtyd commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
rhtyd commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-791272103


   @DaanHoogland pl also check/add support for python3 (urlib3 etc) for cloudstack-marvin pkg for Debian and CentOS8 - otherwise largely LGTM; I'll do another round of review. Pl also run test matrix smoketests.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan removed a comment on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan removed a comment on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-804735470






-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-828062994


   <b>Trillian test result (tid-544)</b>
   Environment: vmware-65u2 (x2), Advanced Networking with Mgmt server 7
   Total time taken: 38183 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t544-vmware-65u2.zip
   Intermittent failure detected: /marvin/tests/smoke/test_nic.py
   Intermittent failure detected: /marvin/tests/smoke/test_privategw_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_life_cycle.py
   Smoke tests completed. 86 look OK, 2 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   test_03_nic_multiple_vmware | `Error` | 74.17 | test_nic.py
   test_01_migrate_VM_and_root_volume | `Error` | 0.01 | test_vm_life_cycle.py
   test_02_migrate_VM_with_two_data_disks | `Error` | 0.01 | test_vm_life_cycle.py
   test_03_migrate_detached_volume | `Error` | 0.01 | test_vm_life_cycle.py
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan removed a comment on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan removed a comment on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-797490189


   Packaging result: :heavy_multiplication_x: centos7 :heavy_check_mark: centos8 :heavy_check_mark: debian. SL-JID 99


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan removed a comment on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan removed a comment on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-786514262






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] weizhouapache commented on a change in pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
weizhouapache commented on a change in pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#discussion_r596633192



##########
File path: debian/cloudstack-marvin.postinst
##########
@@ -19,5 +19,6 @@
 
 set -e
 
-pip install --upgrade http://cdn.mysql.com/Downloads/Connector-Python/mysql-connector-python-2.0.4.zip#md5=3df394d89300db95163f17c843ef49df
-pip install --upgrade /usr/share/cloudstack-marvin/Marvin-*.tar.gz
+python3 -m pip install --upgrade pip
+python3 -m pip install --upgrade http://cdn.mysql.com/Downloads/Connector-Python/mysql-connector-python-2.0.4.zip#md5=3df394d89300db95163f17c843ef49df

Review comment:
       @GabrielBrascher line 23 is not needed, as version 2.0.4 is too old.
   pip3 install latest mysql-connector-python 8.0.15 on ubuntu 20.04
   
   ```
   root@mgt01:~# pip3 list |grep mysql-connector-python
   mysql-connector-python 8.0.15
   ```




----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-788717656


   Packaging result: ✔centos7 ✔centos8 ✖debian. JID-2854


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] GabrielBrascher removed a comment on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
GabrielBrascher removed a comment on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-786616199


   @blueorangutan package


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-829726871


   <b>Trillian test result (tid-558)</b>
   Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
   Total time taken: 33349 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t558-kvm-centos7.zip
   Smoke tests completed. 88 look OK, 0 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-793255580


   <b>[S] Trillian test result (tid-57)</b>
   Environment: vmware-67u3 (x2), Advanced Networking with Mgmt server 7
   Total time taken: 43272 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t57-vmware-67u3.zip
   Intermittent failure detected: /marvin/tests/smoke/test_accounts.py
   Intermittent failure detected: /marvin/tests/smoke/test_deploy_vm_with_userdata.py
   Intermittent failure detected: /marvin/tests/smoke/test_diagnostics.py
   Intermittent failure detected: /marvin/tests/smoke/test_domain_vpc_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_internal_lb.py
   Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_clusters.py
   Intermittent failure detected: /marvin/tests/smoke/test_loadbalance.py
   Intermittent failure detected: /marvin/tests/smoke/test_migration.py
   Intermittent failure detected: /marvin/tests/smoke/test_nested_virtualization.py
   Intermittent failure detected: /marvin/tests/smoke/test_network_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_network.py
   Intermittent failure detected: /marvin/tests/smoke/test_nic.py
   Intermittent failure detected: /marvin/tests/smoke/test_password_server.py
   Intermittent failure detected: /marvin/tests/smoke/test_portforwardingrules.py
   Intermittent failure detected: /marvin/tests/smoke/test_privategw_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dhcphosts.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dns.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dnsservice.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_iptables_default_policy.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_network_ops.py
   Intermittent failure detected: /marvin/tests/smoke/test_scale_vm.py
   Intermittent failure detected: /marvin/tests/smoke/test_service_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_usage.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_life_cycle.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_snapshots.py
   Intermittent failure detected: /marvin/tests/smoke/test_volumes.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_router_nics.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_vpn.py
   Intermittent failure detected: /marvin/tests/smoke/test_hostha_kvm.py
   Smoke tests completed. 56 look OK, 30 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   test_DeleteDomain | `Error` | 244.35 | test_accounts.py
   test_DeleteDomain | `Error` | 244.37 | test_accounts.py
   test_forceDeleteDomain | `Failure` | 218.80 | test_accounts.py
   test_forceDeleteDomain | `Error` | 218.81 | test_accounts.py
   ContextSuite context=TestLoadBalance>:setup | `Error` | 0.00 | test_loadbalance.py
   test_01_native_to_native_network_migration | `Error` | 73.14 | test_migration.py
   test_02_native_to_native_vpc_migration | `Error` | 61.21 | test_migration.py
   test_network_acl | `Error` | 45.04 | test_network_acl.py
   test_delete_account | `Error` | 91.12 | test_network.py
   test_01_port_fwd_on_src_nat | `Error` | 2.16 | test_network.py
   test_02_port_fwd_on_non_src_nat | `Error` | 6.29 | test_network.py
   test_reboot_router | `Error` | 202.04 | test_network.py
   test_releaseIP | `Error` | 84.12 | test_network.py
   test_network_rules_acquired_public_ip_1_static_nat_rule | `Error` | 3.19 | test_network.py
   test_network_rules_acquired_public_ip_2_nat_rule | `Error` | 3.18 | test_network.py
   test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | `Error` | 3.20 | test_network.py
   test_deployvm_userdata | `Error` | 45.20 | test_deploy_vm_with_userdata.py
   test_deployvm_userdata_post | `Error` | 7.54 | test_deploy_vm_with_userdata.py
   test_01_ping_in_vr_success | `Failure` | 15.37 | test_diagnostics.py
   test_13_retrieve_vr_default_files | `Error` | 1.08 | test_diagnostics.py
   test_14_retrieve_vr_one_file | `Error` | 1.07 | test_diagnostics.py
   test_15_retrieve_ssvm_default_files | `Error` | 1.08 | test_diagnostics.py
   test_16_retrieve_ssvm_single_file | `Error` | 1.08 | test_diagnostics.py
   test_17_retrieve_cpvm_default_files | `Error` | 1.09 | test_diagnostics.py
   test_18_retrieve_cpvm_single_file | `Error` | 1.09 | test_diagnostics.py
   test_01_nic | `Error` | 956.60 | test_nic.py
   test_03_nic_multiple_vmware | `Error` | 74.25 | test_nic.py
   test_03_create_vpc_domain_vpc_offering | `Error` | 55.04 | test_domain_vpc_offerings.py
   test_isolate_network_password_server | `Error` | 2.15 | test_password_server.py
   test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 | `Failure` | 39.37 | test_internal_lb.py
   test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 | `Failure` | 41.45 | test_internal_lb.py
   test_03_vpc_internallb_haproxy_stats_on_all_interfaces | `Failure` | 43.25 | test_internal_lb.py
   test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | `Failure` | 43.34 | test_internal_lb.py
   test_01_vpc_privategw_acl | `Failure` | 41.41 | test_privategw_acl.py
   test_02_vpc_privategw_static_routes | `Failure` | 54.59 | test_privategw_acl.py
   test_03_vpc_privategw_restart_vpc_cleanup | `Failure` | 45.35 | test_privategw_acl.py
   test_04_rvpc_privategw_static_routes | `Failure` | 41.26 | test_privategw_acl.py
   test_01_deploy_kubernetes_cluster | `Failure` | 50.63 | test_kubernetes_clusters.py
   test_02_invalid_upgrade_kubernetes_cluster | `Failure` | 50.26 | test_kubernetes_clusters.py
   test_03_deploy_and_upgrade_kubernetes_cluster | `Failure` | 65.74 | test_kubernetes_clusters.py
   test_04_deploy_and_scale_kubernetes_cluster | `Failure` | 50.24 | test_kubernetes_clusters.py
   test_05_delete_kubernetes_cluster | `Failure` | 48.14 | test_kubernetes_clusters.py
   test_07_deploy_kubernetes_ha_cluster | `Failure` | 53.30 | test_kubernetes_clusters.py
   test_08_deploy_and_upgrade_kubernetes_ha_cluster | `Failure` | 52.32 | test_kubernetes_clusters.py
   test_09_delete_kubernetes_ha_cluster | `Failure` | 48.12 | test_kubernetes_clusters.py
   ContextSuite context=TestKubernetesCluster>:teardown | `Error` | 252.58 | test_kubernetes_clusters.py
   test_nested_virtualization_vmware | `Error` | 924.82 | test_nested_virtualization.py
   test_01_create_delete_portforwarding_fornonvpc | `Error` | 136.02 | test_portforwardingrules.py
   test_01_create_delete_portforwarding_fornonvpc | `Error` | 136.03 | test_portforwardingrules.py
   test_router_dhcphosts | `Error` | 2.11 | test_router_dhcphosts.py
   ContextSuite context=TestRouterDHCPHosts>:teardown | `Error` | 12.40 | test_router_dhcphosts.py
   test_router_dhcp_opts | `Error` | 2.18 | test_router_dhcphosts.py
   test_router_dns_guestipquery | `Error` | 2.13 | test_router_dns.py
   test_router_dns_guestipquery | `Error` | 2.17 | test_router_dnsservice.py
   test_01_single_VPC_iptables_policies | `Error` | 39.85 | test_routers_iptables_default_policy.py
   test_01_isolate_network_FW_PF_default_routes_egress_true | `Error` | 103.17 | test_routers_network_ops.py
   test_02_isolate_network_FW_PF_default_routes_egress_false | `Error` | 99.17 | test_routers_network_ops.py
   test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true | `Error` | 171.05 | test_routers_network_ops.py
   test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false | `Error` | 166.13 | test_routers_network_ops.py
   test_03_RVR_Network_check_router_state | `Failure` | 163.66 | test_routers_network_ops.py
   test_01_scale_vm | `Error` | 600.61 | test_scale_vm.py
   test_04_change_offering_small | `Failure` | 707.10 | test_service_offerings.py
   test_01_lb_usage | `Error` | 1.13 | test_usage.py
   test_01_nat_usage | `Error` | 3.12 | test_usage.py
   test_01_vpn_usage | `Error` | 5.34 | test_usage.py
   runTest | `Error` | 0.00 | test_vm_life_cycle.py
   runTest | `Error` | 0.00 | test_vm_life_cycle.py
   test_change_service_offering_for_vm_with_snapshots | `Failure` | 813.75 | test_vm_snapshots.py
   test_01_create_vm_snapshots | `Failure` | 600.70 | test_vm_snapshots.py
   test_02_revert_vm_snapshots | `Failure` | 600.67 | test_vm_snapshots.py
   test_03_delete_vm_snapshots | `Failure` | 0.01 | test_vm_snapshots.py
   test_01_create_volume | `Failure` | 606.94 | test_volumes.py
   test_02_attach_volume | `Failure` | 611.06 | test_volumes.py
   test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | `Error` | 56.73 | test_vpc_redundant.py
   test_02_redundant_VPC_default_routes | `Error` | 52.67 | test_vpc_redundant.py
   test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | `Error` | 39.28 | test_vpc_redundant.py
   test_04_rvpc_network_garbage_collector_nics | `Error` | 48.55 | test_vpc_redundant.py
   test_05_rvpc_multi_tiers | `Error` | 49.58 | test_vpc_redundant.py
   test_01_VPC_nics_after_destroy | `Error` | 41.30 | test_vpc_router_nics.py
   test_02_VPC_default_routes | `Error` | 42.40 | test_vpc_router_nics.py
   test_01_redundant_vpc_site2site_vpn | `Failure` | 42.09 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn_multiple_options | `Failure` | 45.02 | test_vpc_vpn.py
   test_01_vpc_remote_access_vpn | `Failure` | 53.11 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn | `Failure` | 40.99 | test_vpc_vpn.py
   runTest | `Error` | 0.00 | test_hostha_kvm.py
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] DaanHoogland closed pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
DaanHoogland closed pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-789315017


   <b>Trillian test result (tid-3635)</b>
   Environment: vmware-65u2 (x2), Advanced Networking with Mgmt server 7
   Total time taken: 52174 seconds
   Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4727-t3635-vmware-65u2.zip
   Intermittent failure detected: /marvin/tests/smoke/test_accounts.py
   Intermittent failure detected: /marvin/tests/smoke/test_deploy_vm_with_userdata.py
   Intermittent failure detected: /marvin/tests/smoke/test_diagnostics.py
   Intermittent failure detected: /marvin/tests/smoke/test_domain_vpc_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_internal_lb.py
   Intermittent failure detected: /marvin/tests/smoke/test_iso.py
   Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_clusters.py
   Intermittent failure detected: /marvin/tests/smoke/test_loadbalance.py
   Intermittent failure detected: /marvin/tests/smoke/test_migration.py
   Intermittent failure detected: /marvin/tests/smoke/test_nested_virtualization.py
   Intermittent failure detected: /marvin/tests/smoke/test_network_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_network.py
   Intermittent failure detected: /marvin/tests/smoke/test_nic.py
   Intermittent failure detected: /marvin/tests/smoke/test_password_server.py
   Intermittent failure detected: /marvin/tests/smoke/test_portforwardingrules.py
   Intermittent failure detected: /marvin/tests/smoke/test_privategw_acl.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dhcphosts.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dns.py
   Intermittent failure detected: /marvin/tests/smoke/test_router_dnsservice.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_iptables_default_policy.py
   Intermittent failure detected: /marvin/tests/smoke/test_routers_network_ops.py
   Intermittent failure detected: /marvin/tests/smoke/test_scale_vm.py
   Intermittent failure detected: /marvin/tests/smoke/test_service_offerings.py
   Intermittent failure detected: /marvin/tests/smoke/test_usage.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_life_cycle.py
   Intermittent failure detected: /marvin/tests/smoke/test_vm_snapshots.py
   Intermittent failure detected: /marvin/tests/smoke/test_volumes.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_router_nics.py
   Intermittent failure detected: /marvin/tests/smoke/test_vpc_vpn.py
   Smoke tests completed. 56 look OK, 30 have error(s)
   Only failed tests results shown below:
   
   
   Test | Result | Time (s) | Test File
   --- | --- | --- | ---
   test_DeleteDomain | `Error` | 224.49 | test_accounts.py
   test_DeleteDomain | `Error` | 224.49 | test_accounts.py
   test_forceDeleteDomain | `Failure` | 223.61 | test_accounts.py
   test_forceDeleteDomain | `Error` | 223.61 | test_accounts.py
   ContextSuite context=TestLoadBalance>:setup | `Error` | 0.00 | test_loadbalance.py
   test_01_native_to_native_network_migration | `Error` | 81.13 | test_migration.py
   test_02_native_to_native_vpc_migration | `Error` | 53.53 | test_migration.py
   test_network_acl | `Error` | 45.09 | test_network_acl.py
   test_delete_account | `Error` | 98.01 | test_network.py
   test_01_port_fwd_on_src_nat | `Error` | 2.12 | test_network.py
   test_02_port_fwd_on_non_src_nat | `Error` | 6.28 | test_network.py
   test_reboot_router | `Error` | 209.05 | test_network.py
   test_releaseIP | `Error` | 89.99 | test_network.py
   test_network_rules_acquired_public_ip_1_static_nat_rule | `Error` | 3.17 | test_network.py
   test_network_rules_acquired_public_ip_2_nat_rule | `Error` | 3.17 | test_network.py
   test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | `Error` | 3.18 | test_network.py
   test_deployvm_userdata | `Error` | 51.25 | test_deploy_vm_with_userdata.py
   test_deployvm_userdata_post | `Error` | 5.36 | test_deploy_vm_with_userdata.py
   test_13_retrieve_vr_default_files | `Error` | 1.07 | test_diagnostics.py
   test_14_retrieve_vr_one_file | `Error` | 1.09 | test_diagnostics.py
   test_15_retrieve_ssvm_default_files | `Error` | 1.08 | test_diagnostics.py
   test_16_retrieve_ssvm_single_file | `Error` | 1.08 | test_diagnostics.py
   test_17_retrieve_cpvm_default_files | `Error` | 1.07 | test_diagnostics.py
   test_18_retrieve_cpvm_single_file | `Error` | 1.07 | test_diagnostics.py
   test_01_nic | `Error` | 1090.23 | test_nic.py
   test_03_nic_multiple_vmware | `Error` | 74.04 | test_nic.py
   test_03_create_vpc_domain_vpc_offering | `Error` | 42.50 | test_domain_vpc_offerings.py
   test_isolate_network_password_server | `Error` | 2.12 | test_password_server.py
   test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 | `Failure` | 52.52 | test_internal_lb.py
   test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 | `Failure` | 47.38 | test_internal_lb.py
   test_03_vpc_internallb_haproxy_stats_on_all_interfaces | `Failure` | 47.27 | test_internal_lb.py
   test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | `Failure` | 42.16 | test_internal_lb.py
   test_01_vpc_privategw_acl | `Failure` | 33.06 | test_privategw_acl.py
   test_02_vpc_privategw_static_routes | `Failure` | 37.15 | test_privategw_acl.py
   test_03_vpc_privategw_restart_vpc_cleanup | `Failure` | 42.24 | test_privategw_acl.py
   test_04_rvpc_privategw_static_routes | `Failure` | 52.42 | test_privategw_acl.py
   test_04_extract_Iso | `Failure` | 128.30 | test_iso.py
   test_01_deploy_kubernetes_cluster | `Failure` | 55.48 | test_kubernetes_clusters.py
   test_02_invalid_upgrade_kubernetes_cluster | `Failure` | 50.21 | test_kubernetes_clusters.py
   test_03_deploy_and_upgrade_kubernetes_cluster | `Failure` | 56.27 | test_kubernetes_clusters.py
   test_04_deploy_and_scale_kubernetes_cluster | `Failure` | 52.17 | test_kubernetes_clusters.py
   test_05_delete_kubernetes_cluster | `Failure` | 51.17 | test_kubernetes_clusters.py
   test_07_deploy_kubernetes_ha_cluster | `Failure` | 56.23 | test_kubernetes_clusters.py
   test_08_deploy_and_upgrade_kubernetes_ha_cluster | `Failure` | 54.30 | test_kubernetes_clusters.py
   test_09_delete_kubernetes_ha_cluster | `Failure` | 54.18 | test_kubernetes_clusters.py
   ContextSuite context=TestKubernetesCluster>:teardown | `Error` | 270.44 | test_kubernetes_clusters.py
   test_nested_virtualization_vmware | `Error` | 1049.44 | test_nested_virtualization.py
   test_01_create_delete_portforwarding_fornonvpc | `Error` | 142.01 | test_portforwardingrules.py
   test_01_create_delete_portforwarding_fornonvpc | `Error` | 142.01 | test_portforwardingrules.py
   test_router_dhcphosts | `Error` | 2.14 | test_router_dhcphosts.py
   ContextSuite context=TestRouterDHCPHosts>:teardown | `Error` | 12.41 | test_router_dhcphosts.py
   test_router_dhcp_opts | `Error` | 2.14 | test_router_dhcphosts.py
   test_router_dns_guestipquery | `Error` | 2.11 | test_router_dns.py
   test_router_dns_guestipquery | `Error` | 2.11 | test_router_dnsservice.py
   test_01_single_VPC_iptables_policies | `Error` | 41.86 | test_routers_iptables_default_policy.py
   test_01_isolate_network_FW_PF_default_routes_egress_true | `Error` | 119.11 | test_routers_network_ops.py
   test_02_isolate_network_FW_PF_default_routes_egress_false | `Error` | 109.91 | test_routers_network_ops.py
   test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true | `Error` | 190.70 | test_routers_network_ops.py
   test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false | `Error` | 186.48 | test_routers_network_ops.py
   test_03_RVR_Network_check_router_state | `Failure` | 179.25 | test_routers_network_ops.py
   test_01_scale_vm | `Error` | 715.89 | test_scale_vm.py
   test_04_change_offering_small | `Failure` | 822.26 | test_service_offerings.py
   test_01_lb_usage | `Error` | 1.12 | test_usage.py
   test_01_nat_usage | `Error` | 3.11 | test_usage.py
   test_01_vpn_usage | `Error` | 4.26 | test_usage.py
   test_03_migrate_detached_volume | `Error` | 207.09 | test_vm_life_cycle.py
   ContextSuite context=TestVAppsVM>:setup | `Error` | 44.23 | test_vm_life_cycle.py
   test_10_attachAndDetach_iso | `Failure` | 721.86 | test_vm_life_cycle.py
   test_change_service_offering_for_vm_with_snapshots | `Failure` | 941.81 | test_vm_snapshots.py
   test_01_create_vm_snapshots | `Failure` | 715.69 | test_vm_snapshots.py
   test_02_revert_vm_snapshots | `Failure` | 720.18 | test_vm_snapshots.py
   test_03_delete_vm_snapshots | `Failure` | 0.02 | test_vm_snapshots.py
   test_01_create_volume | `Failure` | 719.82 | test_volumes.py
   test_02_attach_volume | `Failure` | 724.00 | test_volumes.py
   test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | `Error` | 48.33 | test_vpc_redundant.py
   test_02_redundant_VPC_default_routes | `Error` | 36.12 | test_vpc_redundant.py
   test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | `Error` | 53.49 | test_vpc_redundant.py
   test_04_rvpc_network_garbage_collector_nics | `Error` | 42.26 | test_vpc_redundant.py
   test_05_rvpc_multi_tiers | `Error` | 44.29 | test_vpc_redundant.py
   test_01_VPC_nics_after_destroy | `Error` | 33.11 | test_vpc_router_nics.py
   test_02_VPC_default_routes | `Error` | 39.27 | test_vpc_router_nics.py
   test_01_redundant_vpc_site2site_vpn | `Failure` | 42.01 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn_multiple_options | `Failure` | 39.94 | test_vpc_vpn.py
   test_01_vpc_remote_access_vpn | `Failure` | 31.69 | test_vpc_vpn.py
   test_01_vpc_site2site_vpn | `Failure` | 50.15 | test_vpc_vpn.py
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [cloudstack] blueorangutan commented on pull request #4727: Marvin3

Posted by GitBox <gi...@apache.org>.
blueorangutan commented on pull request #4727:
URL: https://github.com/apache/cloudstack/pull/4727#issuecomment-832126358


   @rhtyd I understand these words: "help", "hello", "thanks", "package", "test"
   Test command usage: test [mgmt os] [hypervisor] [keepEnv]
   Mgmt OS options: ['centos6', 'centos7', 'centos8', 'ubuntu18', 'ubuntu20']
   Hypervisor options: ['kvm-centos6', 'kvm-centos7', 'kvm-centos8', 'kvm-ubuntu18', 'kvm-ubuntu20', 'xenserver-71', 'xenserver-65sp1', 'vmware-70u1', 'vmware-67u3', 'vmware-65u2', 'vmware-60u2', 'vmware-55u3', 'xcpng76', 'xcpng80', 'xcpng81', 'xenserver-74', 'xcpng74']
   	Note: when keepEnv is passed, you need to specify mgmt server os and hypervisor or use the `matrix` command.
   
   Blessed contributors for kicking Trillian test jobs: ['rhtyd', 'nvazquez', 'PaulAngus', 'borisstoyanov', 'DaanHoogland', 'shwstppr', 'andrijapanicsb', 'Spaceman1984', 'Pearl1594', 'davidjumani', 'harikrishna-patnala', 'vladimirpetrov', 'sureshanaparti', 'weizhouapache']


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org