You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cloudstack.apache.org by GitBox <gi...@apache.org> on 2022/11/07 15:15:00 UTC
[GitHub] [cloudstack] andrijapanicsb opened a new issue, #6873: VPC VR can't be started on VMware due to missing routes
andrijapanicsb opened a new issue, #6873:
URL: https://github.com/apache/cloudstack/issues/6873
##### ISSUE TYPE
<!-- Pick one below and delete the rest -->
* Bug Report
* Improvement Request
* Enhancement Request
* Feature Idea
* Documentation Report
* Other
##### COMPONENT NAME
<!--
VR agent ?
-->
~~~
~~~
##### CLOUDSTACK VERSION
<!--
New line separated list of affected versions, commit ID for issues on main branch.
-->
~~~
4.17.0.0+
~~~
##### CONFIGURATION
<!--
Information about the configuration if relevant, e.g. basic network, advanced networking, etc. N/A otherwise
-->
mgmt server is in Pod1/subnet1, hypervisor (and thus VR's control NIC) is in Pod2/subnet2 - thus there is routing process between mgmt and VR's NIC IP
##### OS / ENVIRONMENT
<!--
Information about the environment if relevant, N/A otherwise
-->
Probably affects only VMware, but has not been tested with XS/KVM (should not be a problem, but needs checking)
##### SUMMARY
<!-- Explain the problem/feature briefly -->
Only VPC VR affected (VR for shared or simpler Isolated network is NOT affected).
There is a patching error of the VPC VR (this might be a problem or a consequence of missing routes) - either way, route from VR to the subnet of the mgmt server (subnet1) is missing/not configured, and thus VR can't talk to the mgmt server - VR configuration never completes. CMDLINE looks fine (all parameters look fine) but things are not applied correctly on the OS level.
##### STEPS TO REPRODUCE
<!--
For bugs, show exactly how to reproduce the problem, using a minimal test-case. Use Screenshots if accurate.
For new features, show how the feature would be used.
-->
<!-- Paste example playbooks or commands between quotes below -->
~~~
mgmt server in subnet1, hypervisor (and thus VR's control NIC) in subnet2 - so that VR needs to send packet to the Pod2's gateway in order to reach Pod1/mgmt server.
~~~
<!-- You can also paste gist.github.com links for larger files -->
##### EXPECTED RESULTS
<!-- What did you expect to happen when running the steps above? -->
~~~
VR patches up and operational
~~~
##### ACTUAL RESULTS
<!-- What actually happened? -->
<!-- Paste verbatim command output between quotes below -->
~~~
VR not patches, routes not present as needed.
~~~
CMD line of the VPC VR:
cloud.log
Routing table empty (there should be multiple routes (route to the mgmt cidr should be via 10.1.32.1 for 10.1.32.0 network - see CMDLINE output)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] weizhouapache commented on issue #6873: VPC VR can't be started on VMware due to missing routes
Posted by GitBox <gi...@apache.org>.
weizhouapache commented on issue #6873:
URL: https://github.com/apache/cloudstack/issues/6873#issuecomment-1319598073
>
That is strange. Can you test it again ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] weizhouapache commented on issue #6873: VPC VR can't be started on VMware due to missing routes
Posted by GitBox <gi...@apache.org>.
weizhouapache commented on issue #6873:
URL: https://github.com/apache/cloudstack/issues/6873#issuecomment-1306756275
> A critical export was moved from bootstrap.sh to init.sh
>
> When the VPC is setup it asked in Line 64 for the hypvervisor
>
> https://github.com/apache/cloudstack/blob/296035d9a57caa62260a666da726ec45b6801c4b/systemvm/debian/opt/cloud/bin/setup/vpcrouter.sh#L64
>
>
> The vpcrouter.sh gets called by the bootstrap.sh. In Version <= 4.16 it gets exported there and is available for vpcrouter.sh
> https://github.com/apache/cloudstack/blob/77df050160d6a5343aab97571bf891e51b4b1201/systemvm/debian/opt/cloud/bin/setup/bootstrap.sh#L215
>
> The comit [830f306](https://github.com/apache/cloudstack/commit/830f3061bcc33c0d3a22d9129e8bcf6a8ead37da) removes the export in the bootstrap.sh and adds it to init.sh
@H-LK
thanks for the findings.
prior to 4.17, the route is added in vpcrouter.sh which is called by cloud-early-config service.
since 4.17, two steps are added before cloud-early-config
- init.sh (called by cloud-preinit service)
- patch (transfer new files/scripts from host or management server to VRs via `scp` command)
The `scp` in `patch` step does not work, because the route is not added (`cloud-early-config` is not executed yet).
The route should be added in `init.sh`, instead of `vpcrouter.sh`
-
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] weizhouapache commented on issue #6873: VPC VR can't be started on VMware due to missing routes
Posted by GitBox <gi...@apache.org>.
weizhouapache commented on issue #6873:
URL: https://github.com/apache/cloudstack/issues/6873#issuecomment-1305858833
it looks the route for mgmt cidr (10.0.32.0/20) is missing.
the problem is, where can we find the gateway of mgmt cidr (e.g. 10.0.32.1) ? cannot find it in cmdline.
xenserver/kvm should not be impacted, as they use link local ip.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] weizhouapache commented on issue #6873: VPC VR can't be started on VMware due to missing routes
Posted by GitBox <gi...@apache.org>.
weizhouapache commented on issue #6873:
URL: https://github.com/apache/cloudstack/issues/6873#issuecomment-1322625181
> We tested all with a fresh installation. By the way, using mysql 8, we must disable mysql's validate_password :
>
> ```sql
> set global validate_password.policy=0;
> set global validate_password.length=1;
> ```
>
> otherwise cloudstack-setup-database printed error : We apologize for below error:
>
> ```
> cloudstack-setup-database cloud:xxxxxx@127.0.0.1 --deploy-as=root:xxxxxx
> ***************************************************************
> Encountering an error when executing mysql script
> ----------------------------------------------------------------------
> table:
> /usr/share/cloudstack-management/setup/create-database.sql
>
> Error:
> b"mysql: [Warning] Using a password on the command line interface can be insecure.\nERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES)\n"
>
> Sql parameters:
> {'user': 'root', 'passwd': 'xxxxxx', 'port': 3306, 'host': '127.0.0.1'}
> ----------------------------------------------------------------------
>
> ***************************************************************
> Please run:
>
> cloudstack-setup-databases -h
>
> for full help
> ```
@hooklee2000
can you file a new github issue for this ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] H-LK commented on issue #6873: VPC VR can't be started on VMware due to missing routes
Posted by GitBox <gi...@apache.org>.
H-LK commented on issue #6873:
URL: https://github.com/apache/cloudstack/issues/6873#issuecomment-1306343488
A critical export was moved from bootstrap.sh to init.sh
When the VPC is setup it asked in Line 64 for the hypvervisor
https://github.com/apache/cloudstack/blob/296035d9a57caa62260a666da726ec45b6801c4b/systemvm/debian/opt/cloud/bin/setup/vpcrouter.sh#L64
The vpcrouter.sh gets called by the bootstrap.sh. In Version <= 4.16 it gets exported there and is available for vpcrouter.sh https://github.com/apache/cloudstack/blob/77df050160d6a5343aab97571bf891e51b4b1201/systemvm/debian/opt/cloud/bin/setup/bootstrap.sh#L215
The comit https://github.com/apache/cloudstack/commit/830f3061bcc33c0d3a22d9129e8bcf6a8ead37da removes the export in the bootstrap.sh and adds it to init.sh
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] hooklee2000 commented on issue #6873: VPC VR can't be started on VMware due to missing routes
Posted by GitBox <gi...@apache.org>.
hooklee2000 commented on issue #6873:
URL: https://github.com/apache/cloudstack/issues/6873#issuecomment-1319459258
We tested current [4.18-vm-autoscaling](https://github.com/apache/cloudstack/tree/4.18-vm-autoscaling) branch 4.18.0.0-SNAPSHOT yesteday, we found VR vm disappear in ui.
Using ssh connect the VR vm under agent host, it has console proxy java process, so act as CPVM wrongly.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] rohityadavcloud closed issue #6873: VPC VR can't be started on VMware due to missing routes
Posted by GitBox <gi...@apache.org>.
rohityadavcloud closed issue #6873: VPC VR can't be started on VMware due to missing routes
URL: https://github.com/apache/cloudstack/issues/6873
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] hooklee2000 commented on issue #6873: VPC VR can't be started on VMware due to missing routes
Posted by GitBox <gi...@apache.org>.
hooklee2000 commented on issue #6873:
URL: https://github.com/apache/cloudstack/issues/6873#issuecomment-1320020787
I tested all with a fresh installation.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] rohityadavcloud commented on issue #6873: VPC VR can't be started on VMware due to missing routes
Posted by GitBox <gi...@apache.org>.
rohityadavcloud commented on issue #6873:
URL: https://github.com/apache/cloudstack/issues/6873#issuecomment-1346368959
Fixed in https://github.com/apache/cloudstack/pull/6921
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] hooklee2000 commented on issue #6873: VPC VR can't be started on VMware due to missing routes
Posted by GitBox <gi...@apache.org>.
hooklee2000 commented on issue #6873:
URL: https://github.com/apache/cloudstack/issues/6873#issuecomment-1319672999
we also tested main branch pulled on 2022-11-17, it had the same problem. How ever, Using virsh list it had not vrvm, it only had cpvm and ssvm.
4.18-vm-autoscaling had vrvm,but vrvm had cpvm java process.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] hooklee2000 commented on issue #6873: VPC VR can't be started on VMware due to missing routes
Posted by GitBox <gi...@apache.org>.
hooklee2000 commented on issue #6873:
URL: https://github.com/apache/cloudstack/issues/6873#issuecomment-1319619289
system vm
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] weizhouapache commented on issue #6873: VPC VR can't be started on VMware due to missing routes
Posted by GitBox <gi...@apache.org>.
weizhouapache commented on issue #6873:
URL: https://github.com/apache/cloudstack/issues/6873#issuecomment-1319847208
> we also tested main branch pulled on 2022-11-17, it had the same problem. How ever, Using virsh list it had not vrvm, it only had cpvm and ssvm. 4.18-vm-autoscaling had vrvm,but vrvm had cpvm java process.
@hooklee2000 did you test with a fresh installation or upgrade existing environment ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] hooklee2000 commented on issue #6873: VPC VR can't be started on VMware due to missing routes
Posted by GitBox <gi...@apache.org>.
hooklee2000 commented on issue #6873:
URL: https://github.com/apache/cloudstack/issues/6873#issuecomment-1322907198
#6915
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org