You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cloudstack.apache.org by "GuilhermeGreggio (via GitHub)" <gi...@apache.org> on 2025/05/30 20:08:54 UTC
[I] Slow connection to Console Proxy after enable HTTPS [cloudstack]
GuilhermeGreggio opened a new issue, #10936:
URL: https://github.com/apache/cloudstack/issues/10936
### problem
Open a new tab of console proxy takes about 40-50s with SSL enabled, with HTTP it's almost instantly.
I tested with management server firewall disabled and since they are both on the same network they ping each other with 0.2ms.
I deleted console proxy so that it could be recreated, but the issue persisted.
Logs from the management server when I click to open a console from a VM:
``` bash
tail -f /var/log/cloudstack/management/management-server.log | grep ConsoleProxy
2025-05-30 17:04:11,040 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:[ctx-38b9725b]) (logid:60e44c48) Enabled non-edge zones available for scan: 1
2025-05-30 17:04:11,046 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:[ctx-38b9725b]) (logid:60e44c48) Zone 1 is ready to launch console proxy
2025-05-30 17:04:18,042 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (AgentManager-Handler-10:[]) (logid:) SeqA 8-778: Seq 8-778: { Cmd , MgmtId: -1, via: 8, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":"2255","_loadInfo":"{
2025-05-30 17:04:23,805 DEBUG [c.c.c.ConsoleProxyManagerImpl] (qtp1390913202-25:[ctx-d80d2c55, ctx-aea978f0]) (logid:d91f4b2b) Assign previous allocated console proxy for user vm : 2255
2025-05-30 17:04:23,930 DEBUG [c.c.c.ConsoleProxyManagerImpl] (qtp1390913202-25:[ctx-d80d2c55, ctx-aea978f0]) (logid:d91f4b2b) Assign previous allocated console proxy for user vm : 2255
2025-05-30 17:04:23,978 DEBUG [c.c.c.ConsoleProxyManagerImpl] (qtp1390913202-25:[ctx-d80d2c55, ctx-aea978f0]) (logid:d91f4b2b) Assign previous allocated console proxy for user vm : 2255
2025-05-30 17:04:28,045 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (AgentManager-Handler-14:[]) (logid:) SeqA 8-780: Seq 8-780: { Cmd , MgmtId: -1, via: 8, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":"2255","_loadInfo":"{
2025-05-30 17:04:38,046 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (AgentManager-Handler-1:[]) (logid:) SeqA 8-781: Seq 8-781: { Cmd , MgmtId: -1, via: 8, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":"2255","_loadInfo":"{
2025-05-30 17:04:41,040 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:[ctx-c6189beb]) (logid:f568f7bd) Enabled non-edge zones available for scan: 1
2025-05-30 17:04:41,046 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:[ctx-c6189beb]) (logid:f568f7bd) Zone 1 is ready to launch console proxy
2025-05-30 17:04:48,045 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (AgentManager-Handler-2:[]) (logid:) SeqA 8-782: Seq 8-782: { Cmd , MgmtId: -1, via: 8, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":"2255","_loadInfo":"{
2025-05-30 17:04:52,291 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (AgentManager-Handler-3:[]) (logid:) SeqA 8-783: Seq 8-783: { Cmd , MgmtId: -1, via: 8, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":"2255","_loadInfo":"{
^C
```
### versions
CloudStack v. 4.20.0.0
CPVM v. 4.20.0.0
VMware ESXi v. 7.0.3, 20842708
### The steps to reproduce the bug
1. Install ACS MGS;
2. Configure first zone integrated to vCenter;
3. Import or create a VM;
4. Try to open the VM console.
### What to do about it?
_No response_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Slow connection to Console Proxy after enable HTTPS [cloudstack]
Posted by "GuilhermeGreggio (via GitHub)" <gi...@apache.org>.
GuilhermeGreggio commented on issue #10936:
URL: https://github.com/apache/cloudstack/issues/10936#issuecomment-2944888301
Hi @weizhouapache
Sorry for the delay.
I was doing some test, unfortunately, nothing works. Here's what I testes:
- Search the logs for errors;
- Disable the firewall;
- Apply the certificate chain with root and intermediaries instead of the ca-bundle;
- Pre-install the certificate chain on my computer;
- Test with a certificate from another CA;
- Use a different browser and a different network;
Here's the entire log from moments before I clicked to open a console until it actually opened:
[log_console_oppening.log](https://github.com/user-attachments/files/20613109/log_console_oppening.log)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Slow connection to Console Proxy after enable HTTPS [cloudstack]
Posted by "weizhouapache (via GitHub)" <gi...@apache.org>.
weizhouapache commented on issue #10936:
URL: https://github.com/apache/cloudstack/issues/10936#issuecomment-2933715206
@GuilhermeGreggio
can you open the console of a vm, and share the full log ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Slow connection to Console Proxy after enable HTTPS [cloudstack]
Posted by "GuilhermeGreggio (via GitHub)" <gi...@apache.org>.
GuilhermeGreggio commented on issue #10936:
URL: https://github.com/apache/cloudstack/issues/10936#issuecomment-2945686912
Hi guys
The problem was on my network.
Our CPVM is under a Fortigate firewall, which was allowing outbound traffic to the CPVM's public IP, but I noticed that the CPVM was connecting to the DNS server using its private IP, which was not allowed on our Fortigate. After we released the traffic, the problem was solved.
Appreciate the help of @DaanHoogland @weizhouapache
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Slow connection to Console Proxy after enable HTTPS [cloudstack]
Posted by "DaanHoogland (via GitHub)" <gi...@apache.org>.
DaanHoogland commented on issue #10936:
URL: https://github.com/apache/cloudstack/issues/10936#issuecomment-2925135034
seems related to #10650. (cc @weizhouapache .. ?)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Slow connection to Console Proxy after enable HTTPS [cloudstack]
Posted by "GuilhermeGreggio (via GitHub)" <gi...@apache.org>.
GuilhermeGreggio commented on issue #10936:
URL: https://github.com/apache/cloudstack/issues/10936#issuecomment-2945548086
> > Hi [@weizhouapache](https://github.com/weizhouapache)
> > Sorry for the delay.
> > I was doing some test, unfortunately, nothing works. Here's what I tested:
> >
> > * Searched for errors in logs;
> > * Disable the firewall;
> > * Apply the certificate chain with root and intermediaries instead of the ca-bundle;
> > * Pre-install the certificate chain on my computer;
> > * Test with a certificate from another CA;
> > * Use a different browser and a different network;
> >
> > Here's the entire log from moments before I clicked to open a console until it actually opened:
> > [log_console_oppening.log](https://github.com/user-attachments/files/20613109/log_console_oppening.log)
>
> from the log, it looks like the management server creates the console endpoint very quickly. The issue happened between the console proxy VM and the ESXi host
>
> can you retry and share some logs with the following changes inside the CPVM ?
>
> ```
> sed -i "s/INFO/DEBUG/g" /usr/local/cloud/systemvm/conf/log4j-cloud.xml
> systemctl restart cloud
> tail -f /var/log/cloud.log
> ```
As requested, here's the log @weizhouapache
[log_cpvm.log](https://github.com/user-attachments/files/20615815/log_cpvm.log)
Thanks for the help!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Slow connection to Console Proxy after enable HTTPS [cloudstack]
Posted by "weizhouapache (via GitHub)" <gi...@apache.org>.
weizhouapache commented on issue #10936:
URL: https://github.com/apache/cloudstack/issues/10936#issuecomment-2945796289
> Hi guys
>
> The problem was on my network.
>
> Our CPVM is under a Fortigate firewall, which was allowing outbound traffic to the CPVM's public IP, but I noticed that the CPVM was connecting to the DNS server using its private IP, which was not allowed on our Fortigate. After we released the traffic, the problem was solved.
>
> Appreciate the help of [@DaanHoogland](https://github.com/DaanHoogland) [@weizhouapache](https://github.com/weizhouapache)
great, thanks for the update and detailed information
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Slow connection to Console Proxy after enable HTTPS [cloudstack]
Posted by "GuilhermeGreggio (via GitHub)" <gi...@apache.org>.
GuilhermeGreggio commented on issue #10936:
URL: https://github.com/apache/cloudstack/issues/10936#issuecomment-2931536983
Hi @DaanHoogland
I read the problem you mentioned, however, I don't know if it's related, because it's mentioning a problem with console sessions with GUI and I'm having this problem even with Linux Servers only with CLI.
The only issue that seems related that I found is #5134
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Slow connection to Console Proxy after enable HTTPS [cloudstack]
Posted by "weizhouapache (via GitHub)" <gi...@apache.org>.
weizhouapache commented on issue #10936:
URL: https://github.com/apache/cloudstack/issues/10936#issuecomment-2945320993
> Hi [@weizhouapache](https://github.com/weizhouapache)
>
> Sorry for the delay.
>
> I was doing some test, unfortunately, nothing works. Here's what I tested:
>
> * Searched for errors in logs;
> * Disable the firewall;
> * Apply the certificate chain with root and intermediaries instead of the ca-bundle;
> * Pre-install the certificate chain on my computer;
> * Test with a certificate from another CA;
> * Use a different browser and a different network;
>
> Here's the entire log from moments before I clicked to open a console until it actually opened:
>
> [log_console_oppening.log](https://github.com/user-attachments/files/20613109/log_console_oppening.log)
from the log, it looks like the management server creates the console endpoint very quickly.
The issue happened between the console proxy VM and the ESXi host
can you retry and share some logs with the following changes inside the CPVM ?
```
sed -i "s/INFO/DEBUG/g" /usr/local/cloud/systemvm/conf/log4j-cloud.xml
systemctl restart cloud
tail -f /var/log/cloud.log
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Slow connection to Console Proxy after enable HTTPS [cloudstack]
Posted by "GuilhermeGreggio (via GitHub)" <gi...@apache.org>.
GuilhermeGreggio closed issue #10936: Slow connection to Console Proxy after enable HTTPS
URL: https://github.com/apache/cloudstack/issues/10936
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org