You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cloudstack.apache.org by "Noelantogerorge (via GitHub)" <gi...@apache.org> on 2023/04/13 13:30:44 UTC
[GitHub] [cloudstack] Noelantogerorge opened a new issue, #7431: Kubernetes external ip for a loadbalancer service is in peding state
Noelantogerorge opened a new issue, #7431:
URL: https://github.com/apache/cloudstack/issues/7431
<!--
Verify first that your issue/request is not already reported on GitHub.
Also test if the latest release and main branch are affected too.
Always add information AFTER of these HTML comments, but no need to delete the comments.
-->
##### ISSUE TYPE
<!-- Pick one below and delete the rest -->
* Bug Report
* Other
##### COMPONENT NAME
<!--
Categorize the issue, e.g. API, VR, VPN, UI, etc.
-->
Kubernetes
##### CLOUDSTACK VERSION
<!--
New line separated list of affected versions, commit ID for issues on main branch.
-->
4.18
##### CONFIGURATION
<!--
Information about the configuration if relevant, e.g. basic network, advanced networking, etc. N/A otherwise
-->
Advance Networking
##### OS / ENVIRONMENT
<!--
Information about the environment if relevant, N/A otherwise
-->
Ubuntu 22.04
##### SUMMARY
<!-- Explain the problem/feature briefly -->
Created a kubernetes cluster with shared network. Service as loadbalancer is not fetching external IP. External IP shows as pending. Also there is no event when I try to describe the service
##### STEPS TO REPRODUCE
<!--
For bugs, show exactly how to reproduce the problem, using a minimal test-case. Use Screenshots if accurate.
For new features, show how the feature would be used.
-->
<!-- Paste example playbooks or commands between quotes below -->
~~~
~~~
<!-- You can also paste gist.github.com links for larger files -->
##### EXPECTED RESULTS
<!-- What did you expect to happen when running the steps above? -->
~~~
~~~
##### ACTUAL RESULTS
<!-- What actually happened? -->
<!-- Paste verbatim command output between quotes below -->
~~~
~~~
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] Noelantogerorge commented on issue #7431: Kubernetes external ip for a loadbalancer service is in peding state
Posted by "Noelantogerorge (via GitHub)" <gi...@apache.org>.
Noelantogerorge commented on issue #7431:
URL: https://github.com/apache/cloudstack/issues/7431#issuecomment-1531324120
@weizhouapache
Ya, When ever I create a cluster there is no metric API available with it. With metric API we could get the pod and node utilization also it helps to deploy horizontal scaling of pods. I could get it by manually installing metric API's and doing some changes to make it available. But if a normal user spins up a kubernetes cluster it dosen't have these API so they will also have to install manually.
Hope you understand the requirement..
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] weizhouapache commented on issue #7431: Kubernetes external ip for a loadbalancer service is in peding state
Posted by "weizhouapache (via GitHub)" <gi...@apache.org>.
weizhouapache commented on issue #7431:
URL: https://github.com/apache/cloudstack/issues/7431#issuecomment-1517329967
> @Noelantogerorge cc @davidjumani it seems cloudstack-kubernetes-provider is not deployed for a shared network which must be causing this issue. https://github.com/apache/cloudstack/blob/main/plugins/integrations/kubernetes-service/src/main/java/com/cloud/kubernetes/cluster/actionworkers/KubernetesClusterActionWorker.java#L565-L569 Let me check if that can be changed
ccm should have been deployed, the error happened when deploy a service with LoadBalancer. But LB is not supported in shared network so it failed when ccm tried to acquire a public ip.
@Noelantogerorge
Can you log into the control plane vm and get more information? For example,
sudo kubectl get services
sudo kunectl describe service <service name>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] weizhouapache commented on issue #7431: Kubernetes external ip for a loadbalancer service is in peding state
Posted by "weizhouapache (via GitHub)" <gi...@apache.org>.
weizhouapache commented on issue #7431:
URL: https://github.com/apache/cloudstack/issues/7431#issuecomment-1518177870
> @weizhouapache I tried with the changed code to allow deploying provider for shared network. After that though it tries to list/create loadbalancer but fails with the API call,
>
> ```
> ⇒ ./kubectl --kubeconfig ./kube.conf describe svc nginx-deployment
> Name: nginx-deployment
> Namespace: default
> Labels: app=nginx
> Annotations: <none>
> Selector: app=nginx
> Type: LoadBalancer
> IP Family Policy: SingleStack
> IP Families: IPv4
> IP: 10.104.19.159
> IPs: 10.104.19.159
> Port: <unset> 80/TCP
> TargetPort: 80/TCP
> NodePort: <unset> 30495/TCP
> Endpoints:
> Session Affinity: None
> External Traffic Policy: Cluster
> Events:
> Type Reason Age From Message
> ---- ------ ---- ---- -------
> Normal EnsuringLoadBalancer 2m40s (x11 over 32m) service-controller Ensuring load balancer
> Warning SyncLoadBalancerFailed 2m10s (x11 over 32m) service-controller Error syncing load balancer: failed to ensure load balancer: error retrieving load balancer rules: Get http://10.0.34.201:8080/client/api?apiKey=KrMLbhjYaLWLqnPISgpqo-2XRXKx0MFuJwfcaf2kGuTVaaoTRYmlyQRTy_VuVBn5zXP2Pkb5cCnZxmYu80ycKw&command=listLoadBalancerRules&keyword=a2508be6b99c0462f9bdc09ba0ab46ac&listall=true&response=json&signature=5y5T5QbgcR9jhjHf5raodd%2F3FsA%3D: dial tcp 10.0.34.201:8080: i/o timeout
> ```
@shwstppr it looks like expected behaviour to me.
cc @davidjumani
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] weizhouapache commented on issue #7431: Kubernetes external ip for a loadbalancer service is in peding state
Posted by "weizhouapache (via GitHub)" <gi...@apache.org>.
weizhouapache commented on issue #7431:
URL: https://github.com/apache/cloudstack/issues/7431#issuecomment-1519697155
@Noelantogerorge
I assume only the app service is created with type=LoadBalancer.
> Hi, We are trying to deploy media server and its app server on kubernetes. Media server works in host network mode. So basically there are lot of ports used by media server these ports works through host server network. If it behind any nat then it won't work.
If media servers are on an isolated network, you can use static nat or create port forwarding rule with a port range.
The app server can access the media servers via <public IP>:<public port>
> I have the deployment yml file which works in cloud like AWS,Digital ocean. If needed I can share the yml file.
@Noelantogerorge
can you share the yaml file and network/ip information of nodes/pods on one of the cloud provider ?
> On cloudstack we can create a isolated or vpc network for kubernetes cluster and LB works perfectly. But as I mentioned if we deploy my pod it works on host network and it get some isolated lan cidr. We need that to be public IP. So I created a shared network with public IP and start the cluster and unfortunately LB fails
@Noelantogerorge
yes, as we have discussed, LB is not supported in cloudstack shared networks.
If the media servers and app servers must be in same kubernetes cluster, it will not work due to the LB failure.
> I tried adding a shared network to another NIC and see how it works but that crash down the cluster. Is there any way how we can make nodes to have public IP rather than isolated or vpc lan cidr.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] Noelantogerorge commented on issue #7431: Kubernetes external ip for a loadbalancer service is in peding state
Posted by "Noelantogerorge (via GitHub)" <gi...@apache.org>.
Noelantogerorge commented on issue #7431:
URL: https://github.com/apache/cloudstack/issues/7431#issuecomment-1508006322
Hi @kiranchavala Thanks for the update...
I had created a custome networkoffering for shared network and enable all supported service like defaultnetworkofferingforKubernetesService. So my custome networoffering is same as Kubernetes network offering. But still external ip is in pending state.
I tried with isolated network and it works fine. Issue with shared network.
We need some port to run on hostnetwork state so worker node NIC will be utilized. In that case we required to have a public IP so shared network is required.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] weizhouapache commented on issue #7431: Kubernetes external ip for a loadbalancer service is in peding state
Posted by "weizhouapache (via GitHub)" <gi...@apache.org>.
weizhouapache commented on issue #7431:
URL: https://github.com/apache/cloudstack/issues/7431#issuecomment-1522331941
got it @Noelantogerorge
Cannot you create load balancer rules for media servers with host network mode ?
if not, can you share some kubernetes logs ? (e.g. kubectl describe svc <svc name>)
the load balancer for app servers should work, I think.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] Noelantogerorge commented on issue #7431: Kubernetes external ip for a loadbalancer service is in peding state
Posted by "Noelantogerorge (via GitHub)" <gi...@apache.org>.
Noelantogerorge commented on issue #7431:
URL: https://github.com/apache/cloudstack/issues/7431#issuecomment-1518201451
@weizhouapache <https://github.com/weizhouapache>
My environment is like I need kubnertes cluster to have public IP. So that
when I deploy pod as host network node IP should be public network and I
need all traffic to route to node network namespace.
So I create a shared network with public IP and observer that load balancer
won't able to provide any external IP address
If this is a normal behaviour then how can we deploy kubernetes in
hostnetwork mode
Same scenario works in coud environment like AWS, AZURE, Digital Ocean etc
On Fri, Apr 21, 2023, 11:41 PM Wei Zhou ***@***.***> wrote:
> @weizhouapache <https://github.com/weizhouapache> I tried with the
> changed code to allow deploying provider for shared network. After that
> though it tries to list/create loadbalancer but fails with the API call,
>
> ⇒ ./kubectl --kubeconfig ./kube.conf describe svc nginx-deployment
> Name: nginx-deployment
> Namespace: default
> Labels: app=nginx
> Annotations: <none>
> Selector: app=nginx
> Type: LoadBalancer
> IP Family Policy: SingleStack
> IP Families: IPv4
> IP: 10.104.19.159
> IPs: 10.104.19.159
> Port: <unset> 80/TCP
> TargetPort: 80/TCP
> NodePort: <unset> 30495/TCP
> Endpoints:
> Session Affinity: None
> External Traffic Policy: Cluster
> Events:
> Type Reason Age From Message
> ---- ------ ---- ---- -------
> Normal EnsuringLoadBalancer 2m40s (x11 over 32m) service-controller Ensuring load balancer
> Warning SyncLoadBalancerFailed 2m10s (x11 over 32m) service-controller Error syncing load balancer: failed to ensure load balancer: error retrieving load balancer rules: Get http://10.0.34.201:8080/client/api?apiKey=KrMLbhjYaLWLqnPISgpqo-2XRXKx0MFuJwfcaf2kGuTVaaoTRYmlyQRTy_VuVBn5zXP2Pkb5cCnZxmYu80ycKw&command=listLoadBalancerRules&keyword=a2508be6b99c0462f9bdc09ba0ab46ac&listall=true&response=json&signature=5y5T5QbgcR9jhjHf5raodd%2F3FsA%3D: dial tcp 10.0.34.201:8080: i/o timeout
>
> @shwstppr <https://github.com/shwstppr> it looks like expected behaviour
> to me.
> cc @davidjumani <https://github.com/davidjumani>
>
> —
> Reply to this email directly, view it on GitHub
> <https://github.com/apache/cloudstack/issues/7431#issuecomment-1518177870>,
> or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/A6FZLRE6XMZRWLIA2MAQ433XCLEVJANCNFSM6AAAAAAW5C4UAM>
> .
> You are receiving this because you were mentioned.Message ID:
> ***@***.***>
>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] Noelantogerorge commented on issue #7431: Kubernetes external ip for a loadbalancer service is in peding state
Posted by "Noelantogerorge (via GitHub)" <gi...@apache.org>.
Noelantogerorge commented on issue #7431:
URL: https://github.com/apache/cloudstack/issues/7431#issuecomment-1531192722
@weizhouapache
Is it possible for you to add metric api to kubernetes cluster..
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] kiranchavala commented on issue #7431: Kubernetes external ip for a loadbalancer service is in peding state
Posted by "kiranchavala (via GitHub)" <gi...@apache.org>.
kiranchavala commented on issue #7431:
URL: https://github.com/apache/cloudstack/issues/7431#issuecomment-1507996354
Hi @Noelantogerorge
what is the network offering you have used for the shared network?
By default, there is no LB service for the shared network offering (DefaultSharedNetworkOffering)
If you look at the network offering DefaultNetworkOfferingforKubernetesService, there is LB service
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] Noelantogerorge commented on issue #7431: Kubernetes external ip for a loadbalancer service is in peding state
Posted by "Noelantogerorge (via GitHub)" <gi...@apache.org>.
Noelantogerorge commented on issue #7431:
URL: https://github.com/apache/cloudstack/issues/7431#issuecomment-1522160003
@weizhouapache
I assume only the app service is created with type=LoadBalancer.
No both media server and app server should be on loadbalancer
If media servers are on an isolated network, you can use static nat or create port forwarding rule with a port range.
The app server can access the media servers via publicIP:publicPort
No prot forwarding and NAT won't work for media server. It should be in host network namespace
can you share the yaml file and network/ip information of nodes/pods on one of the cloud provider ?
I will share you my yml files
yes, as we have discussed, LB is not supported in cloudstack shared networks.
If the media servers and app servers must be in same kubernetes cluster, it will not work due to the LB failure.
So cloudstack is not designed in such a way that kubernetes cluster node can get public IP. In AWS,Digital Ocean I had deployed this and it is working perfectly. Also I had deployed on a baremetal server using kubernetes and other service like metal LB etc.. Is there any other way or work around?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] Noelantogerorge commented on issue #7431: Kubernetes external ip for a loadbalancer service is in peding state
Posted by "Noelantogerorge (via GitHub)" <gi...@apache.org>.
Noelantogerorge commented on issue #7431:
URL: https://github.com/apache/cloudstack/issues/7431#issuecomment-1531173452
@weizhouapache
I created 2 cluster 1 with shared network and other with isolated network. So my app servers and its associated pods works in isolated network with LoadBalancing where as media server works on shared network. I can connect media server with app server through node IP.
Need lot of testing... Thank you for the suppport....
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] weizhouapache commented on issue #7431: Kubernetes external ip for a loadbalancer service is in peding state
Posted by "weizhouapache (via GitHub)" <gi...@apache.org>.
weizhouapache commented on issue #7431:
URL: https://github.com/apache/cloudstack/issues/7431#issuecomment-1531296208
@Noelantogerorge
can you explain a bit more of your requirement ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] weizhouapache commented on issue #7431: Kubernetes external ip for a loadbalancer service is in peding state
Posted by "weizhouapache (via GitHub)" <gi...@apache.org>.
weizhouapache commented on issue #7431:
URL: https://github.com/apache/cloudstack/issues/7431#issuecomment-1531340534
@Noelantogerorge yes, understood.
can you create a github issue for it ? it looks like a small change
can you also share what you have done to make it work ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] Noelantogerorge commented on issue #7431: Kubernetes external ip for a loadbalancer service is in peding state
Posted by "Noelantogerorge (via GitHub)" <gi...@apache.org>.
Noelantogerorge commented on issue #7431:
URL: https://github.com/apache/cloudstack/issues/7431#issuecomment-1534520714
@weizhouapache Done, I had raised a github issue with my solution.
As I could able to solve my infra issue with alternative way I am closing this issue. Thank you @weizhouapache, @kiranchavala, @shwstppr... Thank you guys...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] Noelantogerorge closed issue #7431: Kubernetes external ip for a loadbalancer service is in peding state
Posted by "Noelantogerorge (via GitHub)" <gi...@apache.org>.
Noelantogerorge closed issue #7431: Kubernetes external ip for a loadbalancer service is in peding state
URL: https://github.com/apache/cloudstack/issues/7431
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] shwstppr commented on issue #7431: Kubernetes external ip for a loadbalancer service is in peding state
Posted by "shwstppr (via GitHub)" <gi...@apache.org>.
shwstppr commented on issue #7431:
URL: https://github.com/apache/cloudstack/issues/7431#issuecomment-1517644081
@weizhouapache I tried with the changed code to allow deploying provider for shared network.
After that though it tries to list/create loadbalancer but fails with the API call,
```
⇒ ./kubectl --kubeconfig ./kube.conf describe svc nginx-deployment
Name: nginx-deployment
Namespace: default
Labels: app=nginx
Annotations: <none>
Selector: app=nginx
Type: LoadBalancer
IP Family Policy: SingleStack
IP Families: IPv4
IP: 10.104.19.159
IPs: 10.104.19.159
Port: <unset> 80/TCP
TargetPort: 80/TCP
NodePort: <unset> 30495/TCP
Endpoints:
Session Affinity: None
External Traffic Policy: Cluster
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal EnsuringLoadBalancer 2m40s (x11 over 32m) service-controller Ensuring load balancer
Warning SyncLoadBalancerFailed 2m10s (x11 over 32m) service-controller Error syncing load balancer: failed to ensure load balancer: error retrieving load balancer rules: Get http://10.0.34.201:8080/client/api?apiKey=KrMLbhjYaLWLqnPISgpqo-2XRXKx0MFuJwfcaf2kGuTVaaoTRYmlyQRTy_VuVBn5zXP2Pkb5cCnZxmYu80ycKw&command=listLoadBalancerRules&keyword=a2508be6b99c0462f9bdc09ba0ab46ac&listall=true&response=json&signature=5y5T5QbgcR9jhjHf5raodd%2F3FsA%3D: dial tcp 10.0.34.201:8080: i/o timeout
shwstppr@shwstppr-ThinkPad:~/Downloads|
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] Noelantogerorge commented on issue #7431: Kubernetes external ip for a loadbalancer service is in peding state
Posted by "Noelantogerorge (via GitHub)" <gi...@apache.org>.
Noelantogerorge commented on issue #7431:
URL: https://github.com/apache/cloudstack/issues/7431#issuecomment-1518462746
Hi,
We are trying to deploy media server and its app server on kubernetes.
Media server works in host network mode. So basically there are lot of
ports used by media server these ports works through host server network.
If it behind any nat then it won't work.
I have the deployment yml file which works in cloud like AWS,Digital ocean.
If needed I can share the yml file.
On cloudstack we can create a isolated or vpc network for kubernetes
cluster and LB works perfectly. But as I mentioned if we deploy my pod it
works on host network and it get some isolated lan cidr. We need that to be
public IP.
So I created a shared network with public IP and start the cluster and
unfortunately LB fails
I tried adding a shared network to another NIC and see how it works but
that crash down the cluster. Is there any way how we can make nodes to have
public IP rather than isolated or vpc lan cidr.
On Sat, Apr 22, 2023, 1:04 AM Wei Zhou ***@***.***> wrote:
> @weizhouapache <https://github.com/weizhouapache>
> https://github.com/weizhouapache My environment is like I need kubnertes
> cluster to have public IP. So that when I deploy pod as host network node
> IP should be public network and I need all traffic to route to node network
> namespace. So I create a shared network with public IP and observer that
> load balancer won't able to provide any external IP address If this is a
> normal behaviour then how can we deploy kubernetes in hostnetwork mode Same
> scenario works in coud environment like AWS, AZURE, Digital Ocean etc
> … <#m_6023603284368853770_>
> On Fri, Apr 21, 2023, 11:41 PM Wei Zhou *@*.*> wrote: @weizhouapache
> <https://github.com/weizhouapache> https://github.com/weizhouapache
> <https://github.com/weizhouapache> I tried with the changed code to allow
> deploying provider for shared network. After that though it tries to
> list/create loadbalancer but fails with the API call, ⇒ ./kubectl
> --kubeconfig ./kube.conf describe svc nginx-deployment Name:
> nginx-deployment Namespace: default Labels: app=nginx Annotations:
> Selector: app=nginx Type: LoadBalancer IP Family Policy: SingleStack IP
> Families: IPv4 IP: 10.104.19.159 IPs: 10.104.19.159 Port: 80/TCP
> TargetPort: 80/TCP NodePort: 30495/TCP Endpoints: Session Affinity: None
> External Traffic Policy: Cluster Events: Type Reason Age From Message ----
> ------ ---- ---- ------- Normal EnsuringLoadBalancer 2m40s (x11 over 32m)
> service-controller Ensuring load balancer Warning SyncLoadBalancerFailed
> 2m10s (x11 over 32m) service-controller Error syncing load balancer: failed
> to ensure load balancer: error retrieving load balancer rules: Get
> http://10.0.34.201:8080/client/api?apiKey=KrMLbhjYaLWLqnPISgpqo-2XRXKx0MFuJwfcaf2kGuTVaaoTRYmlyQRTy_VuVBn5zXP2Pkb5cCnZxmYu80ycKw&command=listLoadBalancerRules&keyword=a2508be6b99c0462f9bdc09ba0ab46ac&listall=true&response=json&signature=5y5T5QbgcR9jhjHf5raodd%2F3FsA%3D
> <http://10.0.34.201:8080/client/api?apiKey=KrMLbhjYaLWLqnPISgpqo-2XRXKx0MFuJwfcaf2kGuTVaaoTRYmlyQRTy_VuVBn5zXP2Pkb5cCnZxmYu80ycKw&command=listLoadBalancerRules&keyword=a2508be6b99c0462f9bdc09ba0ab46ac&listall=true&response=json&signature=5y5T5QbgcR9jhjHf5raodd%2F3FsA%3D>:
> dial tcp 10.0.34.201:8080 <http://10.0.34.201:8080>: i/o timeout @shwstppr
> <https://github.com/shwstppr> https://github.com/shwstppr
> <https://github.com/shwstppr> it looks like expected behaviour to me. cc
> @davidjumani <https://github.com/davidjumani>
> https://github.com/davidjumani <https://github.com/davidjumani> — Reply to
> this email directly, view it on GitHub <#7431 (comment)
> <https://github.com/apache/cloudstack/issues/7431#issuecomment-1518177870>>,
> or unsubscribe
> https://github.com/notifications/unsubscribe-auth/A6FZLRE6XMZRWLIA2MAQ433XCLEVJANCNFSM6AAAAAAW5C4UAM
> <https://github.com/notifications/unsubscribe-auth/A6FZLRE6XMZRWLIA2MAQ433XCLEVJANCNFSM6AAAAAAW5C4UAM>
> . You are receiving this because you were mentioned.Message ID: @.*>
>
> @Noelantogerorge <https://github.com/Noelantogerorge>
> As you mentioned, there is no issue with isolated network. In my opinion,
> you will have to use isolated network or vpc.
> Can you describe more details of your requirements, better with an example
> ? let's discuss if there is a resolution.
>
> —
> Reply to this email directly, view it on GitHub
> <https://github.com/apache/cloudstack/issues/7431#issuecomment-1518256554>,
> or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/A6FZLRFBVMHJTIJEMIWL4LLXCLOMXANCNFSM6AAAAAAW5C4UAM>
> .
> You are receiving this because you were mentioned.Message ID:
> ***@***.***>
>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] kiranchavala commented on issue #7431: Kubernetes external ip for a loadbalancer service is in peding state
Posted by "kiranchavala (via GitHub)" <gi...@apache.org>.
kiranchavala commented on issue #7431:
URL: https://github.com/apache/cloudstack/issues/7431#issuecomment-1517268019
This issue is reproducible in lab
@davidjumani @weizhouapache can you take a look
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] shwstppr commented on issue #7431: Kubernetes external ip for a loadbalancer service is in peding state
Posted by "shwstppr (via GitHub)" <gi...@apache.org>.
shwstppr commented on issue #7431:
URL: https://github.com/apache/cloudstack/issues/7431#issuecomment-1517324105
@Noelantogerorge cc @davidjumani it seems cloudstack-kubernetes-provider is not deployed for a shared network which must be causing this issue.
https://github.com/apache/cloudstack/blob/main/plugins/integrations/kubernetes-service/src/main/java/com/cloud/kubernetes/cluster/actionworkers/KubernetesClusterActionWorker.java#L565-L569
Let me check if that can be changed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] weizhouapache commented on issue #7431: Kubernetes external ip for a loadbalancer service is in peding state
Posted by "weizhouapache (via GitHub)" <gi...@apache.org>.
weizhouapache commented on issue #7431:
URL: https://github.com/apache/cloudstack/issues/7431#issuecomment-1518256554
> @weizhouapache <https://github.com/weizhouapache> My environment is like I need kubnertes cluster to have public IP. So that when I deploy pod as host network node IP should be public network and I need all traffic to route to node network namespace. So I create a shared network with public IP and observer that load balancer won't able to provide any external IP address If this is a normal behaviour then how can we deploy kubernetes in hostnetwork mode Same scenario works in coud environment like AWS, AZURE, Digital Ocean etc
> […](#)
> On Fri, Apr 21, 2023, 11:41 PM Wei Zhou ***@***.***> wrote: @weizhouapache <https://github.com/weizhouapache> I tried with the changed code to allow deploying provider for shared network. After that though it tries to list/create loadbalancer but fails with the API call, ⇒ ./kubectl --kubeconfig ./kube.conf describe svc nginx-deployment Name: nginx-deployment Namespace: default Labels: app=nginx Annotations: <none> Selector: app=nginx Type: LoadBalancer IP Family Policy: SingleStack IP Families: IPv4 IP: 10.104.19.159 IPs: 10.104.19.159 Port: <unset> 80/TCP TargetPort: 80/TCP NodePort: <unset> 30495/TCP Endpoints: Session Affinity: None External Traffic Policy: Cluster Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal EnsuringLoadBalancer 2m40s (x11 over 32m) service-controller Ensuring load balancer Warning SyncLoadBalancerFailed 2m10s (x11 over 32m) service-controller Error syncing load balancer: failed to ensure load balancer: error retrieving load b
alancer rules: Get http://10.0.34.201:8080/client/api?apiKey=KrMLbhjYaLWLqnPISgpqo-2XRXKx0MFuJwfcaf2kGuTVaaoTRYmlyQRTy_VuVBn5zXP2Pkb5cCnZxmYu80ycKw&command=listLoadBalancerRules&keyword=a2508be6b99c0462f9bdc09ba0ab46ac&listall=true&response=json&signature=5y5T5QbgcR9jhjHf5raodd%2F3FsA%3D: dial tcp 10.0.34.201:8080: i/o timeout @shwstppr <https://github.com/shwstppr> it looks like expected behaviour to me. cc @davidjumani <https://github.com/davidjumani> — Reply to this email directly, view it on GitHub <[#7431 (comment)](https://github.com/apache/cloudstack/issues/7431#issuecomment-1518177870)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/A6FZLRE6XMZRWLIA2MAQ433XCLEVJANCNFSM6AAAAAAW5C4UAM> . You are receiving this because you were mentioned.Message ID: ***@***.***>
@Noelantogerorge
As you mentioned, there is no issue with isolated network. In my opinion, you will have to use isolated network or vpc.
Can you describe more details of your requirements, better with an example ? let's discuss if there is a resolution.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org