You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@apisix.apache.org by GitBox <gi...@apache.org> on 2022/02/06 19:54:28 UTC
[GitHub] [apisix-ingress-controller] MirtoBusico opened a new issue #853: bug: creating a route with yaml file generates a wrong upstrem: pod address instead of service address
MirtoBusico opened a new issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853
### Issue description
When creating a route using a yaml file and kubectl the generated upstream uses the **pod address** instead of the **service address**.
Whenever the cluster is restarted or the pod is redeployed the pod address changes and the route stop working
### Environment
- your apisix-ingress-controller version (output of apisix-ingress-controller version --long):
```
apache/apisix-ingress-controller:1.4.0 (taken from the k8s dashboard - btw where can I issue the "apisix-ingress-controller version --long" command? )
```
- your Kubernetes cluster version (output of kubectl version):
```
sysop@m01serv:~$ kubectl version
Client Version: version.Info{Major:"1", Minor:"23", GitVersion:"v1.23.1", GitCommit:"86ec240af8cbd1b60bcc4c03c20da9b98005b92e", GitTreeState:"clean", BuildDate:"2021-12-16T11:41:01Z", GoVersion:"go1.17.5", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"22", GitVersion:"v1.22.5+k3s1", GitCommit:"405bf79da97831749733ad99842da638c8ee4802", GitTreeState:"clean", BuildDate:"2021-12-18T00:43:30Z", GoVersion:"go1.16.10", Compiler:"gc", Platform:"linux/amd64"}
sysop@m01serv:~$
```
- if you run apisix-ingress-controller in Bare-metal environment, also show your OS version (uname -a):
```
sysop@m01km:~$ uname -a
Linux m01km 5.4.0-96-generic #109-Ubuntu SMP Wed Jan 12 16:49:16 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
sysop@m01km:~$
```
### Minimal test code / Steps to reproduce
1) on 3 virtual machines install a K3S 3 node cluster
2) install Istio with "minimal" profile
3) install the bookinfo demo application with these definitions
```
# Copyright Istio Authors
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
##################################################################################################
# This file defines the services, service accounts, and deployments for the Bookinfo sample.
#
# To apply all 4 Bookinfo services, their corresponding service accounts, and deployments:
#
# kubectl apply -f samples/bookinfo/platform/kube/bookinfo.yaml
#
# Alternatively, you can deploy any resource separately:
#
# kubectl apply -f samples/bookinfo/platform/kube/bookinfo.yaml -l service=reviews # reviews Service
# kubectl apply -f samples/bookinfo/platform/kube/bookinfo.yaml -l account=reviews # reviews ServiceAccount
# kubectl apply -f samples/bookinfo/platform/kube/bookinfo.yaml -l app=reviews,version=v3 # reviews-v3 Deployment
##################################################################################################
##################################################################################################
# Details service
##################################################################################################
apiVersion: v1
kind: Service
metadata:
name: details
labels:
app: details
service: details
spec:
ports:
- port: 9080
name: http
selector:
app: details
---
apiVersion: v1
kind: ServiceAccount
metadata:
name: bookinfo-details
labels:
account: details
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: details-v1
labels:
app: details
version: v1
spec:
replicas: 1
selector:
matchLabels:
app: details
version: v1
template:
metadata:
labels:
app: details
version: v1
spec:
serviceAccountName: bookinfo-details
containers:
- name: details
image: docker.io/istio/examples-bookinfo-details-v1:1.16.2
imagePullPolicy: IfNotPresent
ports:
- containerPort: 9080
securityContext:
runAsUser: 1000
---
##################################################################################################
# Ratings service
##################################################################################################
apiVersion: v1
kind: Service
metadata:
name: ratings
labels:
app: ratings
service: ratings
spec:
ports:
- port: 9080
name: http
selector:
app: ratings
---
apiVersion: v1
kind: ServiceAccount
metadata:
name: bookinfo-ratings
labels:
account: ratings
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: ratings-v1
labels:
app: ratings
version: v1
spec:
replicas: 1
selector:
matchLabels:
app: ratings
version: v1
template:
metadata:
labels:
app: ratings
version: v1
spec:
serviceAccountName: bookinfo-ratings
containers:
- name: ratings
image: docker.io/istio/examples-bookinfo-ratings-v1:1.16.2
imagePullPolicy: IfNotPresent
ports:
- containerPort: 9080
securityContext:
runAsUser: 1000
---
##################################################################################################
# Reviews service
##################################################################################################
apiVersion: v1
kind: Service
metadata:
name: reviews
labels:
app: reviews
service: reviews
spec:
ports:
- port: 9080
name: http
selector:
app: reviews
---
apiVersion: v1
kind: ServiceAccount
metadata:
name: bookinfo-reviews
labels:
account: reviews
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: reviews-v1
labels:
app: reviews
version: v1
spec:
replicas: 1
selector:
matchLabels:
app: reviews
version: v1
template:
metadata:
labels:
app: reviews
version: v1
spec:
serviceAccountName: bookinfo-reviews
containers:
- name: reviews
image: docker.io/istio/examples-bookinfo-reviews-v1:1.16.2
imagePullPolicy: IfNotPresent
env:
- name: LOG_DIR
value: "/tmp/logs"
ports:
- containerPort: 9080
volumeMounts:
- name: tmp
mountPath: /tmp
- name: wlp-output
mountPath: /opt/ibm/wlp/output
securityContext:
runAsUser: 1000
volumes:
- name: wlp-output
emptyDir: {}
- name: tmp
emptyDir: {}
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: reviews-v2
labels:
app: reviews
version: v2
spec:
replicas: 1
selector:
matchLabels:
app: reviews
version: v2
template:
metadata:
labels:
app: reviews
version: v2
spec:
serviceAccountName: bookinfo-reviews
containers:
- name: reviews
image: docker.io/istio/examples-bookinfo-reviews-v2:1.16.2
imagePullPolicy: IfNotPresent
env:
- name: LOG_DIR
value: "/tmp/logs"
ports:
- containerPort: 9080
volumeMounts:
- name: tmp
mountPath: /tmp
- name: wlp-output
mountPath: /opt/ibm/wlp/output
securityContext:
runAsUser: 1000
volumes:
- name: wlp-output
emptyDir: {}
- name: tmp
emptyDir: {}
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: reviews-v3
labels:
app: reviews
version: v3
spec:
replicas: 1
selector:
matchLabels:
app: reviews
version: v3
template:
metadata:
labels:
app: reviews
version: v3
spec:
serviceAccountName: bookinfo-reviews
containers:
- name: reviews
image: docker.io/istio/examples-bookinfo-reviews-v3:1.16.2
imagePullPolicy: IfNotPresent
env:
- name: LOG_DIR
value: "/tmp/logs"
ports:
- containerPort: 9080
volumeMounts:
- name: tmp
mountPath: /tmp
- name: wlp-output
mountPath: /opt/ibm/wlp/output
securityContext:
runAsUser: 1000
volumes:
- name: wlp-output
emptyDir: {}
- name: tmp
emptyDir: {}
---
##################################################################################################
# Productpage services
##################################################################################################
apiVersion: v1
kind: Service
metadata:
name: productpage
labels:
app: productpage
service: productpage
spec:
ports:
- port: 9080
name: http
selector:
app: productpage
---
apiVersion: v1
kind: ServiceAccount
metadata:
name: bookinfo-productpage
labels:
account: productpage
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: productpage-v1
labels:
app: productpage
version: v1
spec:
replicas: 1
selector:
matchLabels:
app: productpage
version: v1
template:
metadata:
labels:
app: productpage
version: v1
spec:
serviceAccountName: bookinfo-productpage
containers:
- name: productpage
image: docker.io/istio/examples-bookinfo-productpage-v1:1.16.2
imagePullPolicy: IfNotPresent
ports:
- containerPort: 9080
volumeMounts:
- name: tmp
mountPath: /tmp
securityContext:
runAsUser: 1000
volumes:
- name: tmp
emptyDir: {}
---
```
4) get the apisix helm chart values.yaml file and change these lines:
```
...
gateway:
type: LoadBalancer
...
tls:
enabled: true
...
stream: # L4 proxy (TCP/UDP) see bug #851
enabled: true
only: false
tcp: # TCP proxy address list
- 9100
- "127.0.0.1:9101"
udp: # UDP proxy address list
- 9200
- "127.0.0.1:9211"
...
dashboard:
enabled: true
ingress-controller:
enabled: true
```
5) inatall apisix with these commands
```
kubectl create ns apisix
kubectl label namespace apisix istio-injection=enabled
helm install apisix apisix/apisix -f apisix-values.yaml \
--set ingress-controller.config.apisix.serviceNamespace=apisix \
--set ingress-controller.config.apisix.serviceName=apisix-admin \
--namespace apisix
```
6) create a file productpage-ar.yaml containing:
```
apiVersion: apisix.apache.org/v2beta2
kind: ApisixRoute
metadata:
name: productpage
spec:
http:
- name: rule1
match:
hosts:
- www2.m01.net
paths:
- /*
backends:
- serviceName: productpage
servicePort: 9080
```
7) create the route (and describe it ) with the commands:
```
sysop@m01serv:~/software/apisisx$ kubectl -n bookinfo apply -f productpage-ar.yaml
apisixroute.apisix.apache.org/productpage created
sysop@m01serv:~/software/apisisx$ kubectl describe apisixroute productpage -n bookinfo
Name: productpage
Namespace: bookinfo
Labels: <none>
Annotations: <none>
API Version: apisix.apache.org/v2beta3
Kind: ApisixRoute
Metadata:
Creation Timestamp: 2022-02-06T13:13:31Z
Generation: 1
Resource Version: 171709
UID: 3ccba0af-7622-41f2-90f0-ce2846424ae2
Spec:
Http:
Backends:
Service Name: productpage
Service Port: 9080
Match:
Hosts:
www2.m01.net
Paths:
/*
Name: rule1
Status:
Conditions:
Message: Sync Successfully
Observed Generation: 1
Reason: ResourcesSynced
Status: True
Type: ResourcesAvailable
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal ResourcesSynced 50s (x2 over 50s) ApisixIngress ApisixIngress synced successfully
sysop@m01serv:~/software/apisisx$
```
8) Then verify the route in dashboard
<img width="1706" alt="upstream" src="https://user-images.githubusercontent.com/11090934/152696999-29b3a2bd-e24d-4fef-8f94-f3bbc24c7e9a.png">
Note that the "service" in yaml file is translater in the POD address (10.42.1.188) instead of the SERVICE address (10.43.189.220)
```
sysop@m01serv:~/software/apisisx$ kubectl get pods -n bookinfo -o wide
NAME READY STATUS RESTARTS AGE IP NODE NOMINATED NODE READINESS GATES
reviews-v3-5cddf46b56-x2hbz 2/2 Running 4 (5h13m ago) 7d8h 10.42.2.159 m01kw2 <none> <none>
ratings-v1-5db74dc944-5z2rz 2/2 Running 4 (5h13m ago) 7d8h 10.42.0.207 m01km <none> <none>
reviews-v2-6fcf6d48b4-bvtzn 2/2 Running 4 (5h13m ago) 7d8h 10.42.0.206 m01km <none> <none>
reviews-v1-d7f5b879b-bf7tz 2/2 Running 4 (5h13m ago) 7d8h 10.42.1.187 m01kw1 <none> <none>
productpage-v1-77748558b4-w2h2h 2/2 Running 4 (5h13m ago) 7d8h 10.42.1.188 m01kw1 <none> <none>
details-v1-65fff9896-fw7qv 2/2 Running 4 (5h13m ago) 7d8h 10.42.1.190 m01kw1 <none> <none>
sysop@m01serv:~/software/apisisx$ kubectl get services -n bookinfo -o wide
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE SELECTOR
details ClusterIP 10.43.230.138 <none> 9080/TCP 11d app=details
ratings ClusterIP 10.43.16.57 <none> 9080/TCP 11d app=ratings
reviews ClusterIP 10.43.236.52 <none> 9080/TCP 11d app=reviews
productpage ClusterIP 10.43.189.220 <none> 9080/TCP 11d app=productpage
sysop@m01serv:~/software/apisisx$
```
9) restart the cluster and try to access the route.You receive the error
```
upstream connect error or disconnect/reset before headers. reset reason: connection failure, transport failure reason: delayed connect error: 113
```
and looking to the addresses you see that the POD address (10.42.1.211) is changed and the SERVICE address (10.43.189.220) is the same
```
sysop@m01serv:~$ kubectl get pods -n bookinfo -o wide
NAME READY STATUS RESTARTS AGE IP NODE NOMINATED NODE READINESS GATES
ratings-v1-5db74dc944-5z2rz 2/2 Running 6 (16m ago) 7d8h 10.42.0.227 m01km <none> <none>
reviews-v3-5cddf46b56-x2hbz 2/2 Running 6 (16m ago) 7d8h 10.42.2.178 m01kw2 <none> <none>
reviews-v2-6fcf6d48b4-bvtzn 2/2 Running 6 (16m ago) 7d8h 10.42.0.228 m01km <none> <none>
reviews-v1-d7f5b879b-bf7tz 2/2 Running 6 (16m ago) 7d8h 10.42.1.214 m01kw1 <none> <none>
details-v1-65fff9896-fw7qv 2/2 Running 6 (16m ago) 7d8h 10.42.1.212 m01kw1 <none> <none>
productpage-v1-77748558b4-w2h2h 2/2 Running 6 (16m ago) 7d8h 10.42.1.211 m01kw1 <none> <none>
sysop@m01serv:~$ kubectl get services -n bookinfo -o wide
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE SELECTOR
details ClusterIP 10.43.230.138 <none> 9080/TCP 12d app=details
ratings ClusterIP 10.43.16.57 <none> 9080/TCP 12d app=ratings
reviews ClusterIP 10.43.236.52 <none> 9080/TCP 12d app=reviews
productpage ClusterIP 10.43.189.220 <none> 9080/TCP 12d app=productpage
sysop@m01serv:~$
```
NOTE: after approx fife minutes the upstream address is updated with the new value of the POD address and the route works again
### Actual result
```
upstream connect error or disconnect/reset before headers. reset reason: connection failure, transport failure reason: delayed connect error: 113
```
### Error log
Nothing useful in the logs
### Expected result
```
sysop@m01serv:~/software/apisisx$ curl -v http://www2.m01.net
* Trying 192.168.102.121:80...
* TCP_NODELAY set
* Connected to www2.m01.net (192.168.102.121) port 80 (#0)
> GET / HTTP/1.1
> Host: www2.m01.net
> User-Agent: curl/7.68.0
> Accept: */*
>
* Mark bundle as not supporting multiuse
< HTTP/1.1 200 OK
< content-type: text/html; charset=utf-8
< content-length: 1683
< date: Sun, 06 Feb 2022 13:15:42 GMT
< x-envoy-upstream-service-time: 43
< server: istio-envoy
< x-envoy-decorator-operation: apisix-gateway.apisix.svc.cluster.local:80/*
<
<!DOCTYPE html>
<html>
<head>
...
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] tao12345666333 closed issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
tao12345666333 closed issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] tao12345666333 commented on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
tao12345666333 commented on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1040009091
> The warning in the log still complains the v2beta1 version
@MirtoBusico This is a configuration item, in configmap. It can be changed at values.yaml https://github.com/apache/apisix-helm-chart/blob/051998d8cc1816674fcbc3c8029f9e7d1330e3d5/charts/apisix-ingress-controller/values.yaml#L113-L115
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] MirtoBusico commented on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
MirtoBusico commented on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1037329951
I've completed the reinstallation, but after 4 cluster restart the Service address is substituted by a Pod address
The route just defined
The route the day after
<img width="1716" alt="route after_4_restart" src="https://user-images.githubusercontent.com/11090934/153720696-e30add07-5ade-4644-be2e-14c505da6a97.png">
I installed using the new chart
```
sysop@m01serv:~/software/apisisx$ helm show chart apisix/apisix
apiVersion: v2
appVersion: 2.12.0
dependencies:
- condition: etcd.enabled
name: etcd
repository: https://charts.bitnami.com/bitnami
version: 6.2.6
- alias: dashboard
condition: dashboard.enabled
name: apisix-dashboard
repository: https://charts.apiseven.com
version: 0.4.0
- alias: ingress-controller
condition: ingress-controller.enabled
name: apisix-ingress-controller
repository: https://charts.apiseven.com
version: 0.9.0
description: A Helm chart for Apache APISIX
icon: https://apache.org/logos/res/apisix/apisix.png
maintainers:
- name: tao12345666333
name: apisix
type: application
version: 0.8.2
```
On this chart I changed
```
...
gateway:
type: LoadBalancer
...
tls:
enabled: true
...
dashboard:
enabled: true
ingress-controller:
enabled: true
```
The stream modification from issue #851 is no more applicable. The below code gives a syntax error (expected integer received string)
```
...
stream: # L4 proxy (TCP/UDP) see bug #851
enabled: true
only: false
tcp: # TCP proxy address list
- 9100
- "127.0.0.1:9101"
udp: # UDP proxy address list
- 9200
- "127.0.0.1:9211"
```
Apisix installed with
```
kubectl create ns apisix
kubectl label namespace apisix istio-injection=enabled
helm install apisix apisix/apisix -f apisix-values.yaml \
--set ingress-controller.config.apisix.serviceNamespace=apisix \
--set ingress-controller.config.apisix.serviceName=apisix-admin \
--namespace apisix
```
Defining the route as
```
apiVersion: apisix.apache.org/v2beta2
kind: ApisixRoute
metadata:
name: productpage
spec:
http:
- name: rule1
match:
hosts:
- www2.m01.net
paths:
- /*
backends:
- serviceName: productpage
servicePort: 9080
resolveGranularity: service
```
The only strange thing in the apisix-ingress-controller log is that verdion **v2beta1** is deprecated in favor of **v2beta3**
But in the yaml file there is **v2beta2**
```
[GIN] 2022/02/12 - 03:25:30 | 200 | 31.569µs | 127.0.0.6 | GET "/healthz"
[GIN] 2022/02/12 - 03:25:30 | 200 | 20.218µs | 127.0.0.6 | GET "/healthz"
W0212 03:25:35.736793 1 warnings.go:70] apisix.apache.org/v2beta1 ApisixRoute is deprecated; use apisix.apache.org/v2beta3 ApisixRoute
[GIN] 2022/02/12 - 03:25:40 | 200 | 43.57µs | 127.0.0.6 | GET "/healthz"
[GIN] 2022/02/12 - 03:25:40 | 200 | 18.58µs | 127.0.0.6 | GET "/healthz"
```
The apisix-ingress controller at startup (today)
```
2022-02-12T16:49:19.277Z | I0213 00:49:19.277167 1 request.go:665] Waited for 1.163982311s due to client-side throttling, not priority and fairness, request: GET:https://10.43.0.1:443/apis/apisix.apache.org/v2beta3/namespaces/longhorn-system/apisixconsumers
2022-02-12T16:49:20.101Z | 2022-02-13T00:49:20+08:00 [34minfo[0m ingress/controller.go:549 controller now is running as leader {"namespace": "apisix", "pod": "apisix-ingress-controller-6846db58b8-lsv6g"}
2022-02-12T16:49:20.101Z | 2022-02-13T00:49:20+08:00 [34minfo[0m ingress/apisix_pluginconfig.go:57 ApisixPluginConfig controller started
2022-02-12T16:49:20.101Z | 2022-02-13T00:49:20+08:00 [34minfo[0m ingress/endpoint.go:56 endpoints controller started
2022-02-12T16:49:20.101Z | 2022-02-13T00:49:20+08:00 [34minfo[0m ingress/ingress.go:59 ingress controller started
2022-02-12T16:49:20.101Z | 2022-02-13T00:49:20+08:00 [34minfo[0m ingress/apisix_tls.go:58 ApisixTls controller started
2022-02-12T16:49:20.101Z | 2022-02-13T00:49:20+08:00 [34minfo[0m ingress/apisix_cluster_config.go:57 ApisixClusterConfig controller started
2022-02-12T16:49:20.101Z | 2022-02-13T00:49:20+08:00 [34minfo[0m ingress/secret.go:62 secret controller started
2022-02-12T16:49:20.101Z | 2022-02-13T00:49:20+08:00 [34minfo[0m ingress/apisix_upstream.go:58 ApisixUpstream controller started
2022-02-12T16:49:20.101Z | 2022-02-13T00:49:20+08:00 [34minfo[0m ingress/apisix_consumer.go:56 ApisixConsumer controller started
2022-02-12T16:49:20.101Z | 2022-02-13T00:49:20+08:00 [34minfo[0m ingress/apisix_route.go:59 ApisixRoute controller started
2022-02-12T16:49:20.101Z | 2022-02-13T00:49:20+08:00 [34minfo[0m ingress/namespace.go:71 namespace controller started
2022-02-12T16:49:20.101Z | 2022-02-13T00:49:20+08:00 [34minfo[0m ingress/pod.go:47 pod controller started
2022-02-12T16:49:20.102Z | W0213 00:49:20.102458 1 warnings.go:70] apisix.apache.org/v2beta1 ApisixRoute is deprecated; use apisix.apache.org/v2beta3 ApisixRoute
2022-02-12T16:49:20.106Z | W0213 00:49:20.106277 1 warnings.go:70] apisix.apache.org/v2beta1 ApisixRoute is deprecated; use apisix.apache.org/v2beta3 ApisixRoute
2022-02-12T16:49:20.243Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_grafana_3000", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/256603fb", "cluster": "default"}
2022-02-12T16:49:20.243Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-system_grafana_3000"}
2022-02-12T16:49:20.250Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_prometheus_9090", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/618bbe1f", "cluster": "default"}
2022-02-12T16:49:20.250Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-system_prometheus_9090"}
2022-02-12T16:49:20.255Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "kubernetes-dashboard_dashboard-metrics-scraper_8000", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/225c3962", "cluster": "default"}
2022-02-12T16:49:20.255Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "kubernetes-dashboard_dashboard-metrics-scraper_8000"}
2022-02-12T16:49:20.258Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "longhorn-system_csi-snapshotter_12345", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/97d053af", "cluster": "default"}
2022-02-12T16:49:20.258Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "longhorn-system_csi-snapshotter_12345"}
2022-02-12T16:49:20.263Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "apisix_apisix-etcd-headless_2379", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/b439b2f6", "cluster": "default"}
2022-02-12T16:49:20.263Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "apisix_apisix-etcd-headless_2379"}
2022-02-12T16:49:20.265Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "apisix_apisix-etcd-headless_2380", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/4a7d169d", "cluster": "default"}
2022-02-12T16:49:20.265Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "apisix_apisix-etcd-headless_2380"}
2022-02-12T16:49:20.268Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-operator_istio-operator_8383", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/6b312a6d", "cluster": "default"}
2022-02-12T16:49:20.268Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-operator_istio-operator_8383"}
2022-02-12T16:49:20.270Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_jaeger-collector_14268", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/b8ae0da0", "cluster": "default"}
2022-02-12T16:49:20.270Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-system_jaeger-collector_14268"}
2022-02-12T16:49:20.274Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_jaeger-collector_14250", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/9d58d651", "cluster": "default"}
2022-02-12T16:49:20.274Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-system_jaeger-collector_14250"}
2022-02-12T16:49:20.278Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_jaeger-collector_9411", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/6c3f31a6", "cluster": "default"}
2022-02-12T16:49:20.278Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-system_jaeger-collector_9411"}
2022-02-12T16:49:20.281Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "default_kubernetes_443", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/606b3be0", "cluster": "default"}
2022-02-12T16:49:20.281Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "default_kubernetes_443"}
2022-02-12T16:49:20.284Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_istiod_15010", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/861f0648", "cluster": "default"}
2022-02-12T16:49:20.284Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-system_istiod_15010"}
2022-02-12T16:49:20.287Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_istiod_15012", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/68116764", "cluster": "default"}
2022-02-12T16:49:20.287Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-system_istiod_15012"}
2022-02-12T16:49:20.289Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_istiod_443", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/3bd1b5fa", "cluster": "default"}
2022-02-12T16:49:20.289Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-system_istiod_443"}
2022-02-12T16:49:20.292Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_istiod_15014", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/8172c251", "cluster": "default"}
2022-02-12T16:49:20.292Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-system_istiod_15014"}
2022-02-12T16:49:20.294Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_kiali_20001", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/d751995a", "cluster": "default"}
2022-02-12T16:49:20.294Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-system_kiali_20001"}
2022-02-12T16:49:20.297Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_kiali_9090", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/55e2f8be", "cluster": "default"}
2022-02-12T16:49:20.297Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-system_kiali_9090"}
2022-02-12T16:49:20.303Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "apisix_apisix-gateway_80", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/93400b20", "cluster": "default"}
2022-02-12T16:49:20.303Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "apisix_apisix-gateway_80"}
2022-02-12T16:49:20.307Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "apisix_apisix-gateway_443", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/3b59d238", "cluster": "default"}
2022-02-12T16:49:20.307Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "apisix_apisix-gateway_443"}
2022-02-12T16:49:20.309Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "kube-system_docker-registry_5000", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/6cec0f18", "cluster": "default"}
2022-02-12T16:49:20.309Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "kube-system_docker-registry_5000"}
2022-02-12T16:49:20.312Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "apisix_apisix-dashboard_80", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/6624cd4a", "cluster": "default"}
2022-02-12T16:49:20.312Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "apisix_apisix-dashboard_80"}
2022-02-12T16:49:20.315Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "apisix_apisix-admin_9180", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/930895ff", "cluster": "default"}
2022-02-12T16:49:20.315Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "apisix_apisix-admin_9180"}
2022-02-12T16:49:20.317Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "apisix_apisix-ingress-controller_80", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/b1bea59", "cluster": "default"}
2022-02-12T16:49:20.317Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "apisix_apisix-ingress-controller_80"}
2022-02-12T16:49:20.319Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "longhorn-system_csi-provisioner_12345", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/6d394703", "cluster": "default"}
2022-02-12T16:49:20.319Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "longhorn-system_csi-provisioner_12345"}
2022-02-12T16:49:20.322Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "longhorn-system_longhorn-frontend_80", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/d07916d6", "cluster": "default"}
2022-02-12T16:49:20.322Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "longhorn-system_longhorn-frontend_80"}
2022-02-12T16:49:20.325Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_tracing_80", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/b699da65", "cluster": "default"}
2022-02-12T16:49:20.325Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-system_tracing_80"}
2022-02-12T16:49:20.329Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_tracing_16685", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/ae80a4d", "cluster": "default"}
2022-02-12T16:49:20.329Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-system_tracing_16685"}
2022-02-12T16:49:20.344Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "longhorn-system_longhorn-backend_9500", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/2ceb1990", "cluster": "default"}
2022-02-12T16:49:20.344Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "longhorn-system_longhorn-backend_9500"}
2022-02-12T16:49:20.356Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "longhorn-system_csi-attacher_12345", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/ee03afe2", "cluster": "default"}
2022-02-12T16:49:20.356Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "longhorn-system_csi-attacher_12345"}
2022-02-12T16:49:20.362Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "kube-system_metrics-server_443", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/4a344633", "cluster": "default"}
2022-02-12T16:49:20.362Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "kube-system_metrics-server_443"}
2022-02-12T16:49:20.365Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "kube-system_kube-dns_53", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/f3118c88", "cluster": "default"}
2022-02-12T16:49:20.365Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "kube-system_kube-dns_53"}
2022-02-12T16:49:20.368Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "kube-system_kube-dns_53", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/f3118c88", "cluster": "default"}
2022-02-12T16:49:20.368Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "kube-system_kube-dns_53"}
2022-02-12T16:49:20.371Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "kube-system_kube-dns_9153", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/23ef4d0", "cluster": "default"}
2022-02-12T16:49:20.371Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "kube-system_kube-dns_9153"}
2022-02-12T16:49:20.374Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "longhorn-system_csi-resizer_12345", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/29267f16", "cluster": "default"}
2022-02-12T16:49:20.374Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "longhorn-system_csi-resizer_12345"}
2022-02-12T16:49:20.378Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "kubernetes-dashboard_kubernetes-dashboard_443", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/7dc55665", "cluster": "default"}
2022-02-12T16:49:20.378Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "kubernetes-dashboard_kubernetes-dashboard_443"}
2022-02-12T16:49:20.381Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "apisix_apisix-etcd_2379", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/ba31b611", "cluster": "default"}
2022-02-12T16:49:20.381Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "apisix_apisix-etcd_2379"}
2022-02-12T16:49:20.385Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "apisix_apisix-etcd_2380", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/4475127a", "cluster": "default"}
2022-02-12T16:49:20.385Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "apisix_apisix-etcd_2380"}
2022-02-12T16:49:20.388Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_zipkin_9411", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/c4c96c99", "cluster": "default"}
2022-02-12T16:49:20.388Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-system_zipkin_9411"}
2022-02-12T16:49:20.392Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "bookinfo_reviews_9080", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/c4c02588", "cluster": "default"}
2022-02-12T16:49:20.392Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "bookinfo_reviews_9080"}
2022-02-12T16:49:20.396Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "bookinfo_ratings_9080", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/4a5806af", "cluster": "default"}
2022-02-12T16:49:20.396Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "bookinfo_ratings_9080"}
2022-02-12T16:49:20.399Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "bookinfo_details_9080", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/aabec2ca", "cluster": "default"}
2022-02-12T16:49:20.399Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "bookinfo_details_9080"}
2022-02-12T16:49:21.352Z | [GIN] 2022/02/13 - 00:49:21 | 200 | 51.009µs | 127.0.0.6 | GET "/healthz"
2022-02-12T16:49:26.559Z | [GIN] 2022/02/13 - 00:49:26 | 200 | 41.23µs | 127.0.0.6 | GET "/healthz"
```
Now I'll try to delete the route and reinstall using v2beta3
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] MirtoBusico commented on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
MirtoBusico commented on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1040189346
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] MirtoBusico edited a comment on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
MirtoBusico edited a comment on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1040189346
> > The warning in the log still complains the v2beta1 version
>
> @MirtoBusico This is a configuration item, in configmap. It can be changed at values.yaml https://github.com/apache/apisix-helm-chart/blob/051998d8cc1816674fcbc3c8029f9e7d1330e3d5/charts/apisix-ingress-controller/values.yaml#L113-L115
Thanks @tao12345666333
Now I'll reinstall with (if I understand correctly)
```
helm install apisix apisix/apisix -f apisix-values.yaml \
--set ingress-controller.config.apisix.serviceNamespace=apisix \
--set ingress-controller.config.apisix.serviceName=apisix-admin \
--set ingress-controller.config.kubernetes.apisixRouteVersion=apisix.apache.org/v2beta3 \
--namespace apisix
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] MirtoBusico commented on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
MirtoBusico commented on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1035954493
Hi @tao12345666333 I didn't see anything in the controller log.
In this moment I'm reistalling from scratch.
asap I can test I'll post the complete controller log
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] MirtoBusico commented on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
MirtoBusico commented on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1035952958
Hi, @liangyuanpeng this issue started as a bug report. You can follow the section "Step to reproduce"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] tao12345666333 commented on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
tao12345666333 commented on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1040023176
> UPDATE
> After the first restart the route address seems correct but the apisix ingress controller started to signal errors:
I noticed that you have the following log here, which caused the exception of APISIX Ingress controller and APISIX request.
```
2022-02-12T18:57:52.059Z | 2022-02-13T02:57:52+08:00 �[31merror�[0m apisix/upstream.go:122 failed to convert upstream item {"url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams", "upstream_key": "/apisix/upstreams/394532502988915297", "error": "unexpected non-empty object"}
```
Other errors related to `context canceled` are caused by this. The current APISIX Ingress controller communicates with APISIX with the same context, so once a request fails, other requests will also exit.
Can you show me your `394532502988915297` upstream detail?
If you not changed the default APISIX's admin key, you can execute the following commands in APISIX pod.
```
curl http://127.0.0.1:9180/apisix/admin/upstreams/394532502988915297 -H 'X-API-KEY: edd1c9f034335f136f87ad84b625c8f1' -X GET
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] MirtoBusico edited a comment on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
MirtoBusico edited a comment on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1037349675
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] MirtoBusico commented on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
MirtoBusico commented on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1040676363
Well @tao12345666333 seems that no error appears in the logs after deleting the route.
Command to delete the route:
```
sysop@m01serv:~/software/test$ kubectl get apisixroute --all-namespaces
NAMESPACE NAME HOSTS URIS AGE
bookinfo productpage ["www2.m01.net"] ["/*"] 5h19m
sysop@m01serv:~/software/test$ date
mar 15 feb 2022, 19:34:21, CET
sysop@m01serv:~/software/test$ kubectl delete apisixroute productpage -n bookinfo
apisixroute.apisix.apache.org "productpage" deleted
sysop@m01serv:~/software/test$
```
Nothing appears in the ingress-controller log
```
2022-02-15T18:33:53.772Z | [GIN] 2022/02/16 - 02:33:53 | 200 | 17.1µs | 127.0.0.6 | GET "/healthz"
2022-02-15T18:34:03.772Z | [GIN] 2022/02/16 - 02:34:03 | 200 | 27.47µs | 127.0.0.6 | GET "/healthz"
2022-02-15T18:34:03.772Z | [GIN] 2022/02/16 - 02:34:03 | 200 | 28.34µs | 127.0.0.6 | GET "/healthz"
2022-02-15T18:34:13.773Z | [GIN] 2022/02/16 - 02:34:13 | 200 | 37.58µs | 127.0.0.6 | GET "/healthz"
2022-02-15T18:34:13.773Z | [GIN] 2022/02/16 - 02:34:13 | 200 | 20.22µs | 127.0.0.6 | GET "/healthz"
2022-02-15T18:34:23.772Z | [GIN] 2022/02/16 - 02:34:23 | 200 | 30.71µs | 127.0.0.6 | GET "/healthz"
2022-02-15T18:34:23.772Z | [GIN] 2022/02/16 - 02:34:23 | 200 | 29.34µs | 127.0.0.6 | GET "/healthz"
2022-02-15T18:34:33.772Z | [GIN] 2022/02/16 - 02:34:33 | 200 | 27.51µs | 127.0.0.6 | GET "/healthz"
2022-02-15T18:34:33.772Z | [GIN] 2022/02/16 - 02:34:33 | 200 | 12.57µs | 127.0.0.6 | GET "/healthz"
2022-02-15T18:34:43.772Z | [GIN] 2022/02/16 - 02:34:43 | 200 | 30.91µs | 127.0.0.6 | GET "/healthz"
2022-02-15T18:34:43.773Z | [GIN] 2022/02/16 - 02:34:43 | 200 | 31.64µs | 127.0.0.6 | GET "/healthz"
2022-02-15T18:34:53.772Z | [GIN] 2022/02/16 - 02:34:53 | 200 | 30.88µs | 127.0.0.6 | GET "/healthz"
2022-02-15T18:34:53.772Z | [GIN] 2022/02/16 - 02:34:53 | 200 | 43.06µs | 127.0.0.6 | GET "/healthz"
2022-02-15T18:35:03.772Z | [GIN] 2022/02/16 - 02:35:03 | 200 | 33.889µs | 127.0.0.6 | GET "/healthz"
2022-02-15T18:35:03.772Z | [GIN] 2022/02/16 - 02:35:03 | 200 | 101.16µs | 127.0.0.6 | GET "/healthz"
2022-02-15T18:35:13.772Z | [GIN] 2022/02/16 - 02:35:13 | 200 | 34.17µs | 127.0.0.6 | GET "/healthz"
```
In the apisix log appears the deletion
```
2022-02-15T18:35:36.230Z | 127.0.0.6 - - [15/Feb/2022:18:35:33 +0000] apisix-admin.apisix.svc.cluster.local:9180 "DELETE /apisix/admin/routes/72be264c HTTP/1.1" 200 90 0.009 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:35:36.230Z | 127.0.0.6 - - [15/Feb/2022:18:35:33 +0000] apisix-admin.apisix.svc.cluster.local:9180 "DELETE /apisix/admin/upstreams/49b914ed HTTP/1.1" 200 93 0.008 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
```
Then I stopped and started the cluster and I don't see anything wrong in the startup logs:
Apisix ingress controller log:
```
2022-02-15T18:54:44.164Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "kubernetes-dashboard_dashboard-metrics-scraper_8000"}
2022-02-15T18:54:44.166Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-operator_istio-operator_8383", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/6b312a6d", "cluster": "default"}
2022-02-15T18:54:44.166Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-operator_istio-operator_8383"}
2022-02-15T18:54:44.170Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "bookinfo_ratings_9080", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/4a5806af", "cluster": "default"}
2022-02-15T18:54:44.170Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "bookinfo_ratings_9080"}
2022-02-15T18:54:44.176Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "apisix_apisix-dashboard_80", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/6624cd4a", "cluster": "default"}
2022-02-15T18:54:44.176Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "apisix_apisix-dashboard_80"}
2022-02-15T18:54:44.179Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "test_httpbin_8000", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/d4c150ae", "cluster": "default"}
2022-02-15T18:54:44.179Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "test_httpbin_8000"}
2022-02-15T18:54:44.182Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_jaeger-collector_14268", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/b8ae0da0", "cluster": "default"}
2022-02-15T18:54:44.182Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-system_jaeger-collector_14268"}
2022-02-15T18:54:44.186Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_jaeger-collector_14250", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/9d58d651", "cluster": "default"}
2022-02-15T18:54:44.186Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-system_jaeger-collector_14250"}
2022-02-15T18:54:44.189Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_jaeger-collector_9411", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/6c3f31a6", "cluster": "default"}
2022-02-15T18:54:44.189Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-system_jaeger-collector_9411"}
2022-02-15T18:54:44.193Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "longhorn-system_csi-snapshotter_12345", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/97d053af", "cluster": "default"}
2022-02-15T18:54:44.193Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "longhorn-system_csi-snapshotter_12345"}
2022-02-15T18:54:44.196Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "kube-system_metrics-server_443", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/4a344633", "cluster": "default"}
2022-02-15T18:54:44.197Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "kube-system_metrics-server_443"}
2022-02-15T18:54:44.200Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_prometheus_9090", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/618bbe1f", "cluster": "default"}
2022-02-15T18:54:44.200Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-system_prometheus_9090"}
2022-02-15T18:54:44.203Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "bookinfo_productpage_9080", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/49b914ed", "cluster": "default"}
2022-02-15T18:54:44.203Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "bookinfo_productpage_9080"}
2022-02-15T18:54:44.206Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_kiali_20001", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/d751995a", "cluster": "default"}
2022-02-15T18:54:44.206Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-system_kiali_20001"}
2022-02-15T18:54:44.210Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_kiali_9090", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/55e2f8be", "cluster": "default"}
2022-02-15T18:54:44.210Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-system_kiali_9090"}
2022-02-15T18:54:44.214Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_zipkin_9411", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/c4c96c99", "cluster": "default"}
2022-02-15T18:54:44.214Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-system_zipkin_9411"}
2022-02-15T18:54:44.217Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "kubernetes-dashboard_kubernetes-dashboard_443", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/7dc55665", "cluster": "default"}
2022-02-15T18:54:44.217Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "kubernetes-dashboard_kubernetes-dashboard_443"}
2022-02-15T18:54:44.220Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_grafana_3000", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/256603fb", "cluster": "default"}
2022-02-15T18:54:44.220Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-system_grafana_3000"}
2022-02-15T18:54:44.224Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "longhorn-system_longhorn-frontend_80", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/d07916d6", "cluster": "default"}
2022-02-15T18:54:44.224Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "longhorn-system_longhorn-frontend_80"}
2022-02-15T18:54:44.227Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "bookinfo_reviews_9080", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/c4c02588", "cluster": "default"}
2022-02-15T18:54:44.227Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "bookinfo_reviews_9080"}
2022-02-15T18:54:44.230Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "apisix_apisix-gateway_80", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/93400b20", "cluster": "default"}
2022-02-15T18:54:44.230Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "apisix_apisix-gateway_80"}
2022-02-15T18:54:44.234Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "apisix_apisix-gateway_443", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/3b59d238", "cluster": "default"}
2022-02-15T18:54:44.234Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "apisix_apisix-gateway_443"}
2022-02-15T18:54:44.237Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "apisix_apisix-ingress-controller_80", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/b1bea59", "cluster": "default"}
2022-02-15T18:54:44.237Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "apisix_apisix-ingress-controller_80"}
2022-02-15T18:54:44.241Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "kube-system_kube-dns_53", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/f3118c88", "cluster": "default"}
2022-02-15T18:54:44.241Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "kube-system_kube-dns_53"}
2022-02-15T18:54:44.245Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "kube-system_kube-dns_53", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/f3118c88", "cluster": "default"}
2022-02-15T18:54:44.245Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "kube-system_kube-dns_53"}
2022-02-15T18:54:44.248Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "kube-system_kube-dns_9153", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/23ef4d0", "cluster": "default"}
2022-02-15T18:54:44.248Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "kube-system_kube-dns_9153"}
2022-02-15T18:54:44.252Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "default_kubernetes_443", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/606b3be0", "cluster": "default"}
2022-02-15T18:54:44.252Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "default_kubernetes_443"}
2022-02-15T18:54:44.255Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "kube-system_docker-registry_5000", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/6cec0f18", "cluster": "default"}
2022-02-15T18:54:44.255Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "kube-system_docker-registry_5000"}
2022-02-15T18:54:44.258Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "apisix_apisix-etcd_2379", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/ba31b611", "cluster": "default"}
2022-02-15T18:54:44.258Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "apisix_apisix-etcd_2379"}
2022-02-15T18:54:44.262Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "apisix_apisix-etcd_2380", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/4475127a", "cluster": "default"}
2022-02-15T18:54:44.262Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "apisix_apisix-etcd_2380"}
2022-02-15T18:54:44.264Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "apisix_apisix-admin_9180", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/930895ff", "cluster": "default"}
2022-02-15T18:54:44.264Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "apisix_apisix-admin_9180"}
2022-02-15T18:54:44.266Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_tracing_80", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/b699da65", "cluster": "default"}
2022-02-15T18:54:44.266Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-system_tracing_80"}
2022-02-15T18:54:44.269Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_tracing_16685", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/ae80a4d", "cluster": "default"}
2022-02-15T18:54:44.269Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-system_tracing_16685"}
2022-02-15T18:54:44.272Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "longhorn-system_csi-attacher_12345", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/ee03afe2", "cluster": "default"}
2022-02-15T18:54:44.272Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "longhorn-system_csi-attacher_12345"}
2022-02-15T18:54:44.275Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "bookinfo_details_9080", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/aabec2ca", "cluster": "default"}
2022-02-15T18:54:44.275Z | 2022-02-16T02:54:44+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "bookinfo_details_9080"}
2022-02-15T18:54:45.694Z | [GIN] 2022/02/16 - 02:54:45 | 200 | 37.279µs | 127.0.0.6 | GET "/healthz"
2022-02-15T18:54:54.103Z | [GIN] 2022/02/16 - 02:54:54 | 200 | 32.469µs | 127.0.0.6 | GET "/healthz"
2022-02-15T18:54:55.694Z | [GIN] 2022/02/16 - 02:54:55 | 200 | 46.8µs | 127.0.0.6 | GET "/healthz"
2022-02-15T18:55:04.102Z | [GIN] 2022/02/16 - 02:55:04 | 200 | 35.11µs | 127.0.0.6 | GET "/healthz"
```
Apisix log
```
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:41 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/routes HTTP/1.1" 200 94 0.020 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:41 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/schema//plugins/real-ip HTTP/1.1" 200 773 0.000 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:41 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/schema//plugins/zipkin HTTP/1.1" 200 577 0.000 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:41 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/schema//plugins/request-id HTTP/1.1" 200 321 0.000 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:41 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/schema//plugins/fault-injection HTTP/1.1" 200 653 0.000 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:41 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/schema//plugins/serverless-pre-function HTTP/1.1" 200 350 0.000 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:41 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/schema//plugins/batch-requests HTTP/1.1" 200 132 0.000 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:41 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/schema//plugins/cors HTTP/1.1" 200 1851 0.000 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:41 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/ssl HTTP/1.1" 200 91 0.004 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:41 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/stream_routes HTTP/1.1" 200 101 0.002 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:41 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/schema//plugins/basic-auth HTTP/1.1" 200 230 0.000 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:41 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/schema//plugins/jwt-auth HTTP/1.1" 200 132 0.000 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:41 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/schema//plugins/key-auth HTTP/1.1" 200 223 0.000 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:41 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/schema//plugins/consumer-restriction HTTP/1.1" 200 843 0.000 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:41 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/consumers HTTP/1.1" 200 97 0.002 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:41 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/plugin_configs HTTP/1.1" 200 102 0.001 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:41 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/schema//plugins/limit-count HTTP/1.1" 200 1554 0.000 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:41 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/schema//plugins/limit-req HTTP/1.1" 200 577 0.000 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:41 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/schema//plugins/node-status HTTP/1.1" 200 132 0.000 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:41 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/schema//plugins/gzip HTTP/1.1" 200 645 0.000 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:41 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/schema//plugins/traffic-split HTTP/1.1" 200 6091 0.000 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:41 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/schema//plugins/redirect HTTP/1.1" 200 805 0.000 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:41 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/schema//plugins/response-rewrite HTTP/1.1" 200 559 0.000 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:41 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/schema//plugins/grpc-transcode HTTP/1.1" 200 1091 0.000 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:41 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/schema//plugins/prometheus HTTP/1.1" 200 181 0.000 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:41 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/schema//plugins/echo HTTP/1.1" 200 573 0.000 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:41 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/schema//plugins/http-logger HTTP/1.1" 200 970 0.000 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:41 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/schema//plugins/sls-logger HTTP/1.1" 200 860 0.000 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:41 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/schema//plugins/tcp-logger HTTP/1.1" 200 759 0.000 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:41 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/schema//plugins/kafka-logger HTTP/1.1" 200 1348 0.000 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:41 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/schema//plugins/syslog HTTP/1.1" 200 1065 0.000 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:41 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/schema//plugins/udp-logger HTTP/1.1" 200 683 0.000 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:41 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/schema//plugins/serverless-post-function HTTP/1.1" 200 350 0.000 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:43 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/routes HTTP/1.1" 200 94 0.008 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:43 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/stream_routes HTTP/1.1" 200 101 0.004 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:43 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/upstreams HTTP/1.1" 200 564 0.002 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:43 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/ssl HTTP/1.1" 200 91 0.004 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:43 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/consumers HTTP/1.1" 200 97 0.002 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:43 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/plugin_configs HTTP/1.1" 200 102 0.004 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:44 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/upstreams/861f0648 HTTP/1.1" 404 39 0.004 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:44 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/upstreams/68116764 HTTP/1.1" 404 39 0.003 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:44 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/upstreams/3bd1b5fa HTTP/1.1" 404 39 0.005 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:44 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/upstreams/8172c251 HTTP/1.1" 404 39 0.002 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:44 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/upstreams/6d394703 HTTP/1.1" 404 39 0.003 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:44 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/upstreams/29267f16 HTTP/1.1" 404 39 0.003 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
2022-02-15T18:54:44.246Z | 127.0.0.6 - - [15/Feb/2022:18:54:44 +0000] apisix-admin.apisix.svc.cluster.local:9180 "GET /apisix/admin/upstreams/2ceb1990 HTTP/1.1" 404 39 0.003 "-" "Go-http-client/1.1" - - - "http://apisix-admin.apisix.svc.cluster.local:9180"
```
Now I'll try to define again the route and verify the service address survives at least 6 cluster restart
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] tao12345666333 commented on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
tao12345666333 commented on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1039780815
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] MirtoBusico commented on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
MirtoBusico commented on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1040189346
> > The warning in the log still complains the v2beta1 version
>
> @MirtoBusico This is a configuration item, in configmap. It can be changed at values.yaml https://github.com/apache/apisix-helm-chart/blob/051998d8cc1816674fcbc3c8029f9e7d1330e3d5/charts/apisix-ingress-controller/values.yaml#L113-L115
Thens @tao12345666333
Now I'll reinstall with (if I understand correctly)
```
helm install apisix apisix/apisix -f apisix-values.yaml \
--set ingress-controller.config.apisix.serviceNamespace=apisix \
--set ingress-controller.config.apisix.serviceName=apisix-admin \
--set ingress-controller.config.kubernetes.apisixRouteVersion=apisix.apache.org/v2beta3 \
--namespace apisix
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] MirtoBusico commented on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
MirtoBusico commented on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1037340275
Hi @liangyuanpeng with this chart it seems to work
The delete route command (timestam in Rome time thea are UTC+1 - So in apisix log look for 17 instead of 18)
```
sysop@m01serv:~/software/apisisx$ kubectl get apisixroute -n bookinfo
NAME HOSTS URIS AGE
productpage ["www2.m01.net"] ["/*"] 22h
sysop@m01serv:~/software/apisisx$ kubectl delete apisixroute productpage -n bookinfo
apisixroute.apisix.apache.org "productpage" deleted
sysop@m01serv:~/software/apisisx$ date
sab 12 feb 2022, 18:31:10, CET
sysop@m01serv:~/software/apisisx$
```
The apisix ingress controller log (nothing appear here)
```
2022-02-12T17:30:36.560Z | [GIN] 2022/02/13 - 01:30:36 | 200 | 31.21µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:30:41.352Z | [GIN] 2022/02/13 - 01:30:41 | 200 | 43.929µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:30:46.559Z | [GIN] 2022/02/13 - 01:30:46 | 200 | 40.559µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:30:51.352Z | [GIN] 2022/02/13 - 01:30:51 | 200 | 35.86µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:30:56.558Z | [GIN] 2022/02/13 - 01:30:56 | 200 | 34.359µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:31:01.352Z | [GIN] 2022/02/13 - 01:31:01 | 200 | 29.04µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:31:06.560Z | [GIN] 2022/02/13 - 01:31:06 | 200 | 40.28µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:31:11.352Z | [GIN] 2022/02/13 - 01:31:11 | 200 | 37.56µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:31:16.559Z | [GIN] 2022/02/13 - 01:31:16 | 200 | 36.14µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:31:21.352Z | [GIN] 2022/02/13 - 01:31:21 | 200 | 29.45µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:31:26.559Z | [GIN] 2022/02/13 - 01:31:26 | 200 | 30.51µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:31:31.353Z | [GIN] 2022/02/13 - 01:31:31 | 200 | 33.74µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:31:36.559Z | [GIN] 2022/02/13 - 01:31:36 | 200 | 29.13µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:31:41.352Z | [GIN] 2022/02/13 - 01:31:41 | 200 | 40.02µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:31:46.559Z | [GIN] 2022/02/13 - 01:31:46 | 200 | 30.469µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:31:51.352Z | [GIN] 2022/02/13 - 01:31:51 | 200 | 45.11µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:31:56.559Z | [GIN] 2022/02/13 - 01:31:56 | 200 | 30.39µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:32:01.353Z | [GIN] 2022/02/13 - 01:32:01 | 200 | 36.09µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:32:06.559Z | [GIN] 2022/02/13 - 01:32:06 | 200 | 33.08µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:32:11.352Z | [GIN] 2022/02/13 - 01:32:11 | 200 | 28.96µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:32:16.559Z | [GIN] 2022/02/13 - 01:32:16 | 200 | 33.39µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:32:21.115Z | W0213 01:32:21.115801 1 warnings.go:70] apisix.apache.org/v2beta1 ApisixRoute is deprecated; use apisix.apache.org/v2beta3 ApisixRoute
2022-02-12T17:32:21.352Z | [GIN] 2022/02/13 - 01:32:21 | 200 | 29.149µs | 127.0.0.6 | GET "/healthz"
```
In the apisix dasboard the route and upstream disappeared as expected
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] MirtoBusico commented on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
MirtoBusico commented on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1037349675
Recreated the route using v2beta3
```
apiVersion: apisix.apache.org/v2beta3
kind: ApisixRoute
metadata:
name: productpage
spec:
http:
- name: rule1
match:
hosts:
- www2.m01.net
paths:
- /*
backends:
- serviceName: productpage
servicePort: 9080
resolveGranularity: service
```
Installed with
```
sysop@m01serv:~/software/apisisx$ kubectl -n bookinfo apply -f productpage-ar.yaml
apisixroute.apisix.apache.org/productpage created
sysop@m01serv:~/software/apisisx$ date
sab 12 feb 2022, 18:43:37, CET
sysop@m01serv:~/software/apisisx$
```
The warning in the log still complains the **v2beta1** version
```
2022-02-12T17:42:36.559Z | [GIN] 2022/02/13 - 01:42:36 | 200 | 36.86µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:42:41.352Z | [GIN] 2022/02/13 - 01:42:41 | 200 | 41.27µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:42:46.558Z | [GIN] 2022/02/13 - 01:42:46 | 200 | 33.53µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:42:47.785Z | W0213 01:42:47.785053 1 warnings.go:70] apisix.apache.org/v2beta1 ApisixRoute is deprecated; use apisix.apache.org/v2beta3 ApisixRoute
2022-02-12T17:42:51.352Z | [GIN] 2022/02/13 - 01:42:51 | 200 | 29.54µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:42:56.559Z | [GIN] 2022/02/13 - 01:42:56 | 200 | 34.069µs | 127.0.0.6 | GET "/healthz"ù
...
2022-02-12T17:48:36.559Z | [GIN] 2022/02/13 - 01:48:36 | 200 | 38.13µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:48:41.118Z | W0213 01:48:41.118713 1 warnings.go:70] apisix.apache.org/v2beta1 ApisixRoute is deprecated; use apisix.apache.org/v2beta3 ApisixRoute
2022-02-12T17:48:41.352Z | [GIN] 2022/02/13 - 01:48:41 | 200 | 24.85µs | 127.0.0.6 | GET "/healthz"
```
The route correctly point to the Service address
<img width="1709" alt="v2beta3-route-defined" src="https://user-images.githubusercontent.com/11090934/153722325-229bdfbc-a572-4932-acc8-8f16d3b95ad9.png">
Now I'll try some cluster restarts to se if the address changes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] MirtoBusico commented on issue #853: bug: creating a route with yaml file generates a wrong upstrem: pod address instead of service address
Posted by GitBox <gi...@apache.org>.
MirtoBusico commented on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1030905233
**SOLVED**
Found solution at [Service Resolution Granularity](https://apisix.apache.org/docs/ingress-controller/concepts/apisix_route/)
Adding
```
resolveGranularity: service
```
creates an upstream with the service address
Now the route definition is
```
apiVersion: apisix.apache.org/v2beta2
kind: ApisixRoute
metadata:
name: productpage
spec:
http:
- name: rule1
match:
hosts:
- www2.m01.net
paths:
- /*
backends:
- serviceName: productpage
servicePort: 9080
resolveGranularity: service
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] tao12345666333 commented on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
tao12345666333 commented on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1031228421
@MirtoBusico good job :+1: I edited the title to make it more clear
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] MirtoBusico edited a comment on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
MirtoBusico edited a comment on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1037349675
Hi @tao12345666333
Recreated the route using v2beta3
```
apiVersion: apisix.apache.org/v2beta3
kind: ApisixRoute
metadata:
name: productpage
spec:
http:
- name: rule1
match:
hosts:
- www2.m01.net
paths:
- /*
backends:
- serviceName: productpage
servicePort: 9080
resolveGranularity: service
```
Installed with
```
sysop@m01serv:~/software/apisisx$ kubectl -n bookinfo apply -f productpage-ar.yaml
apisixroute.apisix.apache.org/productpage created
sysop@m01serv:~/software/apisisx$ date
sab 12 feb 2022, 18:43:37, CET
sysop@m01serv:~/software/apisisx$
```
The warning in the log still complains the **v2beta1** version
```
2022-02-12T17:42:36.559Z | [GIN] 2022/02/13 - 01:42:36 | 200 | 36.86µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:42:41.352Z | [GIN] 2022/02/13 - 01:42:41 | 200 | 41.27µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:42:46.558Z | [GIN] 2022/02/13 - 01:42:46 | 200 | 33.53µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:42:47.785Z | W0213 01:42:47.785053 1 warnings.go:70] apisix.apache.org/v2beta1 ApisixRoute is deprecated; use apisix.apache.org/v2beta3 ApisixRoute
2022-02-12T17:42:51.352Z | [GIN] 2022/02/13 - 01:42:51 | 200 | 29.54µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:42:56.559Z | [GIN] 2022/02/13 - 01:42:56 | 200 | 34.069µs | 127.0.0.6 | GET "/healthz"ù
...
2022-02-12T17:48:36.559Z | [GIN] 2022/02/13 - 01:48:36 | 200 | 38.13µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:48:41.118Z | W0213 01:48:41.118713 1 warnings.go:70] apisix.apache.org/v2beta1 ApisixRoute is deprecated; use apisix.apache.org/v2beta3 ApisixRoute
2022-02-12T17:48:41.352Z | [GIN] 2022/02/13 - 01:48:41 | 200 | 24.85µs | 127.0.0.6 | GET "/healthz"
```
The route correctly point to the Service address
<img width="1709" alt="v2beta3-route-defined" src="https://user-images.githubusercontent.com/11090934/153722325-229bdfbc-a572-4932-acc8-8f16d3b95ad9.png">
Now I'll try some cluster restarts to see if the address changes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] MirtoBusico commented on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
MirtoBusico commented on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1040277232
Hi @tao12345666333 I've reinstalled apisix with these changes in values.yaml:
```
...
gateway:
type: LoadBalancer
...
tls:
enabled: true
servicePort: 443
containerPort: 9443
existingCASecret: "m01cacert"
certCAFilename: "cert"
http2:
enabled: true
...
discovery:
enabled: true
registry:
dns:
servers:
- "10.43.0.10:53"
...
dashboard:
enabled: true
ingress-controller:
enabled: true
```
And installed with:
```
kubectl create ns apisix
kubectl label namespace apisix istio-injection=enabled
helm install apisix apisix/apisix -f apisix-values.yaml \
--set ingress-controller.config.apisix.serviceNamespace=apisix \
--set ingress-controller.config.apisix.serviceName=apisix-admin \
--set ingress-controller.config.kubernetes.apisixRouteVersion=apisix.apache.org/v2beta3 \
--namespace apisix
```
Created a route with:
```
apiVersion: apisix.apache.org/v2beta3
kind: ApisixRoute
metadata:
name: productpage
spec:
http:
- name: rule1
match:
hosts:
- www2.m01.net
paths:
- /*
backends:
- serviceName: productpage
servicePort: 9080
resolveGranularity: service
```
Using the command:
```
kubectl -n bookinfo apply -f productpage-ar.yaml
```
The route is created with the service address
Nothing appears about route creation in apisix-ingres-controller log:
```
2022-02-15T13:20:13.772Z | [GIN] 2022/02/15 - 21:20:13 | 200 | 31.747µs | 127.0.0.6 | GET "/healthz"
2022-02-15T13:20:13.773Z | [GIN] 2022/02/15 - 21:20:13 | 200 | 33.197µs | 127.0.0.6 | GET "/healthz"
2022-02-15T13:20:23.772Z | [GIN] 2022/02/15 - 21:20:23 | 200 | 40.887µs | 127.0.0.6 | GET "/healthz"
```
The command executed op apisix pod (using the upstream_id from apisix dashboard) says
```
bash-5.1# curl http://127.0.0.1:9180/apisix/admin/upstreams/49b914ed -H 'X-API-KEY: edd1c9f034335f136f87ad84b625c8f1' -X GET
{"action":"get","count":1,"node":{"key":"\/apisix\/upstreams\/49b914ed","value":{"labels":{"managed-by":"apisix-ingress-controller"},"scheme":"http","name":"bookinfo_productpage_9080","update_time":1644930766,"hash_on":"vars","desc":"Created by apisix-ingress-controller, DO NOT modify it manually","type":"roundrobin","nodes":[{"weight":100,"port":9080,"priority":0,"host":"10.43.189.220"}],"id":"49b914ed","pass_host":"pass","create_time":1644930766}}}
bash-5.1#
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] tao12345666333 commented on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
tao12345666333 commented on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1041006182
> Thanks for the detailed report, I have been able to reproduce this issue. i will fix it.
For this bug, we can use #870 to track.
> Then I stopped and started the cluster and I don't see anything wrong in the startup logs
> Now I'll try to define again the route and verify the service address survives at least 6 cluster restart
If you find another error log, please update it at any time.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] MirtoBusico commented on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
MirtoBusico commented on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1031730372
@tao12345666333 Thanks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] MirtoBusico commented on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
MirtoBusico commented on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1034071790
Hi @tao12345666333 I don't know if it is related, but if you delete an apisixroute, it results deleted for kubernetes but is still alive in apisix-dashboard.
First I deleted the route and waited for one hour and half
<img width="783" alt="ksnip_20220209-192544" src="https://user-images.githubusercontent.com/11090934/153266401-18853ea6-a881-4e21-ae1f-418b29520891.png">
Then I looked at upstream list in apisix-dashboard and the upstream (and route) is still there
<img width="1722" alt="ksnip_20220209-192401" src="https://user-images.githubusercontent.com/11090934/153266547-1cc5d03d-31fe-4626-a00b-5d6f11bee80d.png">
Seems that kubernetes and apisix will never be synced.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] apit commented on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
apit commented on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1037730626
@MirtoBusico @tao12345666333 wouldn't apisix controller watch services so recreating cluster, in case of granularity is not service, new pod ip will be reflected in the apisixroute config?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] apit commented on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
apit commented on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1037730626
@MirtoBusico @tao12345666333 wouldn't apisix controller watch services so recreating cluster, in case of granularity is not service, new pod ip will be reflected in the apisixroute config?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] MirtoBusico commented on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
MirtoBusico commented on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1037286073
Hi @apit my use case is:
- a portable (must run on a notebook) kubernetes cluster that should work also in airgapped site
- security, authentication, networking and telemetry outside the microservices I'll develop
- a virtual machine for services (DNS, Keycloak, etc...) and a 3 node cluster on virtual machines running K3S
In this scenatio I access sevices using the /etc/host file for external machines and DNS in the services virtual machine for itself and the 3 node cluster
Every day I start the cluster and the supporting VM and every night shutdown the cluster and the supporting virtual machines
Using NodePort the gateway not always start on the same node and in this case I have to change the /etc/host file and the DNS tables
Using LoadBalancer the address used is always valid
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] liangyuanpeng commented on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
liangyuanpeng commented on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1035936850
> but if you delete an apisixroute, it results deleted for kubernetes
it's absolutely weird, how can we reproduce it?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] MirtoBusico edited a comment on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
MirtoBusico edited a comment on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1037349675
Hi @tao12345666333
Recreated the route using v2beta3
```
apiVersion: apisix.apache.org/v2beta3
kind: ApisixRoute
metadata:
name: productpage
spec:
http:
- name: rule1
match:
hosts:
- www2.m01.net
paths:
- /*
backends:
- serviceName: productpage
servicePort: 9080
resolveGranularity: service
```
Installed with
```
sysop@m01serv:~/software/apisisx$ kubectl -n bookinfo apply -f productpage-ar.yaml
apisixroute.apisix.apache.org/productpage created
sysop@m01serv:~/software/apisisx$ date
sab 12 feb 2022, 18:43:37, CET
sysop@m01serv:~/software/apisisx$
```
The warning in the log still complains the **v2beta1** version
```
2022-02-12T17:42:36.559Z | [GIN] 2022/02/13 - 01:42:36 | 200 | 36.86µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:42:41.352Z | [GIN] 2022/02/13 - 01:42:41 | 200 | 41.27µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:42:46.558Z | [GIN] 2022/02/13 - 01:42:46 | 200 | 33.53µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:42:47.785Z | W0213 01:42:47.785053 1 warnings.go:70] apisix.apache.org/v2beta1 ApisixRoute is deprecated; use apisix.apache.org/v2beta3 ApisixRoute
2022-02-12T17:42:51.352Z | [GIN] 2022/02/13 - 01:42:51 | 200 | 29.54µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:42:56.559Z | [GIN] 2022/02/13 - 01:42:56 | 200 | 34.069µs | 127.0.0.6 | GET "/healthz"ù
...
2022-02-12T17:48:36.559Z | [GIN] 2022/02/13 - 01:48:36 | 200 | 38.13µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:48:41.118Z | W0213 01:48:41.118713 1 warnings.go:70] apisix.apache.org/v2beta1 ApisixRoute is deprecated; use apisix.apache.org/v2beta3 ApisixRoute
2022-02-12T17:48:41.352Z | [GIN] 2022/02/13 - 01:48:41 | 200 | 24.85µs | 127.0.0.6 | GET "/healthz"
```
The route correctly point to the Service address
<img width="1709" alt="v2beta3-route-defined" src="https://user-images.githubusercontent.com/11090934/153722325-229bdfbc-a572-4932-acc8-8f16d3b95ad9.png">
Now I'll try some cluster restarts to see if the address changes
**UPDATE**
After the first restart the route address seems correct but the apisix ingress controller started to signal errors:
```
2022-02-12T18:57:43.978Z | 2022-02-13T02:57:43+08:00 [31merror[0m apisix/cluster.go:213 failed to list upstreams in APISIX: unexpected non-empty object
2022-02-12T18:57:43.978Z | 2022-02-13T02:57:43+08:00 [31merror[0m apisix/cluster.go:168 failed to sync cache {"cost_time": "8.04132023s", "cluster": "default"}
2022-02-12T18:57:43.978Z | 2022-02-13T02:57:43+08:00 [31merror[0m ingress/controller.go:436 failed to wait the default cluster to be ready: unexpected non-empty object
2022-02-12T18:57:43.979Z | 2022-02-13T02:57:43+08:00 [34minfo[0m apisix/cluster.go:158 syncing cache {"cluster": "default"}
2022-02-12T18:57:43.979Z | 2022-02-13T02:57:43+08:00 [31merror[0m apisix/route.go:119 failed to list routes: Get "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/routes": context canceled
2022-02-12T18:57:43.979Z | 2022-02-13T02:57:43+08:00 [34minfo[0m apisix/cluster.go:370 syncing schema {"cluster": "default"}
2022-02-12T18:57:43.979Z | 2022-02-13T02:57:43+08:00 [31merror[0m apisix/cluster.go:208 failed to list routes in APISIX: Get "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/routes": context canceled
2022-02-12T18:57:43.979Z | 2022-02-13T02:57:43+08:00 [31merror[0m apisix/cluster.go:168 failed to sync cache {"cost_time": "80.459µs", "cluster": "default"}
2022-02-12T18:57:43.979Z | 2022-02-13T02:57:43+08:00 [31merror[0m apisix/plugin.go:46 failed to list plugins' names: Get "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/plugins/list": context canceled
2022-02-12T18:57:43.979Z | 2022-02-13T02:57:43+08:00 [31merror[0m apisix/cluster.go:390 failed to list plugin names in APISIX: Get "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/plugins/list": context canceled
2022-02-12T18:57:43.979Z | 2022-02-13T02:57:43+08:00 [31merror[0m apisix/cluster.go:353 failed to sync schema: Get "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/plugins/list": context canceled
2022-02-12T18:57:43.979Z | 2022-02-13T02:57:43+08:00 [34minfo[0m ingress/controller.go:372 controller now is running as a candidate {"namespace": "apisix", "pod": "apisix-ingress-controller-6846db58b8-lsv6g"}
2022-02-12T18:57:43.979Z | I0213 02:57:43.979480 1 leaderelection.go:248] attempting to acquire leader lease apisix/ingress-apisix-leader...
2022-02-12T18:57:43.982Z | 2022-02-13T02:57:43+08:00 [34minfo[0m ingress/controller.go:320 LeaderElection {"message": "apisix-ingress-controller-6846db58b8-lsv6g became leader", "event_type": "Normal"}
2022-02-12T18:57:43.982Z | I0213 02:57:43.982706 1 leaderelection.go:258] successfully acquired lease apisix/ingress-apisix-leader
2022-02-12T18:57:43.982Z | 2022-02-13T02:57:43+08:00 [34minfo[0m ingress/controller.go:409 controller tries to leading ... {"namespace": "apisix", "pod": "apisix-ingress-controller-6846db58b8-lsv6g"}
2022-02-12T18:57:43.982Z | 2022-02-13T02:57:43+08:00 [33mwarn[0m apisix/cluster.go:330 waiting cluster default to ready, it may takes a while
2022-02-12T18:57:43.983Z | 2022-02-13T02:57:43+08:00 [34minfo[0m apisix/cluster.go:370 syncing schema {"cluster": "default"}
2022-02-12T18:57:43.983Z | 2022-02-13T02:57:43+08:00 [34minfo[0m apisix/cluster.go:158 syncing cache {"cluster": "default"}
2022-02-12T18:57:43.990Z | 2022-02-13T02:57:43+08:00 [31merror[0m apisix/upstream.go:122 failed to convert upstream item {"url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams", "upstream_key": "/apisix/upstreams/394532502988915297", "error": "unexpected non-empty object"}
2022-02-12T18:57:43.990Z | 2022-02-13T02:57:43+08:00 [31merror[0m apisix/cluster.go:213 failed to list upstreams in APISIX: unexpected non-empty object
2022-02-12T18:57:46.000Z | 2022-02-13T02:57:46+08:00 [31merror[0m apisix/upstream.go:122 failed to convert upstream item {"url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams", "upstream_key": "/apisix/upstreams/394532502988915297", "error": "unexpected non-empty object"}
2022-02-12T18:57:46.000Z | 2022-02-13T02:57:46+08:00 [31merror[0m apisix/cluster.go:213 failed to list upstreams in APISIX: unexpected non-empty object
2022-02-12T18:57:47.712Z | [GIN] 2022/02/13 - 02:57:47 | 200 | 33.75µs | 127.0.0.6 | GET "/healthz"
2022-02-12T18:57:48.014Z | 2022-02-13T02:57:48+08:00 [31merror[0m apisix/upstream.go:122 failed to convert upstream item {"url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams", "upstream_key": "/apisix/upstreams/394532502988915297", "error": "unexpected non-empty object"}
2022-02-12T18:57:48.014Z | 2022-02-13T02:57:48+08:00 [31merror[0m apisix/cluster.go:213 failed to list upstreams in APISIX: unexpected non-empty object
2022-02-12T18:57:48.929Z | [GIN] 2022/02/13 - 02:57:48 | 200 | 35.1µs | 127.0.0.6 | GET "/healthz"
2022-02-12T18:57:50.026Z | 2022-02-13T02:57:50+08:00 [31merror[0m apisix/upstream.go:122 failed to convert upstream item {"url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams", "upstream_key": "/apisix/upstreams/394532502988915297", "error": "unexpected non-empty object"}
2022-02-12T18:57:50.026Z | 2022-02-13T02:57:50+08:00 [31merror[0m apisix/cluster.go:213 failed to list upstreams in APISIX: unexpected non-empty object
2022-02-12T18:57:52.042Z | 2022-02-13T02:57:52+08:00 [31merror[0m apisix/upstream.go:122 failed to convert upstream item {"url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams", "upstream_key": "/apisix/upstreams/394532502988915297", "error": "unexpected non-empty object"}
2022-02-12T18:57:52.042Z | 2022-02-13T02:57:52+08:00 [31merror[0m apisix/cluster.go:213 failed to list upstreams in APISIX: unexpected non-empty object
2022-02-12T18:57:52.042Z | 2022-02-13T02:57:52+08:00 [31merror[0m apisix/cluster.go:168 failed to sync cache {"cost_time": "8.05881925s", "cluster": "default"}
2022-02-12T18:57:52.042Z | 2022-02-13T02:57:52+08:00 [31merror[0m ingress/controller.go:436 failed to wait the default cluster to be ready: unexpected non-empty object
2022-02-12T18:57:52.042Z | 2022-02-13T02:57:52+08:00 [34minfo[0m ingress/controller.go:372 controller now is running as a candidate {"namespace": "apisix", "pod": "apisix-ingress-controller-6846db58b8-lsv6g"}
2022-02-12T18:57:52.042Z | I0213 02:57:52.042336 1 leaderelection.go:248] attempting to acquire leader lease apisix/ingress-apisix-leader...
2022-02-12T18:57:52.042Z | 2022-02-13T02:57:52+08:00 [34minfo[0m apisix/cluster.go:370 syncing schema {"cluster": "default"}
2022-02-12T18:57:52.042Z | 2022-02-13T02:57:52+08:00 [34minfo[0m apisix/cluster.go:158 syncing cache {"cluster": "default"}
2022-02-12T18:57:52.042Z | 2022-02-13T02:57:52+08:00 [31merror[0m apisix/plugin.go:46 failed to list plugins' names: Get "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/plugins/list": context canceled
2022-02-12T18:57:52.042Z | 2022-02-13T02:57:52+08:00 [31merror[0m apisix/cluster.go:390 failed to list plugin names in APISIX: Get "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/plugins/list": context canceled
2022-02-12T18:57:52.042Z | 2022-02-13T02:57:52+08:00 [31merror[0m apisix/cluster.go:353 failed to sync schema: Get "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/plugins/list": context canceled
2022-02-12T18:57:52.042Z | 2022-02-13T02:57:52+08:00 [31merror[0m apisix/route.go:119 failed to list routes: Get "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/routes": context canceled
2022-02-12T18:57:52.042Z | 2022-02-13T02:57:52+08:00 [31merror[0m apisix/cluster.go:208 failed to list routes in APISIX: Get "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/routes": context canceled
2022-02-12T18:57:52.042Z | 2022-02-13T02:57:52+08:00 [31merror[0m apisix/cluster.go:168 failed to sync cache {"cost_time": "79.919µs", "cluster": "default"}
2022-02-12T18:57:52.047Z | 2022-02-13T02:57:52+08:00 [34minfo[0m ingress/controller.go:320 LeaderElection {"message": "apisix-ingress-controller-6846db58b8-lsv6g became leader", "event_type": "Normal"}
2022-02-12T18:57:52.047Z | I0213 02:57:52.047247 1 leaderelection.go:258] successfully acquired lease apisix/ingress-apisix-leader
2022-02-12T18:57:52.047Z | 2022-02-13T02:57:52+08:00 [34minfo[0m ingress/controller.go:409 controller tries to leading ... {"namespace": "apisix", "pod": "apisix-ingress-controller-6846db58b8-lsv6g"}
2022-02-12T18:57:52.047Z | 2022-02-13T02:57:52+08:00 [33mwarn[0m apisix/cluster.go:330 waiting cluster default to ready, it may takes a while
2022-02-12T18:57:52.047Z | 2022-02-13T02:57:52+08:00 [34minfo[0m apisix/cluster.go:158 syncing cache {"cluster": "default"}
2022-02-12T18:57:52.047Z | 2022-02-13T02:57:52+08:00 [34minfo[0m apisix/cluster.go:370 syncing schema {"cluster": "default"}
2022-02-12T18:57:52.059Z | 2022-02-13T02:57:52+08:00 [31merror[0m apisix/upstream.go:122 failed to convert upstream item {"url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams", "upstream_key": "/apisix/upstreams/394532502988915297", "error": "unexpected non-empty object"}
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] apit commented on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
apit commented on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1037054266
what's the use case for this? is it to let k8s handle the load balance?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] tao12345666333 commented on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
tao12345666333 commented on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1039780815
I will come to confirm this today.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] tao12345666333 closed issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
tao12345666333 closed issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] tao12345666333 commented on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
tao12345666333 commented on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1033059652
thank you for your message. let me confirm again.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] MirtoBusico commented on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
MirtoBusico commented on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1032916023
@tao12345666333 Sorry it is a real bug. Please reopen
After three or four times that I restart the cluster (it is a lab framework: start on the morning and shutdown on the night) the route takes a POD address again.
The same framework used in my previous reply now shows:
Route definition, service addresses and pod addresses
```
sysop@m01serv:~/software/apisisx$ cat productpage-ar.yaml
apiVersion: apisix.apache.org/v2beta2
kind: ApisixRoute
metadata:
name: productpage
spec:
http:
- name: rule1
match:
hosts:
- www2.m01.net
paths:
- /*
backends:
- serviceName: productpage
servicePort: 9080
resolveGranularity: service
sysop@m01serv:~/software/apisisx$ kubectl get svc -n bookinfo
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
details ClusterIP 10.43.230.138 <none> 9080/TCP 13d
ratings ClusterIP 10.43.16.57 <none> 9080/TCP 13d
reviews ClusterIP 10.43.236.52 <none> 9080/TCP 13d
productpage ClusterIP 10.43.189.220 <none> 9080/TCP 13d
sysop@m01serv:~/software/apisisx$
sysop@m01serv:~/software/apisisx$ kubectl get pods -n bookinfo -o wide
NAME READY STATUS RESTARTS AGE IP NODE NOMINATED NODE READINESS GATES
reviews-v3-5cddf46b56-x2hbz 2/2 Running 10 (9h ago) 9d 10.42.2.210 m01kw2 <none> <none>
details-v1-65fff9896-fw7qv 2/2 Running 10 (9h ago) 9d 10.42.1.244 m01kw1 <none> <none>
reviews-v1-d7f5b879b-bf7tz 2/2 Running 10 (9h ago) 9d 10.42.1.4 m01kw1 <none> <none>
productpage-v1-77748558b4-w2h2h 2/2 Running 10 (9h ago) 9d 10.42.1.2 m01kw1 <none> <none>
ratings-v1-5db74dc944-5z2rz 2/2 Running 10 (9h ago) 9d 10.42.0.17 m01km <none> <none>
reviews-v2-6fcf6d48b4-bvtzn 2/2 Running 10 (9h ago) 9d 10.42.0.23 m01km <none> <none>
sysop@m01serv:~/software/apisisx$
```
The route definition taken from the apisix dashboard:
```
nodes:
- host: 10.42.1.232
port: 9080
weight: 100
type: roundrobin
hash_on: vars
scheme: http
pass_host: pass
name: bookinfo_productpage_9080
desc: Created by apisix-ingress-controller, DO NOT modify it manually
labels:
managed-by: apisix-ingress-controller
```
Clearly the route don't work
I cannot figure out why the address changes.
BTW another route defined using the apisix dashboard continues to work regularly
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] MirtoBusico edited a comment on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
MirtoBusico edited a comment on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1040277232
Hi @tao12345666333 I've reinstalled apisix with these changes in values.yaml:
```
...
gateway:
type: LoadBalancer
...
tls:
enabled: true
servicePort: 443
containerPort: 9443
existingCASecret: "m01cacert"
certCAFilename: "cert"
http2:
enabled: true
...
discovery:
enabled: true
registry:
dns:
servers:
- "10.43.0.10:53"
...
dashboard:
enabled: true
ingress-controller:
enabled: true
```
And installed with:
```
kubectl create ns apisix
kubectl label namespace apisix istio-injection=enabled
kubectl -n apisix create secret generic m01cacert --from-file=cert=./m01ca.pem
helm install apisix apisix/apisix -f apisix-values.yaml \
--set ingress-controller.config.apisix.serviceNamespace=apisix \
--set ingress-controller.config.apisix.serviceName=apisix-admin \
--set ingress-controller.config.kubernetes.apisixRouteVersion=apisix.apache.org/v2beta3 \
--namespace apisix
```
Created a route with:
```
apiVersion: apisix.apache.org/v2beta3
kind: ApisixRoute
metadata:
name: productpage
spec:
http:
- name: rule1
match:
hosts:
- www2.m01.net
paths:
- /*
backends:
- serviceName: productpage
servicePort: 9080
resolveGranularity: service
```
Using the command:
```
kubectl -n bookinfo apply -f productpage-ar.yaml
```
The route is created with the service address
Nothing appears about route creation in apisix-ingres-controller log:
```
2022-02-15T13:20:13.772Z | [GIN] 2022/02/15 - 21:20:13 | 200 | 31.747µs | 127.0.0.6 | GET "/healthz"
2022-02-15T13:20:13.773Z | [GIN] 2022/02/15 - 21:20:13 | 200 | 33.197µs | 127.0.0.6 | GET "/healthz"
2022-02-15T13:20:23.772Z | [GIN] 2022/02/15 - 21:20:23 | 200 | 40.887µs | 127.0.0.6 | GET "/healthz"
```
The command executed op apisix pod (using the upstream_id from apisix dashboard) says
```
bash-5.1# curl http://127.0.0.1:9180/apisix/admin/upstreams/49b914ed -H 'X-API-KEY: edd1c9f034335f136f87ad84b625c8f1' -X GET
{"action":"get","count":1,"node":{"key":"\/apisix\/upstreams\/49b914ed","value":{"labels":{"managed-by":"apisix-ingress-controller"},"scheme":"http","name":"bookinfo_productpage_9080","update_time":1644930766,"hash_on":"vars","desc":"Created by apisix-ingress-controller, DO NOT modify it manually","type":"roundrobin","nodes":[{"weight":100,"port":9080,"priority":0,"host":"10.43.189.220"}],"id":"49b914ed","pass_host":"pass","create_time":1644930766}}}
bash-5.1#
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] MirtoBusico edited a comment on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
MirtoBusico edited a comment on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1040189346
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] tao12345666333 commented on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
tao12345666333 commented on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1040285024
Thanks!
I want to know the upstream information that will generate the error` "error": "unexpected non-empty object"`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] tao12345666333 commented on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
tao12345666333 commented on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1035708112
Is there any information in the apisix-ingress-controller log?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] MirtoBusico edited a comment on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
MirtoBusico edited a comment on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1037329951
Hi @tao12345666333
I've completed the reinstallation, but after 4 cluster restart the Service address is substituted by a Pod address
The route just defined
The route the day after
<img width="1716" alt="route after_4_restart" src="https://user-images.githubusercontent.com/11090934/153720696-e30add07-5ade-4644-be2e-14c505da6a97.png">
I installed using the new chart
```
sysop@m01serv:~/software/apisisx$ helm show chart apisix/apisix
apiVersion: v2
appVersion: 2.12.0
dependencies:
- condition: etcd.enabled
name: etcd
repository: https://charts.bitnami.com/bitnami
version: 6.2.6
- alias: dashboard
condition: dashboard.enabled
name: apisix-dashboard
repository: https://charts.apiseven.com
version: 0.4.0
- alias: ingress-controller
condition: ingress-controller.enabled
name: apisix-ingress-controller
repository: https://charts.apiseven.com
version: 0.9.0
description: A Helm chart for Apache APISIX
icon: https://apache.org/logos/res/apisix/apisix.png
maintainers:
- name: tao12345666333
name: apisix
type: application
version: 0.8.2
```
On this chart I changed
```
...
gateway:
type: LoadBalancer
...
tls:
enabled: true
...
dashboard:
enabled: true
ingress-controller:
enabled: true
```
The stream modification from issue #851 is no more applicable. The below code gives a syntax error (expected integer received string)
```
...
stream: # L4 proxy (TCP/UDP) see bug #851
enabled: true
only: false
tcp: # TCP proxy address list
- 9100
- "127.0.0.1:9101"
udp: # UDP proxy address list
- 9200
- "127.0.0.1:9211"
```
Apisix installed with
```
kubectl create ns apisix
kubectl label namespace apisix istio-injection=enabled
helm install apisix apisix/apisix -f apisix-values.yaml \
--set ingress-controller.config.apisix.serviceNamespace=apisix \
--set ingress-controller.config.apisix.serviceName=apisix-admin \
--namespace apisix
```
Defining the route as
```
apiVersion: apisix.apache.org/v2beta2
kind: ApisixRoute
metadata:
name: productpage
spec:
http:
- name: rule1
match:
hosts:
- www2.m01.net
paths:
- /*
backends:
- serviceName: productpage
servicePort: 9080
resolveGranularity: service
```
The only strange thing in the apisix-ingress-controller log is that verdion **v2beta1** is deprecated in favor of **v2beta3**
But in the yaml file there is **v2beta2**
```
[GIN] 2022/02/12 - 03:25:30 | 200 | 31.569µs | 127.0.0.6 | GET "/healthz"
[GIN] 2022/02/12 - 03:25:30 | 200 | 20.218µs | 127.0.0.6 | GET "/healthz"
W0212 03:25:35.736793 1 warnings.go:70] apisix.apache.org/v2beta1 ApisixRoute is deprecated; use apisix.apache.org/v2beta3 ApisixRoute
[GIN] 2022/02/12 - 03:25:40 | 200 | 43.57µs | 127.0.0.6 | GET "/healthz"
[GIN] 2022/02/12 - 03:25:40 | 200 | 18.58µs | 127.0.0.6 | GET "/healthz"
```
The apisix-ingress controller at startup (today)
```
2022-02-12T16:49:19.277Z | I0213 00:49:19.277167 1 request.go:665] Waited for 1.163982311s due to client-side throttling, not priority and fairness, request: GET:https://10.43.0.1:443/apis/apisix.apache.org/v2beta3/namespaces/longhorn-system/apisixconsumers
2022-02-12T16:49:20.101Z | 2022-02-13T00:49:20+08:00 [34minfo[0m ingress/controller.go:549 controller now is running as leader {"namespace": "apisix", "pod": "apisix-ingress-controller-6846db58b8-lsv6g"}
2022-02-12T16:49:20.101Z | 2022-02-13T00:49:20+08:00 [34minfo[0m ingress/apisix_pluginconfig.go:57 ApisixPluginConfig controller started
2022-02-12T16:49:20.101Z | 2022-02-13T00:49:20+08:00 [34minfo[0m ingress/endpoint.go:56 endpoints controller started
2022-02-12T16:49:20.101Z | 2022-02-13T00:49:20+08:00 [34minfo[0m ingress/ingress.go:59 ingress controller started
2022-02-12T16:49:20.101Z | 2022-02-13T00:49:20+08:00 [34minfo[0m ingress/apisix_tls.go:58 ApisixTls controller started
2022-02-12T16:49:20.101Z | 2022-02-13T00:49:20+08:00 [34minfo[0m ingress/apisix_cluster_config.go:57 ApisixClusterConfig controller started
2022-02-12T16:49:20.101Z | 2022-02-13T00:49:20+08:00 [34minfo[0m ingress/secret.go:62 secret controller started
2022-02-12T16:49:20.101Z | 2022-02-13T00:49:20+08:00 [34minfo[0m ingress/apisix_upstream.go:58 ApisixUpstream controller started
2022-02-12T16:49:20.101Z | 2022-02-13T00:49:20+08:00 [34minfo[0m ingress/apisix_consumer.go:56 ApisixConsumer controller started
2022-02-12T16:49:20.101Z | 2022-02-13T00:49:20+08:00 [34minfo[0m ingress/apisix_route.go:59 ApisixRoute controller started
2022-02-12T16:49:20.101Z | 2022-02-13T00:49:20+08:00 [34minfo[0m ingress/namespace.go:71 namespace controller started
2022-02-12T16:49:20.101Z | 2022-02-13T00:49:20+08:00 [34minfo[0m ingress/pod.go:47 pod controller started
2022-02-12T16:49:20.102Z | W0213 00:49:20.102458 1 warnings.go:70] apisix.apache.org/v2beta1 ApisixRoute is deprecated; use apisix.apache.org/v2beta3 ApisixRoute
2022-02-12T16:49:20.106Z | W0213 00:49:20.106277 1 warnings.go:70] apisix.apache.org/v2beta1 ApisixRoute is deprecated; use apisix.apache.org/v2beta3 ApisixRoute
2022-02-12T16:49:20.243Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_grafana_3000", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/256603fb", "cluster": "default"}
2022-02-12T16:49:20.243Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-system_grafana_3000"}
2022-02-12T16:49:20.250Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_prometheus_9090", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/618bbe1f", "cluster": "default"}
2022-02-12T16:49:20.250Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-system_prometheus_9090"}
2022-02-12T16:49:20.255Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "kubernetes-dashboard_dashboard-metrics-scraper_8000", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/225c3962", "cluster": "default"}
2022-02-12T16:49:20.255Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "kubernetes-dashboard_dashboard-metrics-scraper_8000"}
2022-02-12T16:49:20.258Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "longhorn-system_csi-snapshotter_12345", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/97d053af", "cluster": "default"}
2022-02-12T16:49:20.258Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "longhorn-system_csi-snapshotter_12345"}
2022-02-12T16:49:20.263Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "apisix_apisix-etcd-headless_2379", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/b439b2f6", "cluster": "default"}
2022-02-12T16:49:20.263Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "apisix_apisix-etcd-headless_2379"}
2022-02-12T16:49:20.265Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "apisix_apisix-etcd-headless_2380", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/4a7d169d", "cluster": "default"}
2022-02-12T16:49:20.265Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "apisix_apisix-etcd-headless_2380"}
2022-02-12T16:49:20.268Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-operator_istio-operator_8383", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/6b312a6d", "cluster": "default"}
2022-02-12T16:49:20.268Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-operator_istio-operator_8383"}
2022-02-12T16:49:20.270Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_jaeger-collector_14268", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/b8ae0da0", "cluster": "default"}
2022-02-12T16:49:20.270Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-system_jaeger-collector_14268"}
2022-02-12T16:49:20.274Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_jaeger-collector_14250", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/9d58d651", "cluster": "default"}
2022-02-12T16:49:20.274Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-system_jaeger-collector_14250"}
2022-02-12T16:49:20.278Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_jaeger-collector_9411", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/6c3f31a6", "cluster": "default"}
2022-02-12T16:49:20.278Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-system_jaeger-collector_9411"}
2022-02-12T16:49:20.281Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "default_kubernetes_443", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/606b3be0", "cluster": "default"}
2022-02-12T16:49:20.281Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "default_kubernetes_443"}
2022-02-12T16:49:20.284Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_istiod_15010", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/861f0648", "cluster": "default"}
2022-02-12T16:49:20.284Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-system_istiod_15010"}
2022-02-12T16:49:20.287Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_istiod_15012", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/68116764", "cluster": "default"}
2022-02-12T16:49:20.287Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-system_istiod_15012"}
2022-02-12T16:49:20.289Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_istiod_443", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/3bd1b5fa", "cluster": "default"}
2022-02-12T16:49:20.289Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-system_istiod_443"}
2022-02-12T16:49:20.292Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_istiod_15014", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/8172c251", "cluster": "default"}
2022-02-12T16:49:20.292Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-system_istiod_15014"}
2022-02-12T16:49:20.294Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_kiali_20001", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/d751995a", "cluster": "default"}
2022-02-12T16:49:20.294Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-system_kiali_20001"}
2022-02-12T16:49:20.297Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_kiali_9090", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/55e2f8be", "cluster": "default"}
2022-02-12T16:49:20.297Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-system_kiali_9090"}
2022-02-12T16:49:20.303Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "apisix_apisix-gateway_80", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/93400b20", "cluster": "default"}
2022-02-12T16:49:20.303Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "apisix_apisix-gateway_80"}
2022-02-12T16:49:20.307Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "apisix_apisix-gateway_443", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/3b59d238", "cluster": "default"}
2022-02-12T16:49:20.307Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "apisix_apisix-gateway_443"}
2022-02-12T16:49:20.309Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "kube-system_docker-registry_5000", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/6cec0f18", "cluster": "default"}
2022-02-12T16:49:20.309Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "kube-system_docker-registry_5000"}
2022-02-12T16:49:20.312Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "apisix_apisix-dashboard_80", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/6624cd4a", "cluster": "default"}
2022-02-12T16:49:20.312Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "apisix_apisix-dashboard_80"}
2022-02-12T16:49:20.315Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "apisix_apisix-admin_9180", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/930895ff", "cluster": "default"}
2022-02-12T16:49:20.315Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "apisix_apisix-admin_9180"}
2022-02-12T16:49:20.317Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "apisix_apisix-ingress-controller_80", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/b1bea59", "cluster": "default"}
2022-02-12T16:49:20.317Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "apisix_apisix-ingress-controller_80"}
2022-02-12T16:49:20.319Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "longhorn-system_csi-provisioner_12345", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/6d394703", "cluster": "default"}
2022-02-12T16:49:20.319Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "longhorn-system_csi-provisioner_12345"}
2022-02-12T16:49:20.322Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "longhorn-system_longhorn-frontend_80", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/d07916d6", "cluster": "default"}
2022-02-12T16:49:20.322Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "longhorn-system_longhorn-frontend_80"}
2022-02-12T16:49:20.325Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_tracing_80", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/b699da65", "cluster": "default"}
2022-02-12T16:49:20.325Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-system_tracing_80"}
2022-02-12T16:49:20.329Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_tracing_16685", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/ae80a4d", "cluster": "default"}
2022-02-12T16:49:20.329Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-system_tracing_16685"}
2022-02-12T16:49:20.344Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "longhorn-system_longhorn-backend_9500", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/2ceb1990", "cluster": "default"}
2022-02-12T16:49:20.344Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "longhorn-system_longhorn-backend_9500"}
2022-02-12T16:49:20.356Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "longhorn-system_csi-attacher_12345", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/ee03afe2", "cluster": "default"}
2022-02-12T16:49:20.356Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "longhorn-system_csi-attacher_12345"}
2022-02-12T16:49:20.362Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "kube-system_metrics-server_443", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/4a344633", "cluster": "default"}
2022-02-12T16:49:20.362Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "kube-system_metrics-server_443"}
2022-02-12T16:49:20.365Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "kube-system_kube-dns_53", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/f3118c88", "cluster": "default"}
2022-02-12T16:49:20.365Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "kube-system_kube-dns_53"}
2022-02-12T16:49:20.368Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "kube-system_kube-dns_53", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/f3118c88", "cluster": "default"}
2022-02-12T16:49:20.368Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "kube-system_kube-dns_53"}
2022-02-12T16:49:20.371Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "kube-system_kube-dns_9153", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/23ef4d0", "cluster": "default"}
2022-02-12T16:49:20.371Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "kube-system_kube-dns_9153"}
2022-02-12T16:49:20.374Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "longhorn-system_csi-resizer_12345", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/29267f16", "cluster": "default"}
2022-02-12T16:49:20.374Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "longhorn-system_csi-resizer_12345"}
2022-02-12T16:49:20.378Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "kubernetes-dashboard_kubernetes-dashboard_443", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/7dc55665", "cluster": "default"}
2022-02-12T16:49:20.378Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "kubernetes-dashboard_kubernetes-dashboard_443"}
2022-02-12T16:49:20.381Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "apisix_apisix-etcd_2379", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/ba31b611", "cluster": "default"}
2022-02-12T16:49:20.381Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "apisix_apisix-etcd_2379"}
2022-02-12T16:49:20.385Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "apisix_apisix-etcd_2380", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/4475127a", "cluster": "default"}
2022-02-12T16:49:20.385Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "apisix_apisix-etcd_2380"}
2022-02-12T16:49:20.388Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "istio-system_zipkin_9411", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/c4c96c99", "cluster": "default"}
2022-02-12T16:49:20.388Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "istio-system_zipkin_9411"}
2022-02-12T16:49:20.392Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "bookinfo_reviews_9080", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/c4c02588", "cluster": "default"}
2022-02-12T16:49:20.392Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "bookinfo_reviews_9080"}
2022-02-12T16:49:20.396Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "bookinfo_ratings_9080", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/4a5806af", "cluster": "default"}
2022-02-12T16:49:20.396Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "bookinfo_ratings_9080"}
2022-02-12T16:49:20.399Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m apisix/upstream.go:70 upstream not found {"name": "bookinfo_details_9080", "url": "http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin/upstreams/aabec2ca", "cluster": "default"}
2022-02-12T16:49:20.399Z | 2022-02-13T00:49:20+08:00 [33mwarn[0m ingress/controller.go:653 upstream is not referenced {"cluster": "name=default; base_url=http://apisix-admin.apisix.svc.cluster.local:9180/apisix/admin", "upstream": "bookinfo_details_9080"}
2022-02-12T16:49:21.352Z | [GIN] 2022/02/13 - 00:49:21 | 200 | 51.009µs | 127.0.0.6 | GET "/healthz"
2022-02-12T16:49:26.559Z | [GIN] 2022/02/13 - 00:49:26 | 200 | 41.23µs | 127.0.0.6 | GET "/healthz"
```
Now I'll try to delete the route and reinstall using v2beta3
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] tao12345666333 commented on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
tao12345666333 commented on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1072218970
I will close this issue. Thanks for your report.
And I will fix #870 ASAP, it's on my list.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] tao12345666333 commented on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
tao12345666333 commented on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1072218970
I will close this issue. Thanks for your report.
And I will fix #870 ASAP, it's on my list.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] apit edited a comment on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
apit edited a comment on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1037054266
what's the use case for this? is it to let service handle the load balance?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] MirtoBusico edited a comment on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
MirtoBusico edited a comment on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1037349675
Recreated the route using v2beta3
```
apiVersion: apisix.apache.org/v2beta3
kind: ApisixRoute
metadata:
name: productpage
spec:
http:
- name: rule1
match:
hosts:
- www2.m01.net
paths:
- /*
backends:
- serviceName: productpage
servicePort: 9080
resolveGranularity: service
```
Installed with
```
sysop@m01serv:~/software/apisisx$ kubectl -n bookinfo apply -f productpage-ar.yaml
apisixroute.apisix.apache.org/productpage created
sysop@m01serv:~/software/apisisx$ date
sab 12 feb 2022, 18:43:37, CET
sysop@m01serv:~/software/apisisx$
```
The warning in the log still complains the **v2beta1** version
```
2022-02-12T17:42:36.559Z | [GIN] 2022/02/13 - 01:42:36 | 200 | 36.86µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:42:41.352Z | [GIN] 2022/02/13 - 01:42:41 | 200 | 41.27µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:42:46.558Z | [GIN] 2022/02/13 - 01:42:46 | 200 | 33.53µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:42:47.785Z | W0213 01:42:47.785053 1 warnings.go:70] apisix.apache.org/v2beta1 ApisixRoute is deprecated; use apisix.apache.org/v2beta3 ApisixRoute
2022-02-12T17:42:51.352Z | [GIN] 2022/02/13 - 01:42:51 | 200 | 29.54µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:42:56.559Z | [GIN] 2022/02/13 - 01:42:56 | 200 | 34.069µs | 127.0.0.6 | GET "/healthz"ù
...
2022-02-12T17:48:36.559Z | [GIN] 2022/02/13 - 01:48:36 | 200 | 38.13µs | 127.0.0.6 | GET "/healthz"
2022-02-12T17:48:41.118Z | W0213 01:48:41.118713 1 warnings.go:70] apisix.apache.org/v2beta1 ApisixRoute is deprecated; use apisix.apache.org/v2beta3 ApisixRoute
2022-02-12T17:48:41.352Z | [GIN] 2022/02/13 - 01:48:41 | 200 | 24.85µs | 127.0.0.6 | GET "/healthz"
```
The route correctly point to the Service address
<img width="1709" alt="v2beta3-route-defined" src="https://user-images.githubusercontent.com/11090934/153722325-229bdfbc-a572-4932-acc8-8f16d3b95ad9.png">
Now I'll try some cluster restarts to see if the address changes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] MirtoBusico commented on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
MirtoBusico commented on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1037286073
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] tao12345666333 commented on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
tao12345666333 commented on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1040044126
Thanks for the detailed report, I have been able to reproduce this issue. i will fix it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [apisix-ingress-controller] MirtoBusico edited a comment on issue #853: question: How to use Service IP as upstream instead of Pod IP
Posted by GitBox <gi...@apache.org>.
MirtoBusico edited a comment on issue #853:
URL: https://github.com/apache/apisix-ingress-controller/issues/853#issuecomment-1040189346
> > The warning in the log still complains the v2beta1 version
>
> @MirtoBusico This is a configuration item, in configmap. It can be changed at values.yaml https://github.com/apache/apisix-helm-chart/blob/051998d8cc1816674fcbc3c8029f9e7d1330e3d5/charts/apisix-ingress-controller/values.yaml#L113-L115
Thanks @tao12345666333
Now I'll reinstall with (if I understand correctly)
```
helm install apisix apisix/apisix -f apisix-values.yaml \
--set ingress-controller.config.apisix.serviceNamespace=apisix \
--set ingress-controller.config.apisix.serviceName=apisix-admin \
--set ingress-controller.config.kubernetes.apisixRouteVersion=apisix.apache.org/v2beta3 \
--namespace apisix
```
After I reinstalled I'll post th output of
```
curl http://127.0.0.1:9180/apisix/admin/upstreams/394532502988915297 -H 'X-API-KEY: edd1c9f034335f136f87ad84b625c8f1' -X GET
```
from apisix pod
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org