You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@yunikorn.apache.org by "Yongjun Zhang (Jira)" <ji...@apache.org> on 2023/03/16 01:59:00 UTC

[jira] [Comment Edited] (YUNIKORN-269) Editing yunikorn configmaps fails with host "yunikorn-service.yunikorn.svc" resolution error

    [ https://issues.apache.org/jira/browse/YUNIKORN-269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700922#comment-17700922 ] 

Yongjun Zhang edited comment on YUNIKORN-269 at 3/16/23 1:58 AM:
-----------------------------------------------------------------

HI [~kmarton], [~ayubpathan], [~wwei],

Thanks for your work here. Need some help, CC [~ccondit] 

I'm seeing 
{code}
dispatcher.go:142] Failed calling webhook, failing open admission-webhook.yunikorn.validate-conf: failed calling webhook "admission-webhook.yunikorn.validate-conf": failed to call webhook: Post "https://yunikorn-admission-controller-service.yunikorn.svc:443/validate-conf?timeout=10s": context deadline exceeded
{code}

{code}
dispatcher.go:184] failed calling webhook "admission-webhook.yunikorn.mutate-pods": failed to call webhook: Post "https://yunikorn-admission-controller-service.yunikorn.svc:443/mutate?timeout=10s": service "yunikorn-admission-controller-service" not found
E0316 01:11:35.199066 10 dispatcher.go:184] failed calling webhook "admission-webhook.yunikorn.mutate-pods": failed to call webhook: Post "https://yunikorn-admission-controller-service.yunikorn.svc:443/mutate?timeout=10s": service "yunikorn-admission-controller-service" not found
{code}

when I checked the admission controller host, I saw:

~ $ lsof
1	/opt/yunikorn/bin/scheduler-admission-controller	0	/dev/null
1	/opt/yunikorn/bin/scheduler-admission-controller	1	pipe:[139398380]
1	/opt/yunikorn/bin/scheduler-admission-controller	2	pipe:[139398381]
1	/opt/yunikorn/bin/scheduler-admission-controller	3	anon_inode:[eventpoll]
1	/opt/yunikorn/bin/scheduler-admission-controller	4	pipe:[139298745]
1	/opt/yunikorn/bin/scheduler-admission-controller	5	pipe:[139298745]
1	/opt/yunikorn/bin/scheduler-admission-controller	6	socket:[139358013]
1	/opt/yunikorn/bin/scheduler-admission-controller	7	socket:[139358014]
1	/opt/yunikorn/bin/scheduler-admission-controller	8	socket:[139365004]
37	/bin/busybox	0	/dev/pts/0
37	/bin/busybox	1	/dev/pts/0
37	/bin/busybox	2	/dev/pts/0
37	/bin/busybox	10	/dev/tty

Supposedly I should see port 443 (?) but it's not there.

Opening /etc/services shows:

https           443/tcp                         # http protocol over TLS/SSL
https           443/udp                         # HTTP/3

And I saw the following

helm-charts/yunikorn/templates/admission-controller-service.yaml
{code}
{{ if .Values.embedAdmissionController }}
apiVersion: v1
kind: Service
metadata:
  name: yunikorn-admission-controller-service
  labels:
    app: yunikorn-admission-controller-service
    chart: {{ include "yunikorn.chart" . }}
    release: {{ .Release.Name }}
    heritage: {{ .Release.Service }}
spec:
  type: {{ .Values.admissionController.service.type }}
  ports:
    - port: 443
      targetPort: webhook-api
  selector:
    app: yunikorn
    component: yunikorn-admission-controller
    release: {{ .Release.Name }}
{{ end }}
{code}

Wonder if I missed some configs to set, would you please take a look and help?

Thanks.


was (Author: yzhangal):
HI [~kmarton], [~ayubpathan], [~wwei],

Thanks for your work here. Need some help, CC [~ccondit] 

I'm seeing 
{code}
dispatcher.go:142] Failed calling webhook, failing open admission-webhook.yunikorn.validate-conf: failed calling webhook "admission-webhook.yunikorn.validate-conf": failed to call webhook: Post "https://yunikorn-admission-controller-service.yunikorn.svc:443/validate-conf?timeout=10s": context deadline exceeded
{code}

{code}
dispatcher.go:184] failed calling webhook "admission-webhook.yunikorn.mutate-pods": failed to call webhook: Post "https://yunikorn-admission-controller-service.yunikorn.svc:443/mutate?timeout=10s": service "yunikorn-admission-controller-service" not found
E0316 01:11:35.199066 10 dispatcher.go:184] failed calling webhook "admission-webhook.yunikorn.mutate-pods": failed to call webhook: Post "https://yunikorn-admission-controller-service.yunikorn.svc:443/mutate?timeout=10s": service "yunikorn-admission-controller-service" not found
{code}

when I checked the admission controller host, I saw:

~ $ lsof
1	/opt/yunikorn/bin/scheduler-admission-controller	0	/dev/null
1	/opt/yunikorn/bin/scheduler-admission-controller	1	pipe:[139398380]
1	/opt/yunikorn/bin/scheduler-admission-controller	2	pipe:[139398381]
1	/opt/yunikorn/bin/scheduler-admission-controller	3	anon_inode:[eventpoll]
1	/opt/yunikorn/bin/scheduler-admission-controller	4	pipe:[139298745]
1	/opt/yunikorn/bin/scheduler-admission-controller	5	pipe:[139298745]
1	/opt/yunikorn/bin/scheduler-admission-controller	6	socket:[139358013]
1	/opt/yunikorn/bin/scheduler-admission-controller	7	socket:[139358014]
1	/opt/yunikorn/bin/scheduler-admission-controller	8	socket:[139365004]
37	/bin/busybox	0	/dev/pts/0
37	/bin/busybox	1	/dev/pts/0
37	/bin/busybox	2	/dev/pts/0
37	/bin/busybox	10	/dev/tty

Supposedly I should see port 443 (?) but it's not there.

I saw the following

helm-charts/yunikorn/templates/admission-controller-service.yaml
{code}
{{ if .Values.embedAdmissionController }}
apiVersion: v1
kind: Service
metadata:
  name: yunikorn-admission-controller-service
  labels:
    app: yunikorn-admission-controller-service
    chart: {{ include "yunikorn.chart" . }}
    release: {{ .Release.Name }}
    heritage: {{ .Release.Service }}
spec:
  type: {{ .Values.admissionController.service.type }}
  ports:
    - port: 443
      targetPort: webhook-api
  selector:
    app: yunikorn
    component: yunikorn-admission-controller
    release: {{ .Release.Name }}
{{ end }}
{code}
Wonder if I missed some configs to set, would you please take a look and help?

Thanks.

> Editing yunikorn configmaps fails with host "yunikorn-service.yunikorn.svc" resolution error
> --------------------------------------------------------------------------------------------
>
>                 Key: YUNIKORN-269
>                 URL: https://issues.apache.org/jira/browse/YUNIKORN-269
>             Project: Apache YuniKorn
>          Issue Type: Bug
>          Components: deployment
>            Reporter: Ayub Pathan
>            Assignee: Kinga Marton
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 0.9, 0.10
>
>
> Editing yunikorn configmaps fails with below error.
> {noformat}
> kubectl edit configmaps yunikorn-configs -n yunikorn 
> error: configmaps "yunikorn-configs" could not be patched: admission webhook "admission-webhook.yunikorn.validate-conf" denied the request: Post http://yunikorn-service.yunikorn.svc:9080/ws/v1/validate-conf: dial tcp: lookup yunikorn-service.yunikorn.svc on 10.192.0.2:53: no such host
> {noformat}
> Seems like DNS setting for yunikorn service is not configured, maybe through helm charts.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@yunikorn.apache.org
For additional commands, e-mail: issues-help@yunikorn.apache.org