You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/01/29 09:10:58 UTC

[GitHub] [airflow] Junnplus opened a new issue #13972: Startup slow due to securityContext with large log volume

Junnplus opened a new issue #13972:
URL: https://github.com/apache/airflow/issues/13972


   
   **Apache Airflow version**: 2.0.0
   
   **Kubernetes version (if you are using kubernetes)** (use `kubectl version`): 1.11
   
   - **Cloud provider or hardware configuration**: alicloud
   - **Install tools**: helm chart
   - **Others**:
   
   **What happened**:
   
   `uid/gid` causes a massive delay on starting webserver with a large log volume.
   default behavior for Kubernetes to run chown recursively on the entire volume at mount time when fsGroup is set: helm/charts#22857
   
   **What you expected to happen**:
   
   <!-- What do you think went wrong? -->
   
   **How to reproduce it**:
   
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] dimberman commented on issue #13972: Startup slow due to securityContext with large log volume

Posted by GitBox <gi...@apache.org>.
dimberman commented on issue #13972:
URL: https://github.com/apache/airflow/issues/13972#issuecomment-779423366


   @Junnplus is this an Airflow problem or a kubernetes problem? I'm not sure what we can do if k8s is recursively checking the entire volume.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] Dr-Denzy commented on issue #13972: Startup slow due to securityContext with large log volume

Posted by GitBox <gi...@apache.org>.
Dr-Denzy commented on issue #13972:
URL: https://github.com/apache/airflow/issues/13972#issuecomment-800386329


   I will work on this.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] dimberman commented on issue #13972: Startup slow due to securityContext with large log volume

Posted by GitBox <gi...@apache.org>.
dimberman commented on issue #13972:
URL: https://github.com/apache/airflow/issues/13972#issuecomment-809755854


   @Junnplus what do you mean by "option to skip fsgroup"? Can you give me an example of how that has been done?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] boring-cyborg[bot] commented on issue #13972: Startup slow due to securityContext with large log volume

Posted by GitBox <gi...@apache.org>.
boring-cyborg[bot] commented on issue #13972:
URL: https://github.com/apache/airflow/issues/13972#issuecomment-769679287


   Thanks for opening your first issue here! Be sure to follow the issue template!
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] Junnplus commented on issue #13972: Startup slow due to securityContext with large log volume

Posted by GitBox <gi...@apache.org>.
Junnplus commented on issue #13972:
URL: https://github.com/apache/airflow/issues/13972#issuecomment-809855083


   @dimberman I remove fsGroup from webserver and worker deployment.
   ```diff
   +++ b/chart/templates/webserver/webserver-deployment.yaml
   @@ -75,7 +75,6 @@ spec:
          restartPolicy: Always
          securityContext:
            runAsUser: {{ .Values.uid }}
   -        fsGroup: {{ .Values.gid }}
          {{- if or .Values.registry.secretName .Values.registry.connection }}
          imagePullSecrets:
            - name: {{ template "registry_secret" . }}
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] Junnplus commented on issue #13972: Startup slow due to securityContext with large log volume

Posted by GitBox <gi...@apache.org>.
Junnplus commented on issue #13972:
URL: https://github.com/apache/airflow/issues/13972#issuecomment-804618837


   @Dr-Denzy you just need mount a large log volume on webserver. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] Dr-Denzy commented on issue #13972: Startup slow due to securityContext with large log volume

Posted by GitBox <gi...@apache.org>.
Dr-Denzy commented on issue #13972:
URL: https://github.com/apache/airflow/issues/13972#issuecomment-804075008


   @Junnplus could you provide more details on how to reproduce this issue?
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] Junnplus commented on issue #13972: Startup slow due to securityContext with large log volume

Posted by GitBox <gi...@apache.org>.
Junnplus commented on issue #13972:
URL: https://github.com/apache/airflow/issues/13972#issuecomment-782912412


   @dimberman kubernetes problem. Can we add an option to skip `fsGroup` setting?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org