You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2020/10/02 17:20:52 UTC

[GitHub] [airflow] jakepaw opened a new issue #11243: Kubernetes Executor Node Selector

jakepaw opened a new issue #11243:
URL: https://github.com/apache/airflow/issues/11243


   **Apache Airflow version**: 1.10.12
   
   
   **Kubernetes version (if you are using kubernetes)** (use `kubectl version`): 1.17.3
   
   **Environment**:
   
   - **Cloud provider or hardware configuration**: On prem k8s cluster
   - **OS** (e.g. from /etc/os-release): RHEL 7
   - **Kernel** (e.g. `uname -a`):
   - **Install tools**: helm install
   - **Others**:
   
   **What happened**:
   
   I want to set a node selector for my worker pods.. I set nodeSelector in scheduler as well as airflow and the scheduler assigns worker pods to any node in my cluster. I also have tried the following:
   
   AIRFLOW__KUBERNETES__NODE_SELECTORS: kubernetes.io/application = airflow
   
   **What you expected to happen**:
   
   I would like my worker pods to be ran on the nodes following the correct selector.
   
   **Anything else we need to know**:
   
   My worker nodes that are in my k8s cluster for this airflow installation are labeled with the node selector above, the webserver, scheduler, and postgress always spawn correctly on one of my airflow nodes with the correct label, but worker pods are not spawning there. Thank you!
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] boring-cyborg[bot] commented on issue #11243: Kubernetes Executor Node Selector

Posted by GitBox <gi...@apache.org>.
boring-cyborg[bot] commented on issue #11243:
URL: https://github.com/apache/airflow/issues/11243#issuecomment-702856922


   Thanks for opening your first issue here! Be sure to follow the issue template!
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] jakepaw commented on issue #11243: Kubernetes Executor Node Selector

Posted by GitBox <gi...@apache.org>.
jakepaw commented on issue #11243:
URL: https://github.com/apache/airflow/issues/11243#issuecomment-702884173


   Never-mind. Followed this, which uses affinity. 
   
   [Affinity](https://github.com/apache/airflow/issues/9374)


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] mik-laj closed issue #11243: Kubernetes Executor Node Selector

Posted by GitBox <gi...@apache.org>.
mik-laj closed issue #11243:
URL: https://github.com/apache/airflow/issues/11243


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org