[GitHub] [airflow] luos-fc opened a new issue, #31476: cleanup-pod CLI command fails due to incorrect host

["luos-fc (via GitHub)" <gi...@apache.org>]

luos-fc opened a new issue, #31476:
URL: https://github.com/apache/airflow/issues/31476

   ### Apache Airflow version
   
   2.6.1
   
   ### What happened
   
   When running `airflow kubernetes cleanup-pods`, the API call to delete a pod fails. A snippet of the log is below:
   
   ```
   urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='localhost', port=80): Max retries exceeded with url: /api/v1/namespaces/airflow/pods/my-task-avd79fq1 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f52f9aebfd0>: Failed to establish a new connection: [Errno 111] Connection refused'))
   ```
   
   [The Kubernetes client provisioned in _delete_pod](https://github.com/apache/airflow/blob/main/airflow/cli/commands/kubernetes_command.py#L151) incorrectly has the host as `http:localhost`. On the scheduler pod if I start a Python environment I can see that the configuration differs from the `get_kube_client()` configuration:
   
   ```
   >>> get_kube_client().api_client.configuration.host
   '[https://172.20.0.1:443](https://172.20.0.1/)'
   >>> client.CoreV1Api().api_client.configuration.host
   'http://localhost/'
   ```
   
   On Airflow 2.5.3 these two clients have the same configuration.
   
   It's possible I have some mistake in my configuration but I'm not sure what it could be. The above fails on 2.6.0 also.
   
   ### What you think should happen instead
   
   Pods should clean up without error
   
   ### How to reproduce
   
   Run the following from a Kubernetes deployment of Airflow:
   
   ```python
   from airflow.kubernetes.kube_client import get_kube_client
   from kubernetes import client
   
   print(get_kube_client().api_client.configuration.host)
   print(client.CoreV1Api().api_client.configuration.host)
   ```
   
   Alternatively run `airflow kubernetes cleanup-pods` with pods available for cleanup
   
   ### Operating System
   
   Debian GNU/Linux 11 (bullseye)
   
   ### Versions of Apache Airflow Providers
   
   _No response_
   
   ### Deployment
   
   Official Apache Airflow Helm Chart
   
   ### Deployment details
   
   Using `in_cluster` configuration for KubernetesExecutor
   
   ### Anything else
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] hussein-awala closed issue #31476: cleanup-pod CLI command fails due to incorrect host

["hussein-awala (via GitHub)" <gi...@apache.org>]

hussein-awala closed issue #31476: cleanup-pod CLI command fails due to incorrect host
URL: https://github.com/apache/airflow/issues/31476


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org