You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "raphaelauv (via GitHub)" <gi...@apache.org> on 2024/10/30 16:12:37 UTC
Re: [I] Invalid kube-config file. Expected key current-context in kube-config when using deferrable=True [airflow]
raphaelauv commented on issue #34644:
URL: https://github.com/apache/airflow/issues/34644#issuecomment-2447679632
same problem with
airflow==2.10.2 apache-airflow-providers-cncf-kubernetes==9.0.0
kind 0.24.0
```
kind get kubeconfig --internal > conf/kube_conf
```
airflow connection
```json
"kubernetes_default": {
"conn_type": "kubernetes",
"extra": "{\"extra__kubernetes__in_cluster\": false, \"extra__kubernetes__kube_config_path\": \"/opt/airflow/include/.kube/config\", \"extra__kubernetes__namespace\": \"default\", \"extra__kubernetes__cluster_context\": \"kind-kind\", \"extra__kubernetes__disable_verify_ssl\": false, \"extra__kubernetes__disable_tcp_keepalive\": false, \"xcom_sidecar_container_image\": \"alpine:3.16.2\"}"
}
```
```log
[2024-10-30, 16:03:51 UTC] {base.py:84} INFO - Retrieving connection 'kubernetes_default'
[2024-10-30, 16:03:51 UTC] {pod.py:1138} INFO - Building pod airflow-test-pod-xb472z6z with labels: {'dag_id': 'kubernetes_dag', 'task_id': 'task-one', 'run_id': 'manual__2024-10-30T160350.5676190000-e2f6ac7ec', 'kubernetes_pod_operator': 'True', 'try_number': '1'}
[2024-10-30, 16:03:51 UTC] {taskinstance.py:288} INFO - Pausing task as DEFERRED. dag_id=kubernetes_dag, task_id=task-one, run_id=manual__2024-10-30T16:03:50.567619+00:00, execution_date=20241030T160350, start_date=20241030T160351
[2024-10-30, 16:03:51 UTC] {taskinstance.py:340} ▼ Post task execution logs
[2024-10-30, 16:03:51 UTC] {local_task_job_runner.py:260} INFO - Task exited with return code 100 (task deferral)
[2024-10-30, 16:03:51 UTC] {local_task_job_runner.py:245} ▲▲▲ Log group end
[2024-10-30, 16:03:52 UTC] {pod.py:160} INFO - Checking pod 'airflow-test-pod-xb472z6z' in namespace 'default'.
[2024-10-30, 16:03:52 UTC] {base.py:84} INFO - Retrieving connection 'kubernetes_default'
[2024-10-30, 16:03:52 UTC] {kube_config.py:515} WARNING - Config not found: /home/airflow/.kube/config
[2024-10-30, 16:03:52 UTC] {triggerer_job_runner.py:631} INFO - Trigger kubernetes_dag/manual__2024-10-30T16:03:50.567619+00:00/task-one/-1/1 (ID 10) fired: TriggerEvent<{'name': 'airflow-test-pod-xb472z6z', 'namespace': 'default', 'status': 'error', 'message': 'Invalid kube-config file. Expected key contexts in kube-config', 'stack_trace': 'Traceback (most recent call last):\n File "/home/airflow/.local/lib/python3.12/site-packages/airflow/providers/cncf/kubernetes/triggers/pod.py", line 162, in run\n state = await self._wait_for_pod_start()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/home/airflow/.local/lib/python3.12/site-packages/airflow/providers/cncf/kubernetes/triggers/pod.py", line 223, in _wait_for_pod_start\n pod = await self.hook.get_pod(self.pod_name, self.pod_namespace)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/home/airflow/.local/lib/python3.12/site-packages/airflow/providers/cncf/kubernetes/hooks/kubernetes.py
", line 754, in get_pod\n async with self.get_conn() as connection:\n ^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/contextlib.py", line 210, in __aenter__\n return await anext(self.gen)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/home/airflow/.local/lib/python3.12/site-packages/airflow/providers/cncf/kubernetes/hooks/kubernetes.py", line 741, in get_conn\n kube_client = await self._load_config() or async_client.ApiClient()\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/home/airflow/.local/lib/python3.12/site-packages/airflow/providers/cncf/kubernetes/hooks/kubernetes.py", line 711, in _load_config\n await async_config.load_kube_config(\n File "/home/airflow/.local/lib/python3.12/site-packages/kubernetes_asyncio/config/kube_config.py", line 603, in load_kube_config\n loader = _get_kube_config_loader_for_yaml_file(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/home/airflow/.local/lib/python3.12/site-packages/kubernetes_async
io/config/kube_config.py", line 567, in _get_kube_config_loader_for_yaml_file\n return KubeConfigLoader(\n ^^^^^^^^^^^^^^^^^\n File "/home/airflow/.local/lib/python3.12/site-packages/kubernetes_asyncio/config/kube_config.py", line 150, in __init__\n self.set_active_context(active_context)\n File "/home/airflow/.local/lib/python3.12/site-packages/kubernetes_asyncio/config/kube_config.py", line 162, in set_active_context\n self._current_context = self._config[\'contexts\'].get_with_name(\n ~~~~~~~~~~~~^^^^^^^^^^^^\n File "/home/airflow/.local/lib/python3.12/site-packages/kubernetes_asyncio/config/kube_config.py", line 448, in __getitem__\n raise ConfigException(\nkubernetes_asyncio.config.config_exception.ConfigException: Invalid kube-config file. Expected key contexts in kube-config\n'}>
[2024-10-30, 16:03:54 UTC] {local_task_job_runner.py:123} ▼ Pre task execution logs
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org