You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "tommyhutcheson (via GitHub)" <gi...@apache.org> on 2023/09/27 09:06:54 UTC
[GitHub] [airflow] tommyhutcheson opened a new issue, #34644: Invalid kube-config file. Expected key current-context in kube-config when using deferrable=True
tommyhutcheson opened a new issue, #34644:
URL: https://github.com/apache/airflow/issues/34644
### Apache Airflow version
Other Airflow 2 version (please specify below)
### What happened
Hello
We are trying to use the deferrable option with the KubernetesPodOperator for the first time but we can't get past the error `Invalid kube-config file. Expected key current-context in kube-config` when using deferrable=True.
We run airflow via cloud composer in GCP and first upgraded to composer-2.3.2-airflow-2.5.1 but had the issue so upgraded again to composer-2.4.3-airflow-2.5.3 having seen some [posts about a fix](https://airflow.apache.org/docs/apache-airflow-providers-cncf-kubernetes/7.6.0/changelog.html#id28:~:text=add%20missing%20read%20for%20K8S%20config%20file%20from%20conn%20in%20deferred%20%27KubernetesPodOperator%27%C2%A0%20(%2329498)) in version 7.0.0 but we're still faced with the issue.
I have stripping the DAG operator back to basics :
```
task1 = KubernetesPodOperator(
name="hello-world",
image="python:3.11-slim",
cmds=['python', '-c'],
arguments=["print('hello world')"],
task_id="dummy_run",
config_file="/home/airflow/composer_kube_config",
deferrable=True
)
```
operator is being imported from airflow.providers.cncf.kubernetes.operators.pod import KubernetesPodOperator
Error:
`
[2023-09-27, 08:48:03 UTC] {taskinstance.py:1778} ERROR - Task failed with exception
Traceback (most recent call last):
File "/opt/python3.8/lib/python3.8/site-packages/airflow/providers/cncf/kubernetes/operators/pod.py", line 648, in execute_complete
raise AirflowException(event["message"])
airflow.exceptions.AirflowException: Invalid kube-config file. Expected key current-context in kube-config
`
Cloud composer 2 [guide states](https://cloud.google.com/composer/docs/composer-2/use-kubernetes-pod-operator#:~:text=%C2%A0%20%C2%A0%20%C2%A0%20%C2%A0%20%23%20Sets%20the%20config%20file%20to%20a%20kubernetes%20config%20file%20specified%20in%0A%C2%A0%20%C2%A0%20%C2%A0%20%C2%A0%20%23%20airflow.cfg.%20If%20the%20configuration%20file%20does%20not%20exist%20or%20does%0A%C2%A0%20%C2%A0%20%C2%A0%20%C2%A0%20%23%20not%20provide%20validcredentials%20the%20pod%20will%20fail%20to%20launch.%20If%20not%0A%C2%A0%20%C2%A0%20%C2%A0%20%C2%A0%20%23%20specified%2C%20config_file%20defaults%20to%20~/.kube/config) that we need to set the config_file to /home/airflow/composer_kube_config but the error we get seems to imply that the file is missing an expected key current-context. I raised this with google who suggested raisin this ticket here and stating that their product team confirmed that this issue is due to a problem with Airflow.
### What you think should happen instead
Dag runs with deferrable=True parameter set, in this case printing hello world to the logs.
### How to reproduce
Deploy the sample dag to airflow 2.5.3 if possible using cloud composer 2.4.3
``` from airflow.providers.cncf.kubernetes.operators.pod import KubernetesPodOperator
from airflow.providers.google.cloud.operators.kubernetes_engine import GKEStartPodOperator
import airflow
from airflow import DAG
from datetime import timedelta
default_args = {
'start_date': airflow.utils.dates.days_ago(0),
'retries': 1,
'retry_delay': timedelta(minutes=5)
}
with DAG(
'tommy_test_kub_simple_dag',
default_args=default_args,
description='liveness monitoring dag',
schedule_interval='*/10 * * * *',
max_active_runs=2,
catchup=False,
dagrun_timeout=timedelta(minutes=10),
) as dag:
task1 = KubernetesPodOperator(
name="hello-world",
image="python:3.11-slim",
cmds=['python', '-c'],
arguments=["print('hello world')"],
task_id="dummy_run",
config_file="/home/airflow/composer_kube_config",
deferrable=True
)
task1
```
### Operating System
debian:11-slim
### Versions of Apache Airflow Providers
2023-09-27, 09:05:31 UTC] {subprocess.py:75} INFO - Running command: ['/usr/bin/bash', '-c', 'pip freeze']
[2023-09-27, 09:05:32 UTC] {subprocess.py:86} INFO - Output:
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - absl-py @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/absl_py-1.4.0-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - agate @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/agate-1.6.3-py2.py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - aiodebug @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/aiodebug-2.3.0-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - aiofiles @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/aiofiles-23.2.1-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - aiohttp @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/aiohttp-3.8.5-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - aiosignal @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/aiosignal-1.3.1-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - alembic @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/alembic-1.10.2-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - amqp @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/amqp-5.1.1-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - anyio @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/anyio-3.6.2-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - apache-airflow @ file:///usr/local/lib/airflow
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - apache-airflow-providers-amazon==8.2.0
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - apache-airflow-providers-apache-beam @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/apache_airflow_providers_apache_beam-5.2.2-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - apache-airflow-providers-cncf-kubernetes @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/apache_airflow_providers_cncf_kubernetes-7.3.0-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - apache-airflow-providers-common-sql @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/apache_airflow_providers_common_sql-1.7.1-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - apache-airflow-providers-dbt-cloud @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/apache_airflow_providers_dbt_cloud-3.2.3-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - apache-airflow-providers-ftp @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/apache_airflow_providers_ftp-3.5.1-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - apache-airflow-providers-google @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/apache_airflow_providers_google-10.7.0-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - apache-airflow-providers-hashicorp @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/apache_airflow_providers_hashicorp-3.4.2-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - apache-airflow-providers-http @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/apache_airflow_providers_http-4.5.1-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - apache-airflow-providers-imap @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/apache_airflow_providers_imap-3.3.1-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - apache-airflow-providers-mysql @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/apache_airflow_providers_mysql-5.2.0-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - apache-airflow-providers-postgres @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/apache_airflow_providers_postgres-5.6.0-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - apache-airflow-providers-sendgrid @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/apache_airflow_providers_sendgrid-3.2.2-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - apache-airflow-providers-sftp==4.6.1
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - apache-airflow-providers-sqlite @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/apache_airflow_providers_sqlite-3.4.3-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - apache-airflow-providers-ssh @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/apache_airflow_providers_ssh-3.7.2-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - apache-beam @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/apache_beam-2.50.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - apispec @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/apispec-3.3.2-py2.py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - appdirs==1.4.4
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - argcomplete @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/argcomplete-3.0.5-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - asgiref @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/asgiref-3.7.2-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - asn1crypto==1.5.1
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - astronomer-providers==1.17.3
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - astunparse @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/astunparse-1.6.3-py2.py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - async-timeout @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/async_timeout-4.0.2-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - asyncssh==2.13.2
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - attrs @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/attrs-22.2.0-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - Babel @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/Babel-2.12.1-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - backoff @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/backoff-2.2.1-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - bcrypt @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/bcrypt-4.0.1-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - beautifulsoup4==4.12.2
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - billiard @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/billiard-3.6.4.0-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - blinker @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/blinker-1.5-py2.py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - boto3==1.28.54
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - botocore==1.31.54
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - cachecontrol @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/cachecontrol-0.13.1-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - cachelib @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/cachelib-0.9.0-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - cachetools @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/cachetools-5.3.0-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - cattrs @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/cattrs-22.2.0-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - celery @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/celery-5.2.7-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - certifi @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/certifi-2022.12.7-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - cffi @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/cffi-1.15.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - chardet @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/chardet-4.0.0-py2.py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - charset-normalizer @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/charset_normalizer-3.1.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - click @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/click-8.1.3-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - click-didyoumean @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/click_didyoumean-0.3.0-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - click-plugins @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/click_plugins-1.1.1-py2.py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - click-repl @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/click_repl-0.2.0-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - clickclick @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/clickclick-20.10.2-py2.py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - cloudpickle @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/cloudpickle-2.2.1-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - colorama @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/colorama-0.4.6-py2.py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - colorlog @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/colorlog-4.8.0-py2.py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - ConfigUpdater @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/ConfigUpdater-3.1.1-py2.py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - connexion @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/connexion-2.14.2-py2.py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - crcmod @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/crcmod-1.7.tar.gz
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - cron-descriptor @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/cron_descriptor-1.2.35.tar.gz
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - croniter @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/croniter-1.3.8-py2.py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - cryptography @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/cryptography-39.0.2-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - db-dtypes @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/db_dtypes-1.1.1-py2.py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - dbt-bigquery @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/dbt_bigquery-1.5.4-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - dbt-core @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/dbt_core-1.5.4-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - dbt-extractor @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/dbt_extractor-0.4.1-cp36-abi3-manylinux_2_5_x86_64.manylinux1_x86_64.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - decorator @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/decorator-5.1.1-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - Deprecated @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/Deprecated-1.2.13-py2.py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - diff-cover @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/diff_cover-7.7.0-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - dill @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/dill-0.3.1.1.tar.gz
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - distlib @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/distlib-0.3.6-py2.py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - dnspython @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/dnspython-2.3.0-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - docopt @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/docopt-0.6.2.tar.gz
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - docutils @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/docutils-0.19-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - email-validator @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/email_validator-1.3.1-py2.py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - exceptiongroup @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/exceptiongroup-1.1.1-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - fastavro @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/fastavro-1.8.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - fasteners @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/fasteners-0.18-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - filelock @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/filelock-3.10.7-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - firebase-admin @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/firebase_admin-6.2.0-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - Flask @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/Flask-2.2.5-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - Flask-AppBuilder @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/Flask_AppBuilder-4.1.4-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - Flask-Babel @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/Flask_Babel-2.0.0-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - Flask-Bcrypt @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/Flask_Bcrypt-1.0.1-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - Flask-Caching @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/Flask_Caching-2.0.2-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - Flask-JWT-Extended @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/Flask_JWT_Extended-4.4.4-py2.py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - Flask-Login @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/Flask_Login-0.6.2-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - Flask-Session @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/Flask_Session-0.4.0-py2.py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - Flask-SQLAlchemy @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/Flask_SQLAlchemy-2.5.1-py2.py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - Flask-WTF @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/Flask_WTF-1.1.1-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - flatbuffers @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/flatbuffers-23.5.26-py2.py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - flower @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/flower-2.0.1-py2.py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - frozenlist @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/frozenlist-1.3.3-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - fsspec @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/fsspec-2023.9.0-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - future @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/future-0.18.3.tar.gz
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - gast @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/gast-0.4.0-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - gcloud-aio-auth @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/gcloud_aio_auth-4.2.1-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - gcloud-aio-bigquery @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/gcloud_aio_bigquery-6.3.0-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - gcloud-aio-storage @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/gcloud_aio_storage-8.3.0-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - gcsfs @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/gcsfs-2023.9.0-py2.py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - google-ads @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_ads-21.3.0-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - google-api-core @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_api_core-2.11.1-py3-none-any.whl
[2023-09-27, 09:05:33 UTC] {subprocess.py:93} INFO - google-api-python-client @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_api_python_client-2.98.0-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-apitools @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_apitools-0.5.32-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-auth @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_auth-2.17.0-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-auth-httplib2 @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_auth_httplib2-0.1.0-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-auth-oauthlib @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_auth_oauthlib-1.0.0-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-access-context-manager @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_access_context_manager-0.1.16-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-aiplatform @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_aiplatform-1.32.0-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-appengine-logging @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_appengine_logging-1.3.1-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-asset @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_asset-3.19.1-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-audit-log @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_audit_log-0.2.5-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-automl @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_automl-2.11.2-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-batch @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_batch-0.16.0-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-bigquery @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_bigquery-3.11.4-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-bigquery-datatransfer @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_bigquery_datatransfer-3.12.0-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-bigquery-storage @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_bigquery_storage-2.22.0-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-bigtable @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_bigtable-2.21.0-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-build @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_build-3.20.0-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-common @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_common-1.2.0-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-compute @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_compute-1.14.0-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-container @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_container-2.30.0-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-core @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_core-2.3.3-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-datacatalog @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_datacatalog-3.15.0-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-datacatalog-lineage @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_datacatalog_lineage-0.1.7-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-datacatalog-lineage-producer-client @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_datacatalog_lineage_producer_client-0.0.10-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-dataflow-client @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_dataflow_client-0.8.4-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-dataform @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_dataform-0.5.2-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-dataplex @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_dataplex-1.6.2-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-dataproc @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_dataproc-5.5.0-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-dataproc-metastore @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_dataproc_metastore-1.12.0-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-datastore @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_datastore-2.18.0-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-dlp @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_dlp-3.12.2-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-documentai @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_documentai-2.18.0-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-filestore @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_filestore-1.6.1-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-firestore @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_firestore-2.11.1-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-kms @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_kms-2.19.1-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-language @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_language-2.11.0-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-logging @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_logging-3.6.0-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-memcache @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_memcache-1.7.2-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-monitoring @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_monitoring-2.15.1-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-orchestration-airflow @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_orchestration_airflow-1.9.1-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-org-policy @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_org_policy-1.8.2-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-os-config @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_os_config-1.15.2-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-os-login @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_os_login-2.10.0-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-pubsub @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_pubsub-2.18.3-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-pubsublite @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_pubsublite-0.6.1-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-redis @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_redis-2.13.1-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-resource-manager==1.10.1
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-run @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_run-0.9.1-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-secret-manager @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_secret_manager-2.16.3-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-spanner @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_spanner-3.40.1-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-speech @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_speech-2.21.0-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-storage @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_storage-2.10.0-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-storage-transfer @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_storage_transfer-1.9.1-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-tasks @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_tasks-2.14.1-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-texttospeech @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_texttospeech-2.14.1-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-translate @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_translate-3.12.0-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-videointelligence @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_videointelligence-2.11.3-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-vision @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_vision-3.4.4-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-cloud-workflows @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_cloud_workflows-1.11.0-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-crc32c @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_crc32c-1.5.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-pasta @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_pasta-0.2.0-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - google-resumable-media @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/google_resumable_media-2.6.0-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - googleapis-common-protos @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/googleapis_common_protos-1.60.0-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - graphviz @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/graphviz-0.20.1-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - greenlet @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/greenlet-2.0.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - grpc-google-iam-v1 @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/grpc_google_iam_v1-0.12.6-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - grpcio @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/grpcio-1.57.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - grpcio-gcp @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/grpcio_gcp-0.2.2-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - grpcio-status @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/grpcio_status-1.57.0-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - gunicorn @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/gunicorn-20.1.0-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - h11 @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/h11-0.14.0-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - h5py @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/h5py-3.9.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - hdfs @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/hdfs-2.7.2.tar.gz
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - hologram @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/hologram-0.0.16-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - httpcore @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/httpcore-0.16.3-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - httplib2 @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/httplib2-0.22.0-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - httpx @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/httpx-0.23.3-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - humanize @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/humanize-4.6.0-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - hvac @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/hvac-1.2.0-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - idna @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/idna-3.4-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - importlib-metadata @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/importlib_metadata-4.13.0-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - importlib-resources @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/importlib_resources-5.12.0-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - inflection @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/inflection-0.5.1-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - iniconfig @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/iniconfig-2.0.0-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - isodate @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/isodate-0.6.1-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - itsdangerous @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/itsdangerous-2.1.2-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - jaraco.classes @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/jaraco.classes-3.3.0-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - jeepney @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/jeepney-0.8.0-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - Jinja2 @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/Jinja2-3.1.2-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - jmespath==1.0.1
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - json-merge-patch @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/json-merge-patch-0.2.tar.gz
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - jsonpath-ng==1.6.0
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - jsonschema @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/jsonschema-4.19.0-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - jsonschema-specifications @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/jsonschema_specifications-2023.7.1-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - keras @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/keras-2.13.1-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - keyring @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/keyring-24.2.0-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - keyrings.google-artifactregistry-auth @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/keyrings.google_artifactregistry_auth-1.1.2-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - kombu @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/kombu-5.2.4-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - kubernetes @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/kubernetes-23.6.0-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - kubernetes-asyncio @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/kubernetes_asyncio-24.2.3-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - lazy-object-proxy @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/lazy_object_proxy-1.9.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - leather @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/leather-0.3.4-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - libclang @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/libclang-16.0.6-py2.py3-none-manylinux2010_x86_64.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - linkify-it-py @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/linkify_it_py-2.0.0-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - lockfile @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/lockfile-0.12.2-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - Logbook @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/Logbook-1.5.3.tar.gz
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - looker-sdk @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/looker_sdk-23.14.1-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - lxml==4.9.3
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - Mako @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/Mako-1.2.4-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - Markdown @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/Markdown-3.4.3-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - markdown-it-py @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/markdown_it_py-2.2.0-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - MarkupSafe @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/MarkupSafe-2.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - marshmallow @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/marshmallow-3.19.0-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - marshmallow-enum @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/marshmallow_enum-1.5.1-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - marshmallow-oneofschema @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/marshmallow_oneofschema-3.0.1-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - marshmallow-sqlalchemy @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/marshmallow_sqlalchemy-0.26.1-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - mashumaro @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/mashumaro-3.6-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - mdit-py-plugins @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/mdit_py_plugins-0.3.5-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - mdurl @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/mdurl-0.1.2-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - minimal-snowplow-tracker @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/minimal-snowplow-tracker-0.0.2.tar.gz
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - more-itertools @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/more_itertools-9.1.0-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - msgpack @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/msgpack-1.0.5-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - multidict @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/multidict-6.0.4-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - mypy-boto3-appflow==1.28.42
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - mypy-boto3-rds==1.28.41
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - mypy-boto3-redshift-data==1.28.36
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - mypy-boto3-s3==1.28.52
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - mysqlclient @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/mysqlclient-2.2.0.tar.gz
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - networkx @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/networkx-2.8.8-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - numpy @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/numpy-1.24.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - oauth2client @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/oauth2client-4.1.3-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - oauthlib @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/oauthlib-3.2.2-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - objsize @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/objsize-0.6.1-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - opt-einsum @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/opt_einsum-3.3.0-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - orjson @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/orjson-3.9.5-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - overrides @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/overrides-6.5.0-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - packaging @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/packaging-23.0-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - pandas @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/pandas-1.5.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - pandas-gbq @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/pandas_gbq-0.19.2-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - paramiko @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/paramiko-3.3.1-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - parsedatetime @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/parsedatetime-2.4.tar.gz
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - pathspec @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/pathspec-0.9.0-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - pendulum @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/pendulum-2.1.2-cp38-cp38-manylinux1_x86_64.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - pipdeptree @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/pipdeptree-2.13.0-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - pkgutil-resolve-name @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/pkgutil_resolve_name-1.3.10-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - platformdirs @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/platformdirs-3.2.0-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - pluggy @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/pluggy-1.0.0-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - ply==3.11
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - prison @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/prison-0.2.1-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - prometheus-client @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/prometheus_client-0.16.0-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - prompt-toolkit @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/prompt_toolkit-3.0.38-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - proto-plus @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/proto_plus-1.22.3-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - protobuf @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/protobuf-4.23.4-cp37-abi3-manylinux2014_x86_64.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - psutil @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/psutil-5.9.4-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - psycopg2 @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/psycopg2-2.9.7.tar.gz
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - psycopg2-binary @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/psycopg2_binary-2.9.7-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - pyarrow @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/pyarrow-11.0.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - pyasn1 @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/pyasn1-0.4.8-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - pyasn1-modules @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/pyasn1_modules-0.2.8-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - pycparser @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/pycparser-2.21-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - pydata-google-auth @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/pydata_google_auth-1.8.2-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - pydot @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/pydot-1.4.2-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - Pygments @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/Pygments-2.16.1-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - pyhcl @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/pyhcl-0.4.5-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - PyJWT @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/PyJWT-2.6.0-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - pymongo @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/pymongo-4.5.0-cp38-cp38-manylinux2014_x86_64.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - PyNaCl @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/PyNaCl-1.5.0-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.manylinux_2_24_x86_64.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - pyOpenSSL @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/pyOpenSSL-23.2.0-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - pyparsing @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/pyparsing-3.1.1-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - pytest @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/pytest-7.4.1-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - python-daemon @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/python_daemon-3.0.1-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - python-dateutil @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/python_dateutil-2.8.2-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - python-http-client @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/python_http_client-3.3.7-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - python-nvd3 @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/python-nvd3-0.15.0.tar.gz
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - python-slugify @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/python_slugify-8.0.1-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - pytimeparse @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/pytimeparse-1.1.8-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - pytz @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/pytz-2023.3-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - pytzdata @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/pytzdata-2020.1-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - PyYAML @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/PyYAML-6.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - redis @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/redis-3.5.3-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - redshift-connector==2.0.914
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - referencing @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/referencing-0.30.2-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - regex @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/regex-2023.8.8-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - requests @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/requests-2.28.2-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - requests-oauthlib @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/requests_oauthlib-1.3.1-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - requests-toolbelt @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/requests_toolbelt-1.0.0-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - rfc3339-validator @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/rfc3339_validator-0.1.4-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - rfc3986 @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/rfc3986-1.5.0-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - rich @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/rich-13.3.3-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - rpds-py @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/rpds_py-0.10.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - rsa @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/rsa-4.9-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - s3transfer==0.6.2
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - scramp==1.4.4
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - SecretStorage @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/SecretStorage-3.3.3-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - sendgrid @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/sendgrid-6.10.0-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - setproctitle @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/setproctitle-1.3.2-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - Shapely @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/Shapely-1.8.5.post1-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - six==1.16.0
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - sniffio @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/sniffio-1.3.0-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - soupsieve==2.5
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - SQLAlchemy @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/SQLAlchemy-1.4.47-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - sqlalchemy-bigquery @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/sqlalchemy_bigquery-1.8.0-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - SQLAlchemy-JSONField @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/SQLAlchemy_JSONField-1.0.1.post0-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - sqlalchemy-redshift==0.8.14
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - sqlalchemy-spanner @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/sqlalchemy_spanner-1.6.2-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - SQLAlchemy-Utils @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/SQLAlchemy_Utils-0.40.0-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - sqlfluff @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/sqlfluff-2.1.4-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - sqllineage @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/sqllineage-1.4.7-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - sqlparse @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/sqlparse-0.4.4-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - sshtunnel @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/sshtunnel-0.4.0-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - starkbank-ecdsa @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/starkbank-ecdsa-2.2.0.tar.gz
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - statsd @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/statsd-4.0.1-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - tabulate @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/tabulate-0.9.0-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - tblib @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/tblib-2.0.0-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - tenacity @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/tenacity-8.2.2-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - tensorboard @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/tensorboard-2.13.0-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - tensorboard-data-server @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/tensorboard_data_server-0.7.1-py3-none-manylinux2014_x86_64.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - tensorflow @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/tensorflow-2.13.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - tensorflow-estimator @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/tensorflow_estimator-2.13.0-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - tensorflow-io-gcs-filesystem @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/tensorflow_io_gcs_filesystem-0.33.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - termcolor @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/termcolor-2.2.0-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - text-unidecode @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/text_unidecode-1.3-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - toml @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/toml-0.10.2-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - tomli @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/tomli-2.0.1-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - tornado @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/tornado-6.2-cp37-abi3-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - tqdm @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/tqdm-4.66.1-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - typing-extensions @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/typing_extensions-4.5.0-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - uc-micro-py @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/uc_micro_py-1.0.1-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - unicodecsv @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/unicodecsv-0.14.1.tar.gz
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - uritemplate @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/uritemplate-4.1.1-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - urllib3 @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/urllib3-1.26.15-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - vine @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/vine-5.0.0-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - virtualenv @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/virtualenv-20.21.0-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - watchtower==2.0.1
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - wcwidth @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/wcwidth-0.2.6-py2.py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - websocket-client @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/websocket_client-1.5.1-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - Werkzeug @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/Werkzeug-2.2.3-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - wrapt @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/wrapt-1.15.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - WTForms @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/WTForms-3.0.1-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - yarl @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/yarl-1.8.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - zipp @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/zipp-3.15.0-py3-none-any.whl
[2023-09-27, 09:05:34 UTC] {subprocess.py:93} INFO - zstandard @ file:///usr/local/lib/airflow-pypi-dependencies-2.5.3/python3.8/zstandard-0.21.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
### Deployment
Google Cloud Composer
### Deployment details
composer-2.4.3-airflow-2.5.3
### Anything else
_No response_
### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Invalid kube-config file. Expected key current-context in kube-config when using deferrable=True [airflow]
Posted by "functicons (via GitHub)" <gi...@apache.org>.
functicons commented on issue #34644:
URL: https://github.com/apache/airflow/issues/34644#issuecomment-1816937672
I feel like the error messages and logs need to be improved. The current ones are not sufficient to figure out what went wrong in the trigger/hook.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Invalid kube-config file. Expected key current-context in kube-config when using deferrable=True [airflow]
Posted by "bjankie1 (via GitHub)" <gi...@apache.org>.
bjankie1 commented on issue #34644:
URL: https://github.com/apache/airflow/issues/34644#issuecomment-1872146456
Before https://github.com/apache/airflow/pull/29498 the flow was as following:
1. In the operator `config_file` was read and deserialized to a map.
2. Serialized config was passed to the trigger as argument.,
This way 2 things were achieved:
1. Reading file in the trigger which is a blocking operation.
2. Dependency on the file synchronization between components that run trigger and operator. Which means consistency.
@hussein-awala Why has this process been reverted in https://github.com/apache/airflow/pull/29498 ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Invalid kube-config file. Expected key current-context in kube-config when using deferrable=True [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #34644:
URL: https://github.com/apache/airflow/issues/34644#issuecomment-2450315930
@MCMcCallum @raphaelauv -> when you encounter closed issue (Especially closed months ago) with similar description, the best course of action is to open a new one - and describe your circumstances and case - ideally referring to the old issue as related.
This allows to focus on your issue. Which might or might not be related - even if error message is similar. And you have a chance to restart the issue, focusing on - likely - much more fresh circumstances - your Airflow version, your K8s provider version etc. When you add "another" set of things to existing closed issue, it's entirely unclear for anyone who is looking at it - how to reproduce it. Is it the same issue? Or different? Should I look at the original report or a new one? etc.
Also by opening the isssue You own it as an author - and when maintainer ask questions or mark it as "needs more information" it's clear that it's you who should provide it - not the original author, and it's also much more likely that you will do, because it is "fresh".
So I heartily recommend to do so.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Invalid kube-config file. Expected key current-context in kube-config when using deferrable=True [airflow]
Posted by "tommyhutcheson (via GitHub)" <gi...@apache.org>.
tommyhutcheson commented on issue #34644:
URL: https://github.com/apache/airflow/issues/34644#issuecomment-1838656272
Issue ongoing keeping ticket open with author comment.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Invalid kube-config file. Expected key current-context in kube-config when using deferrable=True [airflow]
Posted by "hussein-awala (via GitHub)" <gi...@apache.org>.
hussein-awala commented on issue #34644:
URL: https://github.com/apache/airflow/issues/34644#issuecomment-1861595720
Sorry for the delay. I will try to reproduce it and implement a fix before the next providers' release wave.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Invalid kube-config file. Expected key current-context in kube-config when using deferrable=True [airflow]
Posted by "hussein-awala (via GitHub)" <gi...@apache.org>.
hussein-awala commented on issue #34644:
URL: https://github.com/apache/airflow/issues/34644#issuecomment-1863346284
> @hussein-awala thanks for your input! I will double check whether the config exists in the triggerer pod. But if that was the cause, do you know why in my previous repro, the operator container/pod succeeded with log `hello world deferrable=true`, since the trigger should have failed to trigger it.
It could work with a version < 7.0.0, but since https://github.com/apache/airflow/issues/31322, the behavior was changed by stopping converting the file to dict and providing it to the Trigger, instead, we provide the config file path and we load it in the Trigger. This PR was a bug fix, also there was another reason for it (will explain more later).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Invalid kube-config file. Expected key current-context in kube-config when using deferrable=True [airflow]
Posted by "raphaelauv (via GitHub)" <gi...@apache.org>.
raphaelauv commented on issue #34644:
URL: https://github.com/apache/airflow/issues/34644#issuecomment-2447679632
same problem with
airflow==2.10.2 apache-airflow-providers-cncf-kubernetes==9.0.0
kind 0.24.0
```
kind get kubeconfig --internal > conf/kube_conf
```
airflow connection
```json
"kubernetes_default": {
"conn_type": "kubernetes",
"extra": "{\"extra__kubernetes__in_cluster\": false, \"extra__kubernetes__kube_config_path\": \"/opt/airflow/include/.kube/config\", \"extra__kubernetes__namespace\": \"default\", \"extra__kubernetes__cluster_context\": \"kind-kind\", \"extra__kubernetes__disable_verify_ssl\": false, \"extra__kubernetes__disable_tcp_keepalive\": false, \"xcom_sidecar_container_image\": \"alpine:3.16.2\"}"
}
```
```log
[2024-10-30, 16:03:51 UTC] {base.py:84} INFO - Retrieving connection 'kubernetes_default'
[2024-10-30, 16:03:51 UTC] {pod.py:1138} INFO - Building pod airflow-test-pod-xb472z6z with labels: {'dag_id': 'kubernetes_dag', 'task_id': 'task-one', 'run_id': 'manual__2024-10-30T160350.5676190000-e2f6ac7ec', 'kubernetes_pod_operator': 'True', 'try_number': '1'}
[2024-10-30, 16:03:51 UTC] {taskinstance.py:288} INFO - Pausing task as DEFERRED. dag_id=kubernetes_dag, task_id=task-one, run_id=manual__2024-10-30T16:03:50.567619+00:00, execution_date=20241030T160350, start_date=20241030T160351
[2024-10-30, 16:03:51 UTC] {taskinstance.py:340} ▼ Post task execution logs
[2024-10-30, 16:03:51 UTC] {local_task_job_runner.py:260} INFO - Task exited with return code 100 (task deferral)
[2024-10-30, 16:03:51 UTC] {local_task_job_runner.py:245} ▲▲▲ Log group end
[2024-10-30, 16:03:52 UTC] {pod.py:160} INFO - Checking pod 'airflow-test-pod-xb472z6z' in namespace 'default'.
[2024-10-30, 16:03:52 UTC] {base.py:84} INFO - Retrieving connection 'kubernetes_default'
[2024-10-30, 16:03:52 UTC] {kube_config.py:515} WARNING - Config not found: /home/airflow/.kube/config
[2024-10-30, 16:03:52 UTC] {triggerer_job_runner.py:631} INFO - Trigger kubernetes_dag/manual__2024-10-30T16:03:50.567619+00:00/task-one/-1/1 (ID 10) fired: TriggerEvent<{'name': 'airflow-test-pod-xb472z6z', 'namespace': 'default', 'status': 'error', 'message': 'Invalid kube-config file. Expected key contexts in kube-config', 'stack_trace': 'Traceback (most recent call last):\n File "/home/airflow/.local/lib/python3.12/site-packages/airflow/providers/cncf/kubernetes/triggers/pod.py", line 162, in run\n state = await self._wait_for_pod_start()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/home/airflow/.local/lib/python3.12/site-packages/airflow/providers/cncf/kubernetes/triggers/pod.py", line 223, in _wait_for_pod_start\n pod = await self.hook.get_pod(self.pod_name, self.pod_namespace)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/home/airflow/.local/lib/python3.12/site-packages/airflow/providers/cncf/kubernetes/hooks/kubernetes.py
", line 754, in get_pod\n async with self.get_conn() as connection:\n ^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/contextlib.py", line 210, in __aenter__\n return await anext(self.gen)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/home/airflow/.local/lib/python3.12/site-packages/airflow/providers/cncf/kubernetes/hooks/kubernetes.py", line 741, in get_conn\n kube_client = await self._load_config() or async_client.ApiClient()\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/home/airflow/.local/lib/python3.12/site-packages/airflow/providers/cncf/kubernetes/hooks/kubernetes.py", line 711, in _load_config\n await async_config.load_kube_config(\n File "/home/airflow/.local/lib/python3.12/site-packages/kubernetes_asyncio/config/kube_config.py", line 603, in load_kube_config\n loader = _get_kube_config_loader_for_yaml_file(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/home/airflow/.local/lib/python3.12/site-packages/kubernetes_async
io/config/kube_config.py", line 567, in _get_kube_config_loader_for_yaml_file\n return KubeConfigLoader(\n ^^^^^^^^^^^^^^^^^\n File "/home/airflow/.local/lib/python3.12/site-packages/kubernetes_asyncio/config/kube_config.py", line 150, in __init__\n self.set_active_context(active_context)\n File "/home/airflow/.local/lib/python3.12/site-packages/kubernetes_asyncio/config/kube_config.py", line 162, in set_active_context\n self._current_context = self._config[\'contexts\'].get_with_name(\n ~~~~~~~~~~~~^^^^^^^^^^^^\n File "/home/airflow/.local/lib/python3.12/site-packages/kubernetes_asyncio/config/kube_config.py", line 448, in __getitem__\n raise ConfigException(\nkubernetes_asyncio.config.config_exception.ConfigException: Invalid kube-config file. Expected key contexts in kube-config\n'}>
[2024-10-30, 16:03:54 UTC] {local_task_job_runner.py:123} ▼ Pre task execution logs
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Invalid kube-config file. Expected key current-context in kube-config when using deferrable=True [airflow]
Posted by "tommyhutcheson (via GitHub)" <gi...@apache.org>.
tommyhutcheson commented on issue #34644:
URL: https://github.com/apache/airflow/issues/34644#issuecomment-1761957965
Hi @hussein-awala
I have tried quite a few different configurations at this point but there just seems to be an issue here.
when running the below dag the only task that completes is the deferrable-false task, the other two look to be running the code and output hello-world with deferrable set and I see the dag status change to purple however the runs are failing still with the error below, I have checked the kube-config file and I can see there is a key contexts. I have re-opened by Google support case to asking their product team to test the dag themselves and install composer-2.4.3-airflow-2.5.3. If there is another suggests please let me know.
### ERROR
```
[2023-10-13, 14:38:27 UTC] {standard_task_runner.py:100} ERROR - Failed to execute job 48004 for task deferrable-true-extended-conf (Invalid kube-config file. Expected key contexts in kube-config;
743598)
```
### TESTING DAG
```
from airflow.providers.cncf.kubernetes.operators.pod import KubernetesPodOperator
import airflow
from airflow import DAG
from datetime import timedelta
default_args = {
'start_date': airflow.utils.dates.days_ago(0),
'retries': 1,
'retry_delay': timedelta(minutes=5)
}
with DAG(
'tommy_test_kub_simple_dag',
default_args=default_args,
description='liveness monitoring dag',
schedule_interval='*/10 * * * *',
max_active_runs=2,
catchup=False,
dagrun_timeout=timedelta(minutes=10),
) as dag:
task1 = KubernetesPodOperator(
name="deferrable-true",
image="python:3.11-slim",
cmds=['python', '-c', "print('hello world')"],
task_id="deferrable-true",
config_file="/home/airflow/composer_kube_config",
deferrable=True,
in_cluster=False
)
task2 = KubernetesPodOperator(
name="deferrable-false",
image="python:3.11-slim",
cmds=['python', '-c', "print('hello world')"],
task_id="deferrable-false",
config_file="/home/airflow/composer_kube_config",
deferrable=False,
in_cluster=False
)
task3 = KubernetesPodOperator(
name="deferrable-true-extended-conf",
image="python:3.11-slim",
cmds=['python', '-c', "print('hello world')"],
task_id="deferrable-true-extended-conf",
kubernetes_conn_id="kubernetes_default",
deferrable=True,
in_cluster=False,
cluster_context="gke_my_orchestrater_id",
config_file="/home/airflow/composer_kube_config",
)
task1
task2
task3
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Invalid kube-config file. Expected key current-context in kube-config when using deferrable=True [airflow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #34644:
URL: https://github.com/apache/airflow/issues/34644#issuecomment-1933149008
This issue has been automatically marked as stale because it has been open for 14 days with no response from the author. It will be closed in next 7 days if no further activity occurs from the issue author.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Invalid kube-config file. Expected key current-context in kube-config when using deferrable=True [airflow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #34644:
URL: https://github.com/apache/airflow/issues/34644#issuecomment-1945114873
This issue has been closed because it has not received response from the issue author.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Invalid kube-config file. Expected key current-context in kube-config when using deferrable=True [airflow]
Posted by "functicons (via GitHub)" <gi...@apache.org>.
functicons commented on issue #34644:
URL: https://github.com/apache/airflow/issues/34644#issuecomment-1815815355
@hussein-awala, any idea about the observations above?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Invalid kube-config file. Expected key current-context in kube-config when using deferrable=True [airflow]
Posted by "apilaskowski (via GitHub)" <gi...@apache.org>.
apilaskowski commented on issue #34644:
URL: https://github.com/apache/airflow/issues/34644#issuecomment-1838549521
@potiuk @hussein-awala can you please chime in?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Invalid kube-config file. Expected key current-context in kube-config when using deferrable=True [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #34644:
URL: https://github.com/apache/airflow/issues/34644#issuecomment-1856081623
The lack of more details seems to be because the message is not coming from airflow but from the POD. The message is "just" displayed by the airflow's KPO and the error is somewhere on the POD.
There are likely two ways you can address your problem @tommyhutcheson:
* if you can upgrade to the latest version of Kubernetes Provider then you have a chance that a) problem has been fixed there b) logging will be more comprehensive. You are using pretty old version of the provider (7.3.0) where 7.11.0 is already available and there were numerous improvements and bugfixes implemented there See the https://airflow.apache.org/docs/apache-airflow-providers-cncf-kubernetes/stable/changelog.html . One of the changes implemented in 7.7.0 for example improved multi-line handling of logs by KPO https://github.com/apache/airflow/pull/34412 but there were many more and if you want to be more certain if you should upgrade, I recommend you to go and read in detail the changelog. Each change there contains reference to PR# and you can find and look at the PR where you will find detailed description of all the changes - since it is an open-source project and all is "in the clear".
* Another option is to take a look at the detailed logs of your k8s Pods that are failing. I do not know KPO that well and what kind of flexibility the K8S interface Composer gives you, but I believe you can set KPO in the mode that it wil not be clearing PODs immediately after running and you will be able to inspect much more information - seems you recognize the need of having more detailed information what's going on, so if you would like to analyse it in detail before upgrading, it's likely the way to go.
However, I'd urge you to upgrade everything you can first. Many of our users experience problems that have long been solved and in this case there are quite many issues implemented since your version. You can either attempt it in the way that you want to be sure that you should upgrade (in which case I advise you to do detailed analysis of the changelog) or **just upgrade** and see if you still experience the problem. The latter is usually faster, and takes less time - both for you and volunteers here who have no time to go through detailed list of changelog just to make sure partcular problems have been fixed. This is an open-source project, so people here help when they have time (they are not paid for it) and in cases like that, it's quite a bit on the user to make sure to make the effort to ugprade to latest version in case they experience problems in later versions - especially in case there were many fixes since.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Invalid kube-config file. Expected key current-context in kube-config when using deferrable=True [airflow]
Posted by "functicons (via GitHub)" <gi...@apache.org>.
functicons commented on issue #34644:
URL: https://github.com/apache/airflow/issues/34644#issuecomment-1869733961
> It could work with a version < 7.0.0, but since #31322 ...
It doesn't seem to be related, because the original problem occurred with 7.3.0, and I also reproduced the error with 7.9.0 in composer-2.5.2-airflow-2.6.3. I'm still trying to figure out how to verify the file exists in Trigger Pod.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Invalid kube-config file. Expected key current-context in kube-config when using deferrable=True [airflow]
Posted by "hussein-awala (via GitHub)" <gi...@apache.org>.
hussein-awala commented on issue #34644:
URL: https://github.com/apache/airflow/issues/34644#issuecomment-1861752253
Could you provide the Kubernetes conn you are using in your operator? (you can hide the confidential information)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Invalid kube-config file. Expected key current-context in kube-config when using deferrable=True [airflow]
Posted by "functicons (via GitHub)" <gi...@apache.org>.
functicons commented on issue #34644:
URL: https://github.com/apache/airflow/issues/34644#issuecomment-1863311359
@hussein-awala thanks for your input! I will double check whether the config exists in the triggerer pod. But if that was the cause, do you know why in my previous repro, the operator container/pod succeeded with log `hello world deferrable=true`, since the trigger should have failed to trigger it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Invalid kube-config file. Expected key current-context in kube-config when using deferrable=True [airflow]
Posted by "functicons (via GitHub)" <gi...@apache.org>.
functicons commented on issue #34644:
URL: https://github.com/apache/airflow/issues/34644#issuecomment-1837054949
Friendly ping!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Invalid kube-config file. Expected key current-context in kube-config when using deferrable=True [airflow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #34644:
URL: https://github.com/apache/airflow/issues/34644#issuecomment-1836946088
This issue has been automatically marked as stale because it has been open for 14 days with no response from the author. It will be closed in next 7 days if no further activity occurs from the issue author.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Invalid kube-config file. Expected key current-context in kube-config when using deferrable=True [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #34644:
URL: https://github.com/apache/airflow/issues/34644#issuecomment-1863372278
> It could work with a version < 7.0.0, but since #31322, the behavior was changed by stopping converting the file to dict and providing it to the Trigger, instead, we provide the config file path and we load it in the Trigger. This PR was a bug fix, also there was another reason for it (will explain more later).
That would **certainly** explain the behaviour .. Nice one @hussein-awala :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Invalid kube-config file. Expected key current-context in kube-config when using deferrable=True [airflow]
Posted by "hussein-awala (via GitHub)" <gi...@apache.org>.
hussein-awala commented on issue #34644:
URL: https://github.com/apache/airflow/issues/34644#issuecomment-1908440168
> This PR was a bug fix, also there was another reason for it (will explain more later).
For the second reason, here is it: https://www.cve.org/CVERecord?id=CVE-2023-51702
We're working on an improvement for the trigger data stored in the database, once it's released, we will check how can we fix this issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Invalid kube-config file. Expected key current-context in kube-config when using deferrable=True [airflow]
Posted by "hussein-awala (via GitHub)" <gi...@apache.org>.
hussein-awala commented on issue #34644:
URL: https://github.com/apache/airflow/issues/34644#issuecomment-1861825475
I tested `KubernetesPodTrigger` and `AsyncKubernetesHook` with many configuration combinations, and they both worked as expected.
I was able to reproduce the exception in only one case; are you sure the Kubernetes configuration file exists in the Triggerer pod and in the same path as the worker? In all the reports you provided, you confirmed that the config file is present in the worker (for example, when you tested with `BashOperator`). Still, no one mentioned the Triggerer in his investigation.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Invalid kube-config file. Expected key current-context in kube-config when using deferrable=True [airflow]
Posted by "apilaskowski (via GitHub)" <gi...@apache.org>.
apilaskowski commented on issue #34644:
URL: https://github.com/apache/airflow/issues/34644#issuecomment-1781149724
@tommyhutcheson what do you think about avoiding those files and providing Kube Config in JSON, i think it should be possible. Having blocking operations (eg. files handling) in deferrable mode is in most cases a bad design, and I think community should aim to avoid that everywhere. Let me know if it was possible for you to provide this configuration via JSON.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Invalid kube-config file. Expected key current-context in kube-config when using deferrable=True [airflow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #34644: Invalid kube-config file. Expected key current-context in kube-config when using deferrable=True
URL: https://github.com/apache/airflow/issues/34644
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] hussein-awala commented on issue #34644: Invalid kube-config file. Expected key current-context in kube-config when using deferrable=True
Posted by "hussein-awala (via GitHub)" <gi...@apache.org>.
hussein-awala commented on issue #34644:
URL: https://github.com/apache/airflow/issues/34644#issuecomment-1738076701
> Expected key current-context in kube-config
Deferrable and no deferrable operators use the exact same method to load the kube config file since 7.0.0, I'm surprised that you have this exception only in deferrable mode.
Since your config file doesn't have the current-context (default context), I wonder if you added `cluster_context` to your K8S connection? You can also add it to your task if you want to test.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Invalid kube-config file. Expected key current-context in kube-config when using deferrable=True [airflow]
Posted by "functicons (via GitHub)" <gi...@apache.org>.
functicons commented on issue #34644:
URL: https://github.com/apache/airflow/issues/34644#issuecomment-1815745403
I created a BashOperator which prints the kube config in the composer env. It actually has `current-context`. So it is not really a problem with the kube config itself, but somehow the config was not used correctly in async mode.
```
from datetime import datetime
from airflow import DAG
from airflow.operators.bash import BashOperator
dag = DAG('print_kube_config', description='Print Kube Config', schedule_interval='@once', start_date=datetime(2023, 8, 17))
bash_operator = BashOperator(task_id='print_kube_config_task', bash_command='cat /home/airflow/composer_kube_config', dag=dag)
bash_operator
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Invalid kube-config file. Expected key current-context in kube-config when using deferrable=True [airflow]
Posted by "functicons (via GitHub)" <gi...@apache.org>.
functicons commented on issue #34644:
URL: https://github.com/apache/airflow/issues/34644#issuecomment-1815764689
I reproduced the problem with the following DAG:
```
from airflow.providers.cncf.kubernetes.operators.pod import KubernetesPodOperator
import airflow
from airflow import DAG
from datetime import timedelta
default_args = {
'start_date': airflow.utils.dates.days_ago(0),
'retries': 1,
'retry_delay': timedelta(minutes=5)
}
with DAG(
'kpo',
default_args=default_args,
description='KPO',
schedule_interval='@once',
max_active_runs=2,
catchup=False,
dagrun_timeout=timedelta(minutes=10),
) as dag:
task1 = KubernetesPodOperator(
name="deferrable-true",
image="python:3.11-slim",
cmds=['python', '-c', "print('hello world deferrable=true')"],
task_id="deferrable-true",
config_file="/home/airflow/composer_kube_config",
deferrable=True,
in_cluster=False
)
task1
```
Very interesting. **The container actually succeeded**, we can see `Container logs: hello world deferrable=true` in logs but the error happened after that.
```
Running: ['airflow', 'tasks', 'run', 'kpo', 'deferrable-true', 'scheduled__2023-11-17T00:00:00+00:00', '--job-id', '5896', '--raw', '--subdir', 'DAGS_FOLDER/kpo.py', '--cfg-path', '/tmp/tmp5vwp6_0t']
Container logs: hello world deferrable=true
2023-11-17 05:03:48.808 UTC
Container logs:
2023-11-17 05:03:48.826 UTC
Pod deferrable-true-b6ju3o4y has phase Pending
2023-11-17 05:03:50.852 UTC
Deleting pod: deferrable-true-b6ju3o4y
2023-11-17 05:03:51.075 UTC
Task failed with exception Traceback (most recent call last): File "/opt/python3.8/lib/python3.8/site-packages/airflow/providers/cncf/kubernetes/operators/pod.py", line 648, in execute_complete raise AirflowException(event["message"]) airflow.exceptions.AirflowException: Invalid kube-config file. Expected key current-context in kube-config
2023-11-17 05:03:51.083 UTC
Marking task as FAILED. dag_id=kpo, task_id=deferrable-true, execution_date=20231117T000000, start_date=20231117T050342, end_date=20231117T050351
2023-11-17 05:03:51.121 UTC
Failed to execute job 5896 for task deferrable-true (Invalid kube-config file. Expected key current-context in kube-config; 1262793)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Invalid kube-config file. Expected key current-context in kube-config when using deferrable=True [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #34644:
URL: https://github.com/apache/airflow/issues/34644#issuecomment-1856083901
Please let us know after you investigate and (hopefully) upgrade how the things go, so that we can (hopefully) close the ticket - in the meantime I mark it as pending response.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] boring-cyborg[bot] commented on issue #34644: Invalid kube-config file. Expected key current-context in kube-config when using deferrable=True
Posted by "boring-cyborg[bot] (via GitHub)" <gi...@apache.org>.
boring-cyborg[bot] commented on issue #34644:
URL: https://github.com/apache/airflow/issues/34644#issuecomment-1737005133
Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Invalid kube-config file. Expected key current-context in kube-config when using deferrable=True [airflow]
Posted by "hussein-awala (via GitHub)" <gi...@apache.org>.
hussein-awala commented on issue #34644:
URL: https://github.com/apache/airflow/issues/34644#issuecomment-1870545710
> It doesn't seem to be related, because the original problem occurred with 7.3.0, and I also reproduced the error with 7.9.0 in composer-2.5.2-[airflow-2](https://issues.apache.org/jira/browse/AIRFLOW-2).6.3.
I said that deferrable mode works fine in a version <7.0.0 without adding the config file to the triggerer; reproducing the problem with 7.3.0 and 7.9.0 does not contradict what I said.
> I'm still trying to figure out how to verify the file exists in Trigger Pod. I'd appreciate if someone can provide a sample code for that!
Quickly checking, I would say that providing extra files to the triggerer is impossible. I recommend contacting the support team of GCP to check with them if this is possible or not, and how they can support it if it's not supported.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Invalid kube-config file. Expected key current-context in kube-config when using deferrable=True [airflow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #34644:
URL: https://github.com/apache/airflow/issues/34644#issuecomment-1907128361
This issue has been automatically marked as stale because it has been open for 14 days with no response from the author. It will be closed in next 7 days if no further activity occurs from the issue author.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org