You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "V-S-N-VARMA-PENMETSA (via GitHub)" <gi...@apache.org> on 2025/06/17 10:01:54 UTC

[D] We are facing below error while uploading airflow logs to COS using kubernetes Executer [airflow]

GitHub user V-S-N-VARMA-PENMETSA created a discussion: We are facing below error while uploading airflow logs to COS using kubernetes Executer

We are facing below error while uploading airflow logs to COS using kubernetes Executer, Please find the error below

{"timestamp":"2025-06-17T03:27:07.919199Z","level":"info","event":"Connecting to server:","server":"http://******:8080/execution","logger":"__main__"}
{"timestamp":"2025-06-17T03:27:07.953560Z","level":"info","event":"Secrets backends loaded for worker","count":1,"backend_classes":["EnvironmentVariablesBackend"],"logger":"supervisor"}
{"timestamp":"2025-06-17T03:27:08.508808","level":"info","event":"DAG bundles loaded: dags-folder","logger":"airflow.dag_processing.bundles.manager.DagBundlesManager"}
{"timestamp":"2025-06-17T03:27:08.509330","level":"info","event":"Filling up the DagBag from /opt/airflow/dags/hello_test.py","logger":"airflow.models.dagbag.DagBag"}
{"timestamp":"2025-06-17T03:27:09.340742Z","level":"info","event":"","chan":"stdout","logger":"supervisor"}
{"timestamp":"2025-06-17T03:27:09.340993Z","level":"info","event":" Inside Task-1 sum_function function..........","chan":"stdout","logger":"supervisor"}
{"timestamp":"2025-06-17T03:27:09.513397","level":"info","event":"Connection Retrieved 'cos-airflow-config'","logger":"airflow.hooks.base"}
{"timestamp":"2025-06-17T03:27:09.513661","level":"info","event":"AWS Connection (conn_id='cos-airflow-config', conn_type='aws') credentials retrieved from login and password.","logger":"airflow.providers.amazon.aws.utils.connection_wrapper.AwsConnectionWrapper"}
{"timestamp":"2025-06-17T03:27:10.108110","level":"info","event":"Done. Returned value was: None","logger":"airflow.task.operators.airflow.providers.standard.operators.python.PythonOperator"}
{"event":"Unable to find AWS Connection ID 'cos-airflow-config', switching to empty.","level":"warning","logger":"airflow.task.hooks.airflow.providers.amazon.aws.hooks.s3.S3Hook","timestamp":"2025-06-17T03:27:10.187075Z"}
{"event":"No connection ID provided. Fallback on boto3 credential strategy (region_name=None). See: https://boto3.amazonaws.com/v1/documentation/api/latest/guide/configuration.html","level":"info","logger":"airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory","timestamp":"2025-06-17T03:27:10.187735Z"}
Logs from Jun 17, 2025 to Jun 17, 2025 UTC



GitHub link: https://github.com/apache/airflow/discussions/51830

----
This is an automatically sent email for commits@airflow.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@airflow.apache.org


Re: [D] We are facing below error while uploading airflow logs to COS using kubernetes Executer [airflow]

Posted by "ashb (via GitHub)" <gi...@apache.org>.
GitHub user ashb closed the discussion with a comment: We are facing below error while uploading airflow logs to COS using kubernetes Executer

Reported as an issue in #54603 and will be fixed in 3.0.6

GitHub link: https://github.com/apache/airflow/discussions/51830#discussioncomment-14162475

----
This is an automatically sent email for commits@airflow.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@airflow.apache.org


Re: [D] We are facing below error while uploading airflow logs to COS using kubernetes Executer [airflow]

Posted by "V-S-N-VARMA-PENMETSA (via GitHub)" <gi...@apache.org>.
GitHub user V-S-N-VARMA-PENMETSA closed a discussion: We are facing below error while uploading airflow logs to COS using kubernetes Executer

We are facing below error while uploading airflow logs to COS using kubernetes Executer, Please find the error below

{"timestamp":"2025-06-17T03:27:07.919199Z","level":"info","event":"Connecting to server:","server":"http://******:8080/execution","logger":"__main__"}
{"timestamp":"2025-06-17T03:27:07.953560Z","level":"info","event":"Secrets backends loaded for worker","count":1,"backend_classes":["EnvironmentVariablesBackend"],"logger":"supervisor"}
{"timestamp":"2025-06-17T03:27:08.508808","level":"info","event":"DAG bundles loaded: dags-folder","logger":"airflow.dag_processing.bundles.manager.DagBundlesManager"}
{"timestamp":"2025-06-17T03:27:08.509330","level":"info","event":"Filling up the DagBag from /opt/airflow/dags/hello_test.py","logger":"airflow.models.dagbag.DagBag"}
{"timestamp":"2025-06-17T03:27:09.340742Z","level":"info","event":"","chan":"stdout","logger":"supervisor"}
{"timestamp":"2025-06-17T03:27:09.340993Z","level":"info","event":" Inside Task-1 sum_function function..........","chan":"stdout","logger":"supervisor"}
{"timestamp":"2025-06-17T03:27:09.513397","level":"info","event":"Connection Retrieved 'cos-airflow-config'","logger":"airflow.hooks.base"}
{"timestamp":"2025-06-17T03:27:09.513661","level":"info","event":"AWS Connection (conn_id='cos-airflow-config', conn_type='aws') credentials retrieved from login and password.","logger":"airflow.providers.amazon.aws.utils.connection_wrapper.AwsConnectionWrapper"}
{"timestamp":"2025-06-17T03:27:10.108110","level":"info","event":"Done. Returned value was: None","logger":"airflow.task.operators.airflow.providers.standard.operators.python.PythonOperator"}
{"event":"Unable to find AWS Connection ID 'cos-airflow-config', switching to empty.","level":"warning","logger":"airflow.task.hooks.airflow.providers.amazon.aws.hooks.s3.S3Hook","timestamp":"2025-06-17T03:27:10.187075Z"}
{"event":"No connection ID provided. Fallback on boto3 credential strategy (region_name=None). See: https://boto3.amazonaws.com/v1/documentation/api/latest/guide/configuration.html","level":"info","logger":"airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory","timestamp":"2025-06-17T03:27:10.187735Z"}
Logs from Jun 17, 2025 to Jun 17, 2025 UTC



GitHub link: https://github.com/apache/airflow/discussions/51830

----
This is an automatically sent email for commits@airflow.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@airflow.apache.org