You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "mjordyn (via GitHub)" <gi...@apache.org> on 2025/01/17 21:29:26 UTC

Re: [I] Log fetches for EcsRunTaskOperator return incomplete logs [airflow]

mjordyn commented on issue #43717:
URL: https://github.com/apache/airflow/issues/43717#issuecomment-2599247441

   I encountered a very similar issue in Airflow 2.10.1 with apache-airflow-providers-amazon==8.28.0. However, in my case, I was running Airflow in a Docker container (Docker Compose), not using MWAA, and the logs missing from the Airflow UI were the first few from each of my ECS tasks. These logs were present in the ECS task CloudWatch log streams. Adding a 10 second sleep statement before the logger.info calls as a workaround caused those logs to appear as expected in the Airflow UI. All of this held true for a few separate `EcsRunTaskOperator` steps calling different ECS tasks.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org