[GitHub] [airflow] potiuk commented on issue #20500: infinite recursion in StreamLogWriter

[GitBox <gi...@apache.org>]

potiuk commented on issue #20500:
URL: https://github.com/apache/airflow/issues/20500#issuecomment-1001575874


   Airflow tasks' stderr and stdout are by default redirected to the task log. this is necessary to capture all the output from the tasks to the log. You cannot really write logs to stderr to the task.
   
   You can send the logs to other loggers but not to stderr - because this is exactly what is happnening - the stderr of your task is routed to the logger, sent to stderr and routed back. 
   
   You can see here for details on how you can customize the logging, but adding logger to write to stderr is not going to work.: https://airflow.apache.org/docs/apache-airflow/stable/logging-monitoring/logging-tasks.html#advanced-configuration
   
   It's a limitation of Airflow in order to handle all the output for tasks (including even unintended stderrr wrting.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org