[GitHub] [airflow] potiuk commented on issue #17605: Airflow stdout not working/console problem

[GitBox <gi...@apache.org>]

potiuk commented on issue #17605:
URL: https://github.com/apache/airflow/issues/17605#issuecomment-898536080


   You have no written how you deployed your Airflow.
   
   From the looks of it - the fact that the logs were still printed in log files of airflow -  I am almost 100% sure,your changes had a typo or they were not applied (for example you have not restarted the pods after changing the configuration.
   
   The easiest way you can check it is, to dump information about your loggers when you are printing logs. When you get the logger, you should be able to see how your logging configuration looks like in your task (you could print it to the logs since they are stored as files). This is explained for example here:
   https://stackoverflow.com/questions/31599940/how-to-print-current-logging-configuration-used-by-the-python-logging-module
   
   I am almost sure that when you try to do it, you will see that your custom configuration has not been actually applied and you will need to investigate why.
   
   Note that ALL your pods and workers (whatever deployment you have) have to have exactly the same configuration. Airflow is a distributed system, and you have to make sure that if you change the configuration, the configuration is available in all your machines and workers (for example by sharing a common image with the configuration or applying the helm chart).
   
   My very wild guess is that you applied the configuration change only on one machine (scheduler for example) but the same configuration has not been updated on the workers or pods that you use to run tasks.
   
   I am closing this as invalid until you do some more investigation in this direction and double-check that your configuration is properly applied.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org