[GitHub] Fokko commented on issue #3914: [AIRFLOW-3069] Log all output of the S3 file transform script

[GitBox <gi...@apache.org>]

Fokko commented on issue #3914: [AIRFLOW-3069] Log all output of the S3 file transform script
URL: https://github.com/apache/incubator-airflow/pull/3914#issuecomment-429271091
 
 
   Thanks @sbilinski 
   
   In the past we had some issues with separate stdout and stderr. What happend is that when the stderr buffer would fill up, and it wasn't being consumed, because it was still reading the stdout as long as the process lives, it would freeze in the end because of the full stderr buffer. This is a known bug which we've fixed in the bash_operator by piping stderr to stdout: https://github.com/apache/incubator-airflow/blob/master/airflow/operators/bash_operator.py#L112

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services