[GitHub] [airflow] potiuk edited a comment on issue #17993: Allow the default encoding to be set in airflow config to read/write task logs

[GitBox <gi...@apache.org>]

potiuk edited a comment on issue #17993:
URL: https://github.com/apache/airflow/issues/17993#issuecomment-911869434


   Question - how do you want to do it ? 
   
   From what I know, the best and recommended way to set the encoding for python is to configure the right language settings in  environment (basically LANG settings).  Any attempt to do it in python code is a futile effort and is a band-aid rather than solution (especially when you use multiprocessing, forking and multiple entry-points which make Python interpreted started in a new process sometimes in unexpected ways, initialising and importing libraries in different sequence in different processes.
   
   Last time when I checked the only recommended way to set encoding for python was to properly set LANG variables in the underlying operating system. 
   
   Has anything changed since ? What is your idea to approach it and how does it play with all the various multi-process pieces we have (specifically: Celery, Kubernetes, Webserver, Scheduler and LocalExecutor - each use a different way of running  Python processes / multi-processing/billiard).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org