You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "AutomationDev85 (via GitHub)" <gi...@apache.org> on 2026/02/28 14:18:31 UTC

[PR] Provider Docker: Handle UnicodeEncodeError during fetch_log [airflow]

AutomationDev85 opened a new pull request, #62632:
URL: https://github.com/apache/airflow/pull/62632

   # Overview
   
   We encountered an issue during log streaming from Docker containers with the Docker provider package:
   
   ```
   UnicodeEncodeError: 'utf-8' codec can't encode character '\udce2' in position 76: surrogates not allowed
   File "/home/airflow/.local/lib/python3.12/site-packages/airflow/sdk/bases/operator.py", line 417 in wrapper
   File "/home/airflow/.local/lib/python3.12/site-packages/airflow/providers/docker/operators/docker.py", line 495 in execute
   File "/home/airflow/.local/lib/python3.12/site-packages/airflow/providers/docker/operators/docker.py", line 360 in _run_image
   File "/home/airflow/.local/lib/python3.12/site-packages/airflow/providers/docker/operators/docker.py", line 422 in _run_image_with_mounts
   File "/home/airflow/.local/lib/python3.12/site-packages/airflow/providers/docker/operators/docker.py", line 66 in fetch_logs
   File "/home/airflow/.local/lib/python3.12/site-packages/airflow/sdk/_shared/logging/structlog.py", line 100 in meth
   File "/home/airflow/.local/lib/python3.12/site-packages/structlog/_base.py", line 222 in _proxy_to_logger
   File "/home/airflow/.local/lib/python3.12/site-packages/structlog/_base.py", line 173 in _process_event
   File "/home/airflow/.local/lib/python3.12/site-packages/structlog/processors.py", line 353 in __call__
   ```
   
   The issue was caused by surrogate characters appearing in log streams (likely due to partial character reads during streaming). We resolved this by changing the error handling parameter from surrogateescape to replace, which gracefully handles non-UTF-8 characters instead of raising a UnicodeEncodeError.
   
   # Details of change:
   
   * Changed the errors parameter from surrogateescape to replace in log stream handling


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] Handle UnicodeEncodeError during fetch_log in Airflow 3 [airflow]

Posted by "jscheffl (via GitHub)" <gi...@apache.org>.
jscheffl merged PR #62632:
URL: https://github.com/apache/airflow/pull/62632


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org