You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "AutomationDev85 (via GitHub)" <gi...@apache.org> on 2026/02/28 14:18:31 UTC
[PR] Provider Docker: Handle UnicodeEncodeError during fetch_log [airflow]
AutomationDev85 opened a new pull request, #62632:
URL: https://github.com/apache/airflow/pull/62632
# Overview
We encountered an issue during log streaming from Docker containers with the Docker provider package:
```
UnicodeEncodeError: 'utf-8' codec can't encode character '\udce2' in position 76: surrogates not allowed
File "/home/airflow/.local/lib/python3.12/site-packages/airflow/sdk/bases/operator.py", line 417 in wrapper
File "/home/airflow/.local/lib/python3.12/site-packages/airflow/providers/docker/operators/docker.py", line 495 in execute
File "/home/airflow/.local/lib/python3.12/site-packages/airflow/providers/docker/operators/docker.py", line 360 in _run_image
File "/home/airflow/.local/lib/python3.12/site-packages/airflow/providers/docker/operators/docker.py", line 422 in _run_image_with_mounts
File "/home/airflow/.local/lib/python3.12/site-packages/airflow/providers/docker/operators/docker.py", line 66 in fetch_logs
File "/home/airflow/.local/lib/python3.12/site-packages/airflow/sdk/_shared/logging/structlog.py", line 100 in meth
File "/home/airflow/.local/lib/python3.12/site-packages/structlog/_base.py", line 222 in _proxy_to_logger
File "/home/airflow/.local/lib/python3.12/site-packages/structlog/_base.py", line 173 in _process_event
File "/home/airflow/.local/lib/python3.12/site-packages/structlog/processors.py", line 353 in __call__
```
The issue was caused by surrogate characters appearing in log streams (likely due to partial character reads during streaming). We resolved this by changing the error handling parameter from surrogateescape to replace, which gracefully handles non-UTF-8 characters instead of raising a UnicodeEncodeError.
# Details of change:
* Changed the errors parameter from surrogateescape to replace in log stream handling
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Handle UnicodeEncodeError during fetch_log in Airflow 3 [airflow]
Posted by "jscheffl (via GitHub)" <gi...@apache.org>.
jscheffl merged PR #62632:
URL: https://github.com/apache/airflow/pull/62632
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org