You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "AlekseiSaff (via GitHub)" <gi...@apache.org> on 2024/03/04 02:44:43 UTC
[I] 'utf-8' codec can't decode byte 0x80 in position 0: invalid start byte (after upgrade to 2.8.2) [airflow]
AlekseiSaff opened a new issue, #37871:
URL: https://github.com/apache/airflow/issues/37871
### Apache Airflow version
2.8.2
### If "Other Airflow 2 version" selected, which one?
_No response_
### What happened?
after upgrade to 2.8.2 some backfill DAGs fail to run with error
00:00+00:00', '--local', '--pool', 'default_pool', '--subdir', 'DAGS_FOLDER/nse/nse_data_validation.py']
[2024-03-04T10:41:51.731+0800] {base_executor.py:146} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'nse-data-validation', 'stream_filter_9_banknifty', 'backfill__2023-06-08T14:
00:00+00:00', '--local', '--pool', 'default_pool', '--subdir', 'DAGS_FOLDER/nse/nse_data_validation.py']
[2024-03-04T10:41:51.743+0800] {base_executor.py:146} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'nse-data-validation', 'stream_filter_9_banknifty', 'backfill__2023-06-09T14:
00:00+00:00', '--local', '--pool', 'default_pool', '--subdir', 'DAGS_FOLDER/nse/nse_data_validation.py']
[2024-03-04T10:41:56.063+0800] {backfill_job_runner.py:446} INFO - [backfill progress] | finished run 0 of 2 | tasks waiting: 104 | succeeded: 4 | running: 20 | failed: 0 | skipped: 0
| deadlocked: 0 | not ready: 90
[2024-03-04T10:42:00.787+0800] {backfill_job_runner.py:446} INFO - [backfill progress] | finished run 0 of 2 | tasks waiting: 104 | succeeded: 24 | running: 0 | failed: 0 | skipped: 0
| deadlocked: 0 | not ready: 0
'utf-8' codec can't decode byte 0x80 in position 0: invalid start byte
### What you think should happen instead?
DAG must be procesed in a normal way
### How to reproduce
Run DAG via backfill
### Operating System
CentOS 7.9
### Versions of Apache Airflow Providers
_No response_
### Deployment
Other
### Deployment details
_No response_
### Anything else?
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] 'utf-8' codec can't decode byte 0x80 in position 0: invalid start byte (after upgrade to 2.8.2) [airflow]
Posted by "AlekseiSaff (via GitHub)" <gi...@apache.org>.
AlekseiSaff commented on issue #37871:
URL: https://github.com/apache/airflow/issues/37871#issuecomment-1978276878
sorry, I had it True on worker machine, but false on web-server
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] 'utf-8' codec can't decode byte 0x80 in position 0: invalid start byte (after upgrade to 2.8.2) [airflow]
Posted by "jscheffl (via GitHub)" <gi...@apache.org>.
jscheffl commented on issue #37871:
URL: https://github.com/apache/airflow/issues/37871#issuecomment-1981876308
So is the problem resolved and the last comment just re-opened?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] 'utf-8' codec can't decode byte 0x80 in position 0: invalid start byte (after upgrade to 2.8.2) [airflow]
Posted by "AlekseiSaff (via GitHub)" <gi...@apache.org>.
AlekseiSaff commented on issue #37871:
URL: https://github.com/apache/airflow/issues/37871#issuecomment-1977817729
From what I realize can't see/get some xcom objects anymore .
Mar 4 10:58:14 lt-hkg1-avm04 airflow: File "/usr/local/lib/python3.9/site-packages/sqlalchemy/event/attr.py", line 346, in __call__
Mar 4 10:58:14 lt-hkg1-avm04 airflow: fn(*args, **kw)
Mar 4 10:58:14 lt-hkg1-avm04 airflow: File "/usr/local/lib/python3.9/site-packages/sqlalchemy/orm/mapper.py", line 3702, in _event_on_load
Mar 4 10:58:14 lt-hkg1-avm04 airflow: instrumenting_mapper._reconstructor(state.obj())
Mar 4 10:58:14 lt-hkg1-avm04 airflow: File "/usr/local/lib/python3.9/site-packages/airflow/models/xcom.py", line 132, in init_on_load
Mar 4 10:58:14 lt-hkg1-avm04 airflow: self.value = self.orm_deserialize_value()
Mar 4 10:58:14 lt-hkg1-avm04 airflow: File "/usr/local/lib/python3.9/site-packages/airflow/models/xcom.py", line 705, in orm_deserialize_value
Mar 4 10:58:14 lt-hkg1-avm04 airflow: return BaseXCom._deserialize_value(self, True)
Mar 4 10:58:14 lt-hkg1-avm04 airflow: File "/usr/local/lib/python3.9/site-packages/airflow/models/xcom.py", line 689, in _deserialize_value
Mar 4 10:58:14 lt-hkg1-avm04 airflow: return json.loads(result.value.decode("UTF-8"), cls=XComDecoder, object_hook=object_hook)
Mar 4 10:58:14 lt-hkg1-avm04 airflow: UnicodeDecodeError: 'utf-8' codec can't decode byte 0x80 in position 0: invalid start byte
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] 'utf-8' codec can't decode byte 0x80 in position 0: invalid start byte (after upgrade to 2.8.2) [airflow]
Posted by "AlekseiSaff (via GitHub)" <gi...@apache.org>.
AlekseiSaff closed issue #37871: 'utf-8' codec can't decode byte 0x80 in position 0: invalid start byte (after upgrade to 2.8.2)
URL: https://github.com/apache/airflow/issues/37871
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] 'utf-8' codec can't decode byte 0x80 in position 0: invalid start byte (after upgrade to 2.8.2) [airflow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #37871: 'utf-8' codec can't decode byte 0x80 in position 0: invalid start byte (after upgrade to 2.8.2)
URL: https://github.com/apache/airflow/issues/37871
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] 'utf-8' codec can't decode byte 0x80 in position 0: invalid start byte (after upgrade to 2.8.2) [airflow]
Posted by "AlekseiSaff (via GitHub)" <gi...@apache.org>.
AlekseiSaff commented on issue #37871:
URL: https://github.com/apache/airflow/issues/37871#issuecomment-1978222099
I set enable_xcom_pickling to True and now it works
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] 'utf-8' codec can't decode byte 0x80 in position 0: invalid start byte (after upgrade to 2.8.2) [airflow]
Posted by "AlekseiSaff (via GitHub)" <gi...@apache.org>.
AlekseiSaff commented on issue #37871:
URL: https://github.com/apache/airflow/issues/37871#issuecomment-1980226018
It seems like we had different value for enable_xcom_pickling on webserver and workers.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] 'utf-8' codec can't decode byte 0x80 in position 0: invalid start byte (after upgrade to 2.8.2) [airflow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #37871:
URL: https://github.com/apache/airflow/issues/37871#issuecomment-2026356888
This issue has been closed because it has not received response from the issue author.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] 'utf-8' codec can't decode byte 0x80 in position 0: invalid start byte (after upgrade to 2.8.2) [airflow]
Posted by "AlekseiSaff (via GitHub)" <gi...@apache.org>.
AlekseiSaff commented on issue #37871:
URL: https://github.com/apache/airflow/issues/37871#issuecomment-1978217672
that is what I'm seeing in value field of XCOM table (read via python)
enable_xcom_pickling = False - in settings
b'\x80\x04\x88.'
b'\x80\x04\x95\x06\x00\x00\x00\x00\x00\x00\x00J\xd1\xb14\x01.'
b'\x80\x04\x95*\x00\x00\x00\x00\x00\x00\x00\x8c&check_for_stream_iplf_9_banknifty_sync\x94.'
b'\x80\x04\x95;\x00\x00\x00\x00\x00\x00\x00}\x94\x8c\x08followed\x94]\x94\x8c&check_for_stream_iplf_9_banknifty_sync\x94as.'
b'\x80\x04\x88.'
b'\x80\x04\x95\x06\x00\x00\x00\x00\x00\x00\x00J\xd4\xb14\x01.'
b'\x80\x04\x95*\x00\x00\x00\x00\x00\x00\x00\x8c&check_for_stream_iplf_6_banknifty_sync\x94.'
b'\x80\x04\x95;\x00\x00\x00\x00\x00\x00\x00}\x94\x8c\x08followed\x94]\x94\x8c&check_for_stream_iplf_6_banknifty_sync\x94as.'
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] 'utf-8' codec can't decode byte 0x80 in position 0: invalid start byte (after upgrade to 2.8.2) [airflow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #37871:
URL: https://github.com/apache/airflow/issues/37871#issuecomment-2010947659
This issue has been automatically marked as stale because it has been open for 14 days with no response from the author. It will be closed in next 7 days if no further activity occurs from the issue author.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org