[GitHub] [airflow] blessymoses commented on issue #12813: Attempting to read an xcom produced by KubernetesPodOperator results in UnicodeDecodeError

[GitBox <gi...@apache.org>]

blessymoses commented on issue #12813:
URL: https://github.com/apache/airflow/issues/12813#issuecomment-757711168


   This issue also results in BranchPythonOperator not working with KubernetesExecutor.
   
   **Apache Airflow version**: 1.10.12
   
   **What happened**:
   BranchPythonOperator task succeeds. But it does not schedule the task in the followed branch.
   Scheduler throws UnicodeDecodeError: 'utf-8' codec can't decode byte 0x80 in position 0: invalid start byte
   
   **Stack Trace**:
   Process DagFileProcessor4425-Process:
   Traceback (most recent call last):
     File "/usr/local/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap
       self.run()
     File "/usr/local/lib/python3.7/multiprocessing/process.py", line 99, in run
       self._target(*self._args, **self._kwargs)
     File "/usr/local/lib/python3.7/site-packages/airflow/jobs/scheduler_job.py", line 159, in _run_file_processor
       pickle_dags)
     File "/usr/local/lib/python3.7/site-packages/airflow/utils/db.py", line 74, in wrapper
       return func(*args, **kwargs)
     File "/usr/local/lib/python3.7/site-packages/airflow/jobs/scheduler_job.py", line 1637, in process_file
       self._process_dags(dagbag, dags, ti_keys_to_schedule)
     File "/usr/local/lib/python3.7/site-packages/airflow/jobs/scheduler_job.py", line 1316, in _process_dags
       self._process_task_instances(dag, tis_out)
     File "/usr/local/lib/python3.7/site-packages/airflow/utils/db.py", line 74, in wrapper
       return func(*args, **kwargs)
     File "/usr/local/lib/python3.7/site-packages/airflow/jobs/scheduler_job.py", line 793, in _process_task_instances
       run.update_state(session=session)
     File "/usr/local/lib/python3.7/site-packages/airflow/utils/db.py", line 70, in wrapper
       return func(*args, **kwargs)
     File "/usr/local/lib/python3.7/site-packages/airflow/models/dagrun.py", line 296, in update_state
       session=session)
     File "/usr/local/lib/python3.7/site-packages/airflow/utils/db.py", line 70, in wrapper
       return func(*args, **kwargs)
     File "/usr/local/lib/python3.7/site-packages/airflow/models/taskinstance.py", line 659, in are_dependencies_met
       session=session):
     File "/usr/local/lib/python3.7/site-packages/airflow/models/taskinstance.py", line 683, in get_failed_dep_statuses
       dep_context):
     File "/usr/local/lib/python3.7/site-packages/airflow/ti_deps/deps/base_ti_dep.py", line 106, in get_dep_statuses
       for dep_status in self._get_dep_statuses(ti, session, dep_context):
     File "/usr/local/lib/python3.7/site-packages/airflow/ti_deps/deps/not_previously_skipped_dep.py", line 58, in _get_dep_statuses
       task_ids=parent.task_id, key=XCOM_SKIPMIXIN_KEY
     File "/usr/local/lib/python3.7/site-packages/airflow/models/taskinstance.py", line 1564, in xcom_pull
       return pull_fn(task_id=task_ids)
     File "/usr/local/lib/python3.7/site-packages/airflow/utils/db.py", line 74, in wrapper
       return func(*args, **kwargs)
     File "/usr/local/lib/python3.7/site-packages/airflow/models/xcom.py", line 165, in get_one
       return json.loads(result.value.decode('UTF-8'))
   UnicodeDecodeError: 'utf-8' codec can't decode byte 0x80 in position 0: invalid start byte


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org