You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Walter Smith (JIRA)" <ji...@apache.org> on 2017/01/21 02:15:26 UTC

[jira] [Created] (AIRFLOW-783) Python 3 incompatibility in BaseTaskRunner

Walter Smith created AIRFLOW-783:
------------------------------------

             Summary: Python 3 incompatibility in BaseTaskRunner
                 Key: AIRFLOW-783
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-783
             Project: Apache Airflow
          Issue Type: Bug
          Components: core
    Affects Versions: Airflow 1.8
         Environment: python 3.4
            Reporter: Walter Smith


The stdout of the subprocess is being used without a codec, so task output is lost. Running unit tests will demonstrate this repeatedly.

Typical backtrace:

{noformat}
test_fetch_task_instance (tests.WebUiTests) ... Exception in thread Thread-3:
Traceback (most recent call last):
  File "/usr/local/Cellar/python3/3.4.3/Frameworks/Python.framework/Versions/3.4/lib/python3.4/threading.py", line 920, in _bootstrap_inner
    self.run()
  File "/usr/local/Cellar/python3/3.4.3/Frameworks/Python.framework/Versions/3.4/lib/python3.4/threading.py", line 868, in run
    self._target(*self._args, **self._kwargs)
  File "/Users/walter/infbio/incubator-airflow/airflow/task_runner/base_task_runner.py", line 95, in _read_task_logs
    self.logger.info('Subtask: {}'.format(line.rstrip('\n')))
TypeError: 'str' does not support the buffer interface
{noformat}




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)