You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by "Juhong Jung (Jira)" <ji...@apache.org> on 2019/08/28 20:00:15 UTC

[jira] [Created] (AIRFLOW-5339) Wait forever spark hook if python version is 3

Juhong Jung created AIRFLOW-5339:
------------------------------------

             Summary: Wait forever spark hook if python version is 3
                 Key: AIRFLOW-5339
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-5339
             Project: Apache Airflow
          Issue Type: Bug
          Components: hooks
    Affects Versions: 1.10.4, 1.10.3, 1.10.2, 1.10.1, 1.10.0
            Reporter: Juhong Jung
            Assignee: Juhong Jung


I found spark hook is not terminating forever.

Because Python 3 *{{subprocess.Popen}}* return {{*bytes*}}, *{{iter(sp.stdout.readlin, '')}}* pattern codes are not work.

I will submit PR.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)