You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2018/08/13 15:26:07 UTC
[GitHub] kaxil commented on issue #3744: [AIRFLOW-2893] fix stuck dataflow
job due to name mismatch
kaxil commented on issue #3744: [AIRFLOW-2893] fix stuck dataflow job due to name mismatch
URL: https://github.com/apache/incubator-airflow/pull/3744#issuecomment-412558011
@fenglu-g Looks like a Python 3 test failures:
```
======================================================================
20) ERROR: test_data_flow_missing_job_id (tests.contrib.hooks.test_gcp_dataflow_hook.DataflowTest)
----------------------------------------------------------------------
Traceback (most recent call last):
tests/contrib/hooks/test_gcp_dataflow_hook.py line 297 in test_data_flow_missing_job_id
self.assertEqual(_Dataflow(cmd).wait_for_done(), None)
airflow/contrib/hooks/gcp_dataflow_hook.py line 153 in wait_for_done
job_id = job_id or self._extract_job(line)
airflow/contrib/hooks/gcp_dataflow_hook.py line 138 in _extract_job
matched_job = job_id_pattern.match(line or '')
TypeError: cannot use a string pattern on a bytes-like object
-------------------- >> begin captured stdout << ---------------------
[2018-08-13 08:48:14,177] {gcp_dataflow_hook.py:120} INFO - Running command: echo unit testing
[2018-08-13 08:48:14,202] {gcp_dataflow_hook.py:144} INFO - Start waiting for DataFlow process to complete.
[2018-08-13 08:48:14,203] {gcp_dataflow_hook.py:152} INFO - b'unit testing'
--------------------- >> end captured stdout << ----------------------
-------------------- >> begin captured logging << --------------------
airflow.contrib.hooks.gcp_dataflow_hook._Dataflow: INFO: Running command: echo unit testing
airflow.contrib.hooks.gcp_dataflow_hook._Dataflow: INFO: Start waiting for DataFlow process to complete.
airflow.contrib.hooks.gcp_dataflow_hook._Dataflow: INFO: b'unit testing'
--------------------- >> end captured logging << ---------------------
======================================================================
21) ERROR: test_data_flow_valid_job_id (tests.contrib.hooks.test_gcp_dataflow_hook.DataflowTest)
----------------------------------------------------------------------
Traceback (most recent call last):
tests/contrib/hooks/test_gcp_dataflow_hook.py line 293 in test_data_flow_valid_job_id
self.assertEqual(_Dataflow(cmd).wait_for_done(), TEST_JOB_ID)
airflow/contrib/hooks/gcp_dataflow_hook.py line 153 in wait_for_done
job_id = job_id or self._extract_job(line)
airflow/contrib/hooks/gcp_dataflow_hook.py line 138 in _extract_job
matched_job = job_id_pattern.match(line or '')
TypeError: cannot use a string pattern on a bytes-like object
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services