You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Yifan Mai (Jira)" <ji...@apache.org> on 2019/09/06 20:53:00 UTC

[jira] [Updated] (BEAM-8149) [FnApiRunner]multi-process runner does not terminate cleanly upon receiving SIGINT

     [ https://issues.apache.org/jira/browse/BEAM-8149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yifan Mai updated BEAM-8149:
----------------------------
    Description: 
The multi-process runner does not handle SIGINT gracefully. To reproduce, run wordcount.py using the "Run with multiprocessing mode" instructions from the comment above (in Python 3).

Expected: wordcount terminates gracefully when Ctrl-C is pressed during pipeline execution (similarly to default direct runner)
Actual: wordcount hangs forever after printing the following once per worker:

{code}
Exception in thread run_worker:
Traceback (most recent call last):
  File "/usr/lib/python3.6/threading.py", line 916, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.6/threading.py", line 864, in run
    self._target(*self._args, **self._kwargs)
  File "/usr/local/google/home/yifanmai/venv/wordcount/lib/python3.6/site-packages/apache_beam/runners/portability/local_job_service.py", line 216, in run
    'Worker subprocess exited with return code %s' % p.returncode)
RuntimeError: Worker subprocess exited with return code 1
{code}

> [FnApiRunner]multi-process runner does not terminate cleanly upon receiving SIGINT
> ----------------------------------------------------------------------------------
>
>                 Key: BEAM-8149
>                 URL: https://issues.apache.org/jira/browse/BEAM-8149
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-py-core
>    Affects Versions: 2.15.0
>            Reporter: Hannah Jiang
>            Assignee: Hannah Jiang
>            Priority: Major
>
> The multi-process runner does not handle SIGINT gracefully. To reproduce, run wordcount.py using the "Run with multiprocessing mode" instructions from the comment above (in Python 3).
> Expected: wordcount terminates gracefully when Ctrl-C is pressed during pipeline execution (similarly to default direct runner)
> Actual: wordcount hangs forever after printing the following once per worker:
> {code}
> Exception in thread run_worker:
> Traceback (most recent call last):
>   File "/usr/lib/python3.6/threading.py", line 916, in _bootstrap_inner
>     self.run()
>   File "/usr/lib/python3.6/threading.py", line 864, in run
>     self._target(*self._args, **self._kwargs)
>   File "/usr/local/google/home/yifanmai/venv/wordcount/lib/python3.6/site-packages/apache_beam/runners/portability/local_job_service.py", line 216, in run
>     'Worker subprocess exited with return code %s' % p.returncode)
> RuntimeError: Worker subprocess exited with return code 1
> {code}



--
This message was sent by Atlassian Jira
(v8.3.2#803003)