You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Ankur Goenka (JIRA)" <ji...@apache.org> on 2018/01/06 01:48:00 UTC

[jira] [Comment Edited] (BEAM-3411) Test apache_beam.examples.wordcount_it_test.WordCountIT times out

    [ https://issues.apache.org/jira/browse/BEAM-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16314279#comment-16314279 ] 

Ankur Goenka edited comment on BEAM-3411 at 1/6/18 1:47 AM:
------------------------------------------------------------

We missed catching a case where progress report for an unregistered work item is requested from the worker which resulted in an uncaught exceptions.
Erroneous Code block: 

{code:python}
worker = self._instruction_id_vs_worker[request.instruction_id]
{code}

Underlying error stack trace:
{code:python}
Python sdk harness failed: 
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/apache_beam/runners/worker/sdk_worker_main.py", line 134, in main
    worker_count=_get_worker_count(sdk_pipeline_options)).run()
  File "/usr/local/lib/python2.7/dist-packages/apache_beam/runners/worker/sdk_worker.py", line 97, in run
    work_request)
  File "/usr/local/lib/python2.7/dist-packages/apache_beam/runners/worker/sdk_worker.py", line 162, in _request_process_bundle_progress
    worker = self._instruction_id_vs_worker[request.instruction_id]
KeyError: u'-39'
{code}



was (Author: angoenka):
We missed catching a case where progress report for an unregistered work item is requested from the worker which resulted in an uncaught exceptions:
Underlying error stack trace:
{code:java}
Python sdk harness failed: 
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/apache_beam/runners/worker/sdk_worker_main.py", line 134, in main
    worker_count=_get_worker_count(sdk_pipeline_options)).run()
  File "/usr/local/lib/python2.7/dist-packages/apache_beam/runners/worker/sdk_worker.py", line 97, in run
    work_request)
  File "/usr/local/lib/python2.7/dist-packages/apache_beam/runners/worker/sdk_worker.py", line 162, in _request_process_bundle_progress
    worker = self._instruction_id_vs_worker[request.instruction_id]
KeyError: u'-39'
{code}


> Test apache_beam.examples.wordcount_it_test.WordCountIT times out
> -----------------------------------------------------------------
>
>                 Key: BEAM-3411
>                 URL: https://issues.apache.org/jira/browse/BEAM-3411
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-py-core
>            Reporter: Henning Rohde
>            Assignee: Ankur Goenka
>
> Failed run: https://builds.apache.org/job/beam_PostCommit_Python_Verify/3876/console
> Log snippet:
> test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ERROR
> ======================================================================
> ERROR: test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT)
> ----------------------------------------------------------------------
> Traceback (most recent call last):
>   File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify/src/sdks/python/.eggs/nose-1.3.7-py2.7.egg/nose/plugins/multiprocess.py", line 812, in run
>     test(orig)
>   File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify/src/sdks/python/.eggs/nose-1.3.7-py2.7.egg/nose/case.py", line 45, in __call__
>     return self.run(*arg, **kwarg)
>   File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify/src/sdks/python/.eggs/nose-1.3.7-py2.7.egg/nose/case.py", line 133, in run
>     self.runTest(result)
>   File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify/src/sdks/python/.eggs/nose-1.3.7-py2.7.egg/nose/case.py", line 151, in runTest
>     test(result)
>   File "/usr/lib/python2.7/unittest/case.py", line 395, in __call__
>     return self.run(*args, **kwds)
>   File "/usr/lib/python2.7/unittest/case.py", line 331, in run
>     testMethod()
>   File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify/src/sdks/python/apache_beam/examples/wordcount_it_test.py", line 77, in test_wordcount_fnapi_it
>     on_success_matcher=PipelineStateMatcher()))
>   File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify/src/sdks/python/apache_beam/examples/wordcount_fnapi.py", line 130, in run
>     result.wait_until_finish()
>   File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py", line 956, in wait_until_finish
>     time.sleep(5.0)
>   File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify/src/sdks/python/.eggs/nose-1.3.7-py2.7.egg/nose/plugins/multiprocess.py", line 276, in signalhandler
>     raise TimedOutException()
> TimedOutException: 'test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT)'
> ----------------------------------------------------------------------
> Ran 3 tests in 901.290s
> FAILED (errors=1)
> Build step 'Execute shell' marked build as failure



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)