You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/06/17 06:04:08 UTC

Build failed in Jenkins: beam_PostCommit_Python_VR_Spark #144

See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/144/display/redirect>

------------------------------------------
[...truncated 1.11 MB...]
RuntimeError: Pipeline test_multimap_side_input_1560751410.3_f1c02219-5f8c-493a-8477-2877887c481b failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-4956e240-fae8-4c3c-a76a-4d537ed29e42/33/temp_shuffle_0e74a25d-7fca-41d2-8090-5ba5b61ba7ba (No such file or directory)

======================================================================
ERROR: test_multimap_side_input_type_coercion (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 267, in test_multimap_side_input_type_coercion
    equal_to([('a', [1, 3]), ('b', [2])]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_multimap_side_input_type_coercion_1560751413.93_05f84c77-0985-457b-9a9b-74429059a0f6 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-4956e240-fae8-4c3c-a76a-4d537ed29e42/09/temp_shuffle_a4172ecc-16ba-4228-b956-f14cb000ebdc (No such file or directory)

======================================================================
ERROR: test_no_subtransform_composite (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 673, in test_no_subtransform_composite
    assert_that((pcoll_a, pcoll_b) | First(), equal_to(['a']))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_no_subtransform_composite_1560751417.09_fe7baa10-6af7-4eaa-8ef5-927515a21502 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-4956e240-fae8-4c3c-a76a-4d537ed29e42/21/temp_shuffle_cde8d23a-cbe3-4a2f-afc8-a2f9f3011ccc (No such file or directory)

======================================================================
ERROR: test_pardo (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 104, in test_pardo
    assert_that(res, equal_to(['aax', 'bcbcx']))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_1560751419.21_3dfab730-d324-4568-883e-0210a15fb854 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-4956e240-fae8-4c3c-a76a-4d537ed29e42/2e/shuffle_24_0_0.data.05923d2d-2648-4e5a-a05d-ae2f8fb0300e (No such file or directory)

======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 176, in test_pardo_side_and_main_outputs
    assert_that(unnamed.odd, equal_to([1, 3]), label='unnamed.odd')
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_and_main_outputs_1560751421.17_15abb670-6fca-42a1-8201-1d5ba06fecb4 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-4956e240-fae8-4c3c-a76a-4d537ed29e42/0b/temp_shuffle_75a909d5-4166-40e2-85c0-82842c747d67 (No such file or directory)

======================================================================
ERROR: test_pardo_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 187, in test_pardo_side_inputs
    ('a', 'y'), ('b', 'y'), ('c', 'y')]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_inputs_1560751423.56_1b140e76-6cc9-4c7e-b054-cd86aa6ae79c failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-4956e240-fae8-4c3c-a76a-4d537ed29e42/12/shuffle_28_0_0.index.278d8723-5e64-4b67-8bd0-c5d16f94a0a8 (No such file or directory)

======================================================================
ERROR: test_pardo_side_outputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 158, in test_pardo_side_outputs
    assert_that(xy.y, equal_to(['y', 'xy']), label='y')
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_outputs_1560751424.96_091d7896-bc35-4e11-bd6c-7493f27c0c05 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-4956e240-fae8-4c3c-a76a-4d537ed29e42/10/temp_shuffle_6ad85cea-51ac-4883-90ac-4c55189a1d63 (No such file or directory)

======================================================================
ERROR: test_pardo_state_only (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 308, in test_pardo_state_only
    equal_to(expected))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_state_only_1560751426.37_230aaf11-d6e3-479a-b1a3-fc90911131bb failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-4956e240-fae8-4c3c-a76a-4d537ed29e42/2e/shuffle_31_0_0.data.de1e4e29-630c-4b28-8cd6-c05a09962bbc (No such file or directory)

======================================================================
ERROR: test_pardo_state_timers (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 401, in test_pardo_state_timers
    self._run_pardo_state_timers(False)
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 461, in _run_pardo_state_timers
    assert_that(actual, is_buffered_correctly)
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_state_timers_1560751430.42_1ca01c8c-ec13-440e-8dbe-0742a27f8e38 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-4956e240-fae8-4c3c-a76a-4d537ed29e42/27/temp_shuffle_16170a90-968e-4f74-b8e8-4026a957f2a4 (No such file or directory)

======================================================================
ERROR: test_pardo_timers (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 361, in test_pardo_timers
    assert_that(actual, equal_to(expected))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_timers_1560751432.11_3dbfd4cd-ac38-4a11-9ae1-3b27c89ac970 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-4956e240-fae8-4c3c-a76a-4d537ed29e42/36/shuffle_39_0_0.data.ab1e09b4-c50c-4b95-a0da-070e2fc91c16 (No such file or directory)

======================================================================
ERROR: test_pardo_unfusable_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 277, in test_pardo_unfusable_side_inputs
    equal_to([('a', 'a'), ('a', 'b'), ('b', 'a'), ('b', 'b')]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_unfusable_side_inputs_1560751433.7_ad17239f-801d-4eb2-9fa2-4c68bfcec54e failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-4956e240-fae8-4c3c-a76a-4d537ed29e42/05/temp_shuffle_1de3050b-ced0-4f18-80b9-2e9c89e48bcb (No such file or directory)

======================================================================
ERROR: test_pardo_windowed_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 214, in test_pardo_windowed_side_inputs
    label='windowed')
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_windowed_side_inputs_1560751436.89_0e6dff42-d2ba-46c9-be7c-df735d7f2d27 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-4956e240-fae8-4c3c-a76a-4d537ed29e42/36/shuffle_42_0_0.index.799ab45d-eb87-45f3-b4af-4a6bcb1dcc26 (No such file or directory)

======================================================================
ERROR: test_read (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 592, in test_read
    equal_to(['a', 'b', 'c']))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_read_1560751438.66_9c7b3427-a946-486c-bdb7-a3db52363dbb failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-4956e240-fae8-4c3c-a76a-4d537ed29e42/36/temp_shuffle_dd61ead6-e7a7-4141-95e4-36fa7be6413e (No such file or directory)

======================================================================
ERROR: test_reshuffle (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 562, in test_reshuffle
    equal_to([1, 2, 3]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_reshuffle_1560751439.9_76ef54bf-ae9b-4e63-abe2-3d33f8e49a7d failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-4956e240-fae8-4c3c-a76a-4d537ed29e42/2e/temp_shuffle_12b0a807-9cd7-45cc-86cb-995b8da0c62d (No such file or directory)

======================================================================
ERROR: test_sdf_wrap_range_source (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 548, in test_sdf_wrap_range_source
    self._run_sdf_wrapper_pipeline(RangeSource(0, 4), [0, 1, 2, 3])
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 534, in _run_sdf_wrapper_pipeline
    p | beam.io.Read(source)
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_sdf_wrap_range_source_1560751441.29_dde3d8b4-9cfd-4288-b836-a66fb6210a9d failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-4956e240-fae8-4c3c-a76a-4d537ed29e42/10/shuffle_48_0_0.index.441745fa-9f40-4f06-ab87-0be60f7a32b1 (No such file or directory)

======================================================================
ERROR: test_sdf_wrapper_overrides_read (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/mock-2.0.0-py2.7.egg/mock/mock.py",> line 1305, in patched
    return func(*args, **keywargs)
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 545, in test_sdf_wrapper_overrides_read
    self._run_sdf_wrapper_pipeline(RangeSource(0, 4), ['1'])
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 534, in _run_sdf_wrapper_pipeline
    p | beam.io.Read(source)
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_sdf_wrapper_overrides_read_1560751442.36_16964597-90aa-46b9-b86e-d2b6ec3fd018 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-4956e240-fae8-4c3c-a76a-4d537ed29e42/0b/shuffle_49_0_0.data.71269b8e-5c49-44ae-93ed-c6fbdc8be21d (No such file or directory)

======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 404, in test_windowed_pardo_state_timers
    self._run_pardo_state_timers(True)
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 461, in _run_pardo_state_timers
    assert_that(actual, is_buffered_correctly)
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_windowed_pardo_state_timers_1560751443.45_02fa3d1c-cd45-4cf0-a9f1-239dcd1a9bcf failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-4956e240-fae8-4c3c-a76a-4d537ed29e42/33/shuffle_52_0_0.data.5e9e202a-846a-4f8b-964b-fbceab0e75fd (No such file or directory)

======================================================================
ERROR: test_windowing (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 604, in test_windowing
    assert_that(res, equal_to([('k', [1, 2]), ('k', [100, 101, 102])]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_windowing_1560751444.86_9c0291a4-30ca-4ba4-a83d-309b53060fc1 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-4956e240-fae8-4c3c-a76a-4d537ed29e42/14/shuffle_55_0_0.index.1d7add45-2a6f-4010-bfd0-1ebdb7d15b2b (No such file or directory)

----------------------------------------------------------------------
Ran 38 tests in 75.394s

FAILED (errors=23, skipped=10)

> Task :sdks:python:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/build.gradle'> line: 251

* What went wrong:
Execution failed for task ':sdks:python:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 3m 44s
60 actionable tasks: 47 executed, 13 from cache

Publishing build scan...
https://gradle.com/s/phpfhncrnquvg

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_Python_VR_Spark #145

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/145/display/redirect>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org