You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/06/14 18:04:06 UTC

Build failed in Jenkins: beam_PostCommit_Python_VR_Spark #129

See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/129/display/redirect>

------------------------------------------
[...truncated 1.10 MB...]
RuntimeError: Pipeline test_large_elements_1560535401.57_f746288c-5a61-4aa9-a28f-c54853fafa37 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-8862a491-ead7-4dcb-8691-664c6916dfa6/1a/temp_shuffle_06525bd5-0694-4df3-83f4-994e87c6e766 (No such file or directory)

======================================================================
ERROR: test_multimap_side_input (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 254, in test_multimap_side_input
    equal_to([('a', [1, 3]), ('b', [2])]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_multimap_side_input_1560535403.25_f1a50411-6047-48de-b824-5c47b88fc995 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-8862a491-ead7-4dcb-8691-664c6916dfa6/31/shuffle_16_0_0.index.d0150a4e-9f92-4ab9-a399-8421ade906ae (No such file or directory)

======================================================================
ERROR: test_multimap_side_input_type_coercion (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 267, in test_multimap_side_input_type_coercion
    equal_to([('a', [1, 3]), ('b', [2])]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_multimap_side_input_type_coercion_1560535404.86_59fa73d8-2f94-4170-a7d1-73e8a16fc2f1 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-8862a491-ead7-4dcb-8691-664c6916dfa6/0e/shuffle_17_0_0.index.c7409cfa-7254-4d86-88c5-c92ef8b8be1f (No such file or directory)

======================================================================
ERROR: test_no_subtransform_composite (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 673, in test_no_subtransform_composite
    assert_that((pcoll_a, pcoll_b) | First(), equal_to(['a']))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_no_subtransform_composite_1560535406.48_73273c60-d692-46aa-a3ef-e47ddfc40445 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-8862a491-ead7-4dcb-8691-664c6916dfa6/31/temp_shuffle_ce477873-cb45-49aa-9f42-b186c5571fe3 (No such file or directory)

======================================================================
ERROR: test_pardo (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 104, in test_pardo
    assert_that(res, equal_to(['aax', 'bcbcx']))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_1560535408.91_c0889839-e5e7-4643-b78f-59685dd9cbe3 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-8862a491-ead7-4dcb-8691-664c6916dfa6/36/shuffle_20_0_0.index.fa59e785-f0dd-491d-805d-33000309eba7 (No such file or directory)

======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 176, in test_pardo_side_and_main_outputs
    assert_that(unnamed.odd, equal_to([1, 3]), label='unnamed.odd')
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_and_main_outputs_1560535411.19_08d8d729-c511-4c26-badb-8cc859cc7457 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-8862a491-ead7-4dcb-8691-664c6916dfa6/0e/temp_shuffle_79f32b8f-26ca-4896-8a82-a00613bcecce (No such file or directory)

======================================================================
ERROR: test_pardo_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 187, in test_pardo_side_inputs
    ('a', 'y'), ('b', 'y'), ('c', 'y')]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_inputs_1560535413.54_0464aa7c-e406-4572-9296-5819a0e3d045 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-8862a491-ead7-4dcb-8691-664c6916dfa6/2c/shuffle_26_0_0.data.4cf665b6-eff8-4e00-b76a-674549fc7f30 (No such file or directory)

======================================================================
ERROR: test_pardo_side_outputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 158, in test_pardo_side_outputs
    assert_that(xy.y, equal_to(['y', 'xy']), label='y')
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_outputs_1560535417.22_0ddd180a-caee-4b82-8a2e-6ba4642f5102 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-8862a491-ead7-4dcb-8691-664c6916dfa6/0b/shuffle_27_0_0.data.7a430435-d5ea-4417-b36b-4145d53e0733 (No such file or directory)

======================================================================
ERROR: test_pardo_state_timers (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 401, in test_pardo_state_timers
    self._run_pardo_state_timers(False)
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 461, in _run_pardo_state_timers
    assert_that(actual, is_buffered_correctly)
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_state_timers_1560535428.71_7fa4bce4-25b2-4836-9a05-25438eed5732 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-8862a491-ead7-4dcb-8691-664c6916dfa6/11/shuffle_34_0_0.data.e0f4a190-cbd3-491d-b84d-d6e153ed0335 (No such file or directory)

======================================================================
ERROR: test_pardo_timers (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 361, in test_pardo_timers
    assert_that(actual, equal_to(expected))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_timers_1560535430.39_8a79801a-b5de-4cec-9cc6-6a018bc343ab failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-8862a491-ead7-4dcb-8691-664c6916dfa6/13/shuffle_36_0_0.data.c8902d76-1830-4a3c-b639-8d24968aea8c (No such file or directory)

======================================================================
ERROR: test_pardo_unfusable_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 277, in test_pardo_unfusable_side_inputs
    equal_to([('a', 'a'), ('a', 'b'), ('b', 'a'), ('b', 'b')]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_unfusable_side_inputs_1560535433.18_abae9f46-8af2-4afc-be49-74bfb780ce7f failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-8862a491-ead7-4dcb-8691-664c6916dfa6/31/temp_shuffle_a2764d6b-6d98-4dd8-a4ec-1b2e5454da5d (No such file or directory)

======================================================================
ERROR: test_pardo_windowed_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 214, in test_pardo_windowed_side_inputs
    label='windowed')
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_windowed_side_inputs_1560535434.89_1c623a8f-aafc-4a5d-8ba5-25d402e58bf6 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-8862a491-ead7-4dcb-8691-664c6916dfa6/36/shuffle_39_0_0.data.f63d95b1-c373-4af1-9f56-70968f699594 (No such file or directory)

======================================================================
ERROR: test_read (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 592, in test_read
    equal_to(['a', 'b', 'c']))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_read_1560535436.27_043ad72f-e192-4c39-a002-eefa9066f050 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-8862a491-ead7-4dcb-8691-664c6916dfa6/13/shuffle_41_0_0.data.573c6436-a6cd-469b-838c-21cc588d1860 (No such file or directory)

======================================================================
ERROR: test_reshuffle (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 562, in test_reshuffle
    equal_to([1, 2, 3]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_reshuffle_1560535437.65_fb5b1b05-e0f5-46ac-83a4-d393e2f4e2a6 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-8862a491-ead7-4dcb-8691-664c6916dfa6/0b/temp_shuffle_7d85165a-d9a4-40dd-bb4d-acace5a6cf2a (No such file or directory)

======================================================================
ERROR: test_sdf_wrap_range_source (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 548, in test_sdf_wrap_range_source
    self._run_sdf_wrapper_pipeline(RangeSource(0, 4), [0, 1, 2, 3])
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 534, in _run_sdf_wrapper_pipeline
    p | beam.io.Read(source)
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_sdf_wrap_range_source_1560535439.15_371732ee-56a1-448f-985b-7f22b2afeeba failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-8862a491-ead7-4dcb-8691-664c6916dfa6/36/temp_shuffle_f37456fe-6686-423b-b73a-105f0d323344 (No such file or directory)

======================================================================
ERROR: test_sdf_wrapper_overrides_read (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/mock-2.0.0-py2.7.egg/mock/mock.py",> line 1305, in patched
    return func(*args, **keywargs)
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 545, in test_sdf_wrapper_overrides_read
    self._run_sdf_wrapper_pipeline(RangeSource(0, 4), ['1'])
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 534, in _run_sdf_wrapper_pipeline
    p | beam.io.Read(source)
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_sdf_wrapper_overrides_read_1560535440.32_fa9bc664-d9a6-4d9c-a1ae-52560dc5f994 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-8862a491-ead7-4dcb-8691-664c6916dfa6/0e/shuffle_46_0_0.index.c8f43251-bdb6-47d0-a2c4-9eb14af05871 (No such file or directory)

======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 404, in test_windowed_pardo_state_timers
    self._run_pardo_state_timers(True)
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 461, in _run_pardo_state_timers
    assert_that(actual, is_buffered_correctly)
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_windowed_pardo_state_timers_1560535441.5_8e1dca5a-651a-4d23-b359-275702778629 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-8862a491-ead7-4dcb-8691-664c6916dfa6/13/temp_shuffle_789c70e7-64b3-4c44-b7a7-bda6c768f220 (No such file or directory)

======================================================================
ERROR: test_windowing (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 604, in test_windowing
    assert_that(res, equal_to([('k', [1, 2]), ('k', [100, 101, 102])]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_windowing_1560535442.92_43359638-8286-44c2-a787-15e5f9c0f9f0 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-8862a491-ead7-4dcb-8691-664c6916dfa6/20/temp_shuffle_4f41ad05-f9a8-42b1-8df5-3df2b9d294c6 (No such file or directory)

----------------------------------------------------------------------
Ran 38 tests in 82.053s

FAILED (errors=21, skipped=10)

> Task :sdks:python:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/build.gradle'> line: 251

* What went wrong:
Execution failed for task ':sdks:python:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 3m 52s
60 actionable tasks: 47 executed, 13 from cache

Publishing build scan...
https://gradle.com/s/argpy6ruuh6cu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_Python_VR_Spark #130

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/130/display/redirect?page=changes>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org