You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/06/14 12:04:34 UTC

Build failed in Jenkins: beam_PostCommit_Python_VR_Spark #123

See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/123/display/redirect>

------------------------------------------
[...truncated 1.15 MB...]
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_group_by_key_1560513818.97_69fb7084-6daf-466b-8a97-99db81f47943 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-214d2693-efc8-4eff-b480-f765d2c0f077/13/shuffle_14_0_0.data.28013249-d7d7-41d5-9b2e-eb26382282f4 (No such file or directory)

======================================================================
ERROR: test_large_elements (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 623, in test_large_elements
    assert_that(gbk_res, equal_to(['a', 'b']), label='gbk')
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_large_elements_1560513821.66_544956a7-63b3-41d2-9bd7-9c9c998f63cc failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-214d2693-efc8-4eff-b480-f765d2c0f077/0d/temp_shuffle_ec09f358-abc7-4326-81f1-bf3c1f538024 (No such file or directory)

======================================================================
ERROR: test_multimap_side_input (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 254, in test_multimap_side_input
    equal_to([('a', [1, 3]), ('b', [2])]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_multimap_side_input_1560513823.48_e11bc112-786a-46c6-94c3-3d03edad129b failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-214d2693-efc8-4eff-b480-f765d2c0f077/0a/shuffle_17_0_0.data.903593be-613c-4f8e-a9d2-172cb722be00 (No such file or directory)

======================================================================
ERROR: test_multimap_side_input_type_coercion (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 267, in test_multimap_side_input_type_coercion
    equal_to([('a', [1, 3]), ('b', [2])]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_multimap_side_input_type_coercion_1560513825.49_5e91653d-6889-402f-a4bb-984fdbc5b7da failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-214d2693-efc8-4eff-b480-f765d2c0f077/0e/temp_shuffle_202fe976-6dca-4dd8-ae40-c41dd6a5be1d (No such file or directory)

======================================================================
ERROR: test_no_subtransform_composite (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 673, in test_no_subtransform_composite
    assert_that((pcoll_a, pcoll_b) | First(), equal_to(['a']))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_no_subtransform_composite_1560513831.94_35c5c3bb-33a1-430c-8895-abfb5e3e1572 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-214d2693-efc8-4eff-b480-f765d2c0f077/11/shuffle_21_0_0.data.ed00a654-9dbd-4cbb-a92b-4760072e196c (No such file or directory)

======================================================================
ERROR: test_pardo (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 104, in test_pardo
    assert_that(res, equal_to(['aax', 'bcbcx']))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_1560513834.65_8df4a90a-0535-485d-b0fd-f9283b71c1ad failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-214d2693-efc8-4eff-b480-f765d2c0f077/0d/shuffle_23_0_0.index.fcf1af29-f6b9-4b58-b2ce-6f46fea7d3de (No such file or directory)

======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 176, in test_pardo_side_and_main_outputs
    assert_that(unnamed.odd, equal_to([1, 3]), label='unnamed.odd')
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_and_main_outputs_1560513836.53_f57ecd2e-e4ee-43b3-8c4c-4353644ae376 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-214d2693-efc8-4eff-b480-f765d2c0f077/0d/shuffle_25_0_0.data.ba07f2b4-20ce-4d75-86d9-de3a9fdb786e (No such file or directory)

======================================================================
ERROR: test_pardo_side_outputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 158, in test_pardo_side_outputs
    assert_that(xy.y, equal_to(['y', 'xy']), label='y')
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_outputs_1560513847.14_b829c59f-0804-4ba7-b5a0-0fce67082359 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-214d2693-efc8-4eff-b480-f765d2c0f077/0d/shuffle_30_0_0.data.cfcddc08-5902-4942-ab37-99451ae247bb (No such file or directory)

======================================================================
ERROR: test_pardo_state_only (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 308, in test_pardo_state_only
    equal_to(expected))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_state_only_1560513850.42_94fd4536-5e0b-4df9-9471-01d2b3944c2d failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-214d2693-efc8-4eff-b480-f765d2c0f077/11/shuffle_34_0_0.data.4065167e-5402-4da7-b97f-141d3b0dade7 (No such file or directory)

======================================================================
ERROR: test_pardo_state_timers (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 401, in test_pardo_state_timers
    self._run_pardo_state_timers(False)
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 461, in _run_pardo_state_timers
    assert_that(actual, is_buffered_correctly)
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_state_timers_1560513851.83_09e7a368-828a-4b4a-93cf-e1e21c9c601b failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-214d2693-efc8-4eff-b480-f765d2c0f077/13/shuffle_36_0_0.data.925145f6-7868-42ff-b4f6-f80c021bd82e (No such file or directory)

======================================================================
ERROR: test_pardo_timers (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 361, in test_pardo_timers
    assert_that(actual, equal_to(expected))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_timers_1560513854.14_33cceb7e-796d-40f5-93bb-7c6c3569294b failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-214d2693-efc8-4eff-b480-f765d2c0f077/0e/shuffle_39_0_0.index.b6ba1be6-7486-4528-a374-9fe757e7cef8 (No such file or directory)

======================================================================
ERROR: test_pardo_unfusable_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 277, in test_pardo_unfusable_side_inputs
    equal_to([('a', 'a'), ('a', 'b'), ('b', 'a'), ('b', 'b')]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_unfusable_side_inputs_1560513856.45_58db1e65-69cf-4088-b901-8d298c1d8be5 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-214d2693-efc8-4eff-b480-f765d2c0f077/13/shuffle_41_0_0.data.47caf8a5-04e4-40a8-b5ed-ce24cfa2f908 (No such file or directory)

======================================================================
ERROR: test_pardo_windowed_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 214, in test_pardo_windowed_side_inputs
    label='windowed')
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_windowed_side_inputs_1560513857.67_19e07f16-5ad0-40a3-b57f-b9f82d6c222a failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-214d2693-efc8-4eff-b480-f765d2c0f077/25/temp_shuffle_f4ab46e6-7d27-4a79-9eed-a7caecc70e94 (No such file or directory)

======================================================================
ERROR: test_read (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 592, in test_read
    equal_to(['a', 'b', 'c']))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_read_1560513858.91_3bf0859a-02e7-415e-9281-2d08df2ba368 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-214d2693-efc8-4eff-b480-f765d2c0f077/11/shuffle_43_0_0.data.ff971849-51ae-4320-9c51-28dfa0b1671b (No such file or directory)

======================================================================
ERROR: test_reshuffle (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 562, in test_reshuffle
    equal_to([1, 2, 3]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_reshuffle_1560513861.91_79426841-6047-4725-a50c-d2f68aac84c8 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-214d2693-efc8-4eff-b480-f765d2c0f077/0d/shuffle_47_0_0.data.53fc6c54-7dec-4a8a-a9e9-ab3f896f202d (No such file or directory)

======================================================================
ERROR: test_sdf_wrapper_overrides_read (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/mock-2.0.0-py2.7.egg/mock/mock.py",> line 1305, in patched
    return func(*args, **keywargs)
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 545, in test_sdf_wrapper_overrides_read
    self._run_sdf_wrapper_pipeline(RangeSource(0, 4), ['1'])
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 534, in _run_sdf_wrapper_pipeline
    p | beam.io.Read(source)
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_sdf_wrapper_overrides_read_1560513865.24_1ee9571c-a48f-4d09-9f17-fe3b460488dc failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-214d2693-efc8-4eff-b480-f765d2c0f077/11/temp_shuffle_a20c54b5-9c00-44d2-a3fc-228ee706cbb1 (No such file or directory)

======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 404, in test_windowed_pardo_state_timers
    self._run_pardo_state_timers(True)
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 461, in _run_pardo_state_timers
    assert_that(actual, is_buffered_correctly)
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_windowed_pardo_state_timers_1560513866.27_6af24649-4837-4f73-abc0-09f081c223bf failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-214d2693-efc8-4eff-b480-f765d2c0f077/22/temp_shuffle_49b8ec73-733b-4d35-8e01-8f24099fd926 (No such file or directory)

======================================================================
ERROR: test_windowing (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 604, in test_windowing
    assert_that(res, equal_to([('k', [1, 2]), ('k', [100, 101, 102])]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_windowing_1560513867.8_3c82950a-1a99-4b06-87f0-8745dcf495fc failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-214d2693-efc8-4eff-b480-f765d2c0f077/11/temp_shuffle_2644a93c-c371-47d8-9b66-d8a1118458e0 (No such file or directory)

----------------------------------------------------------------------
Ran 38 tests in 89.382s

FAILED (errors=22, skipped=10)

> Task :sdks:python:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/build.gradle'> line: 251

* What went wrong:
Execution failed for task ':sdks:python:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 4m 16s
60 actionable tasks: 48 executed, 12 from cache

Publishing build scan...
https://gradle.com/s/3gg2pn3gnbwta

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_Python_VR_Spark #124

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/124/display/redirect?page=changes>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org