You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/06/19 18:04:29 UTC

Build failed in Jenkins: beam_PostCommit_Python_VR_Spark #172

See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/172/display/redirect>

------------------------------------------
[...truncated 1.10 MB...]
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 556, in test_group_by_key
    assert_that(res, equal_to([('a', [1, 2]), ('b', [3])]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_group_by_key_1560967412.95_d77e1574-b4a9-4d1e-9298-791b8903f201 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-00e578a5-5beb-44bd-a785-9f40eccb6240/13/temp_shuffle_4a63426d-40c4-4115-b520-b16116c52ea6 (No such file or directory)

======================================================================
ERROR: test_large_elements (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 623, in test_large_elements
    assert_that(gbk_res, equal_to(['a', 'b']), label='gbk')
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_large_elements_1560967414.38_89ff05c7-9e01-4153-91fc-5d53a969d170 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-00e578a5-5beb-44bd-a785-9f40eccb6240/0e/temp_shuffle_d8c60aa2-2e2f-4bc9-bc21-aaee5e53d254 (No such file or directory)

======================================================================
ERROR: test_multimap_side_input (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 254, in test_multimap_side_input
    equal_to([('a', [1, 3]), ('b', [2])]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_multimap_side_input_1560967420.95_92ac7a54-ba08-4c03-93a3-3028a909da06 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-00e578a5-5beb-44bd-a785-9f40eccb6240/3b/temp_shuffle_720f27af-68d9-4c69-a037-36590f937661 (No such file or directory)

======================================================================
ERROR: test_multimap_side_input_type_coercion (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 267, in test_multimap_side_input_type_coercion
    equal_to([('a', [1, 3]), ('b', [2])]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_multimap_side_input_type_coercion_1560967422.98_faf60cb2-1e57-4734-89b0-78b9a193a595 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-00e578a5-5beb-44bd-a785-9f40eccb6240/21/temp_shuffle_c23b4f82-6ac4-480d-9b2f-caadba662ee7 (No such file or directory)

======================================================================
ERROR: test_no_subtransform_composite (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 673, in test_no_subtransform_composite
    assert_that((pcoll_a, pcoll_b) | First(), equal_to(['a']))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_no_subtransform_composite_1560967424.59_7f37bc27-61b4-44a7-9085-4cc0b5aef1b7 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-00e578a5-5beb-44bd-a785-9f40eccb6240/08/shuffle_19_0_0.data.52c21ea3-43a4-47c4-a6c4-2d20e36b2843 (No such file or directory)

======================================================================
ERROR: test_pardo (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 104, in test_pardo
    assert_that(res, equal_to(['aax', 'bcbcx']))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_1560967426.9_5877290b-c43a-4fbd-b0cf-310b9a5bce43 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-00e578a5-5beb-44bd-a785-9f40eccb6240/3b/temp_shuffle_749d2d14-3f1e-49f9-9f09-1c20f6d0a090 (No such file or directory)

======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 176, in test_pardo_side_and_main_outputs
    assert_that(unnamed.odd, equal_to([1, 3]), label='unnamed.odd')
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_and_main_outputs_1560967428.76_d2e1dac5-9a05-4262-99cf-8f2a3ffdda51 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-00e578a5-5beb-44bd-a785-9f40eccb6240/2e/shuffle_24_0_0.data.867b4d67-2e38-4ed9-871e-0b354939ecd7 (No such file or directory)

======================================================================
ERROR: test_pardo_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 187, in test_pardo_side_inputs
    ('a', 'y'), ('b', 'y'), ('c', 'y')]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_inputs_1560967432.11_ed146bbc-26e7-43c7-afdd-956d9c7bf345 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-00e578a5-5beb-44bd-a785-9f40eccb6240/0b/shuffle_27_0_0.data.f75d17b6-585b-4e21-ac57-65cbeb0d7e58 (No such file or directory)

======================================================================
ERROR: test_pardo_side_outputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 158, in test_pardo_side_outputs
    assert_that(xy.y, equal_to(['y', 'xy']), label='y')
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_outputs_1560967435.7_8f848f83-e037-424d-8ad1-aaa0fe0f45ab failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-00e578a5-5beb-44bd-a785-9f40eccb6240/08/temp_shuffle_56b16c09-ed26-4cd6-8859-c61019253aea (No such file or directory)

======================================================================
ERROR: test_pardo_state_only (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 308, in test_pardo_state_only
    equal_to(expected))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_state_only_1560967438.43_f6a2058b-4e5c-4b03-b7bd-d3d722687801 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-00e578a5-5beb-44bd-a785-9f40eccb6240/2e/shuffle_31_0_0.data.6958d415-fa03-4416-9bb4-f9ad5bc15842 (No such file or directory)

======================================================================
ERROR: test_pardo_state_timers (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 401, in test_pardo_state_timers
    self._run_pardo_state_timers(False)
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 461, in _run_pardo_state_timers
    assert_that(actual, is_buffered_correctly)
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_state_timers_1560967441.79_a3749f91-ed1c-4220-a1cf-8fd533453d00 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-00e578a5-5beb-44bd-a785-9f40eccb6240/11/shuffle_34_0_0.data.b1cb552e-4c4e-49a8-a3c8-bd7f6364f1cb (No such file or directory)

======================================================================
ERROR: test_pardo_timers (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 361, in test_pardo_timers
    assert_that(actual, equal_to(expected))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_timers_1560967444.29_58876a44-bf57-48f1-abe2-6b3d868a0c68 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-00e578a5-5beb-44bd-a785-9f40eccb6240/11/temp_shuffle_83575d9d-13f0-4922-93d0-f59c51c3ec4e (No such file or directory)

======================================================================
ERROR: test_pardo_unfusable_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 277, in test_pardo_unfusable_side_inputs
    equal_to([('a', 'a'), ('a', 'b'), ('b', 'a'), ('b', 'b')]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_unfusable_side_inputs_1560967447.61_be743a92-bbf6-45d8-93eb-01e38aceade0 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-00e578a5-5beb-44bd-a785-9f40eccb6240/36/shuffle_39_0_0.data.c41cbc10-64f7-4973-80c1-7efb71a1cf12 (No such file or directory)

======================================================================
ERROR: test_pardo_windowed_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 214, in test_pardo_windowed_side_inputs
    label='windowed')
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_windowed_side_inputs_1560967449.49_aa753edd-962d-4094-8bfe-6ccad08f4a63 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-00e578a5-5beb-44bd-a785-9f40eccb6240/0e/shuffle_41_1_0.data.7ccc8318-91cc-455e-8a5e-23b0ed78f482 (No such file or directory)

======================================================================
ERROR: test_read (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 592, in test_read
    equal_to(['a', 'b', 'c']))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_read_1560967453.63_89a4c620-a2fd-4adc-ae8e-36adc6f3c673 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-00e578a5-5beb-44bd-a785-9f40eccb6240/11/shuffle_43_0_0.data.211e36dd-4375-40b5-8a7b-706080f016fb (No such file or directory)

======================================================================
ERROR: test_reshuffle (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 562, in test_reshuffle
    equal_to([1, 2, 3]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_reshuffle_1560967455.74_deb5deaa-bda9-4af1-a618-8b39cf7e9705 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-00e578a5-5beb-44bd-a785-9f40eccb6240/2e/shuffle_46_0_0.data.884f132c-f12d-4773-9da3-a258bfddfec1 (No such file or directory)

======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 404, in test_windowed_pardo_state_timers
    self._run_pardo_state_timers(True)
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 461, in _run_pardo_state_timers
    assert_that(actual, is_buffered_correctly)
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_windowed_pardo_state_timers_1560967461.97_2d65c857-1a00-4d19-9e28-a53427e0a54e failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-00e578a5-5beb-44bd-a785-9f40eccb6240/09/temp_shuffle_dfe9c53e-63f8-41ec-b39c-93b50668be03 (No such file or directory)

======================================================================
ERROR: test_windowing (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 604, in test_windowing
    assert_that(res, equal_to([('k', [1, 2]), ('k', [100, 101, 102])]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_windowing_1560967464.68_d7c4a663-4e2c-4192-b3ee-21ea8f970699 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-00e578a5-5beb-44bd-a785-9f40eccb6240/2e/shuffle_53_0_0.data.294b3f2f-7011-459a-8877-10349e23b738 (No such file or directory)

----------------------------------------------------------------------
Ran 38 tests in 89.987s

FAILED (errors=21, skipped=10)

> Task :sdks:python:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/build.gradle'> line: 251

* What went wrong:
Execution failed for task ':sdks:python:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 4m 16s
60 actionable tasks: 47 executed, 13 from cache

Publishing build scan...
https://gradle.com/s/zsag5dcsbbuiw

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_Python_VR_Spark #173

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/173/display/redirect?page=changes>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org