You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/06/18 12:06:53 UTC
Build failed in Jenkins: beam_PostCommit_Python_VR_Spark #159
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/159/display/redirect>
------------------------------------------
[...truncated 1.11 MB...]
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_group_by_key_1560859462.57_d5abd490-db48-458c-90c9-a237af176d5f failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-0c7ca546-0254-40ce-a462-bd3cc5b61cb4/10/shuffle_15_0_0.index.8d526c3f-c242-4c82-b08c-8c5b625e0db6 (No such file or directory)
======================================================================
ERROR: test_large_elements (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 623, in test_large_elements
assert_that(gbk_res, equal_to(['a', 'b']), label='gbk')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_large_elements_1560859469.26_e6ca5e7a-0f13-43f3-99ea-0e76aacf6f4a failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-0c7ca546-0254-40ce-a462-bd3cc5b61cb4/0b/temp_shuffle_a3341d28-8323-4466-8f6e-1d9e896eb956 (No such file or directory)
======================================================================
ERROR: test_multimap_side_input (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 254, in test_multimap_side_input
equal_to([('a', [1, 3]), ('b', [2])]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_multimap_side_input_1560859475.22_aa9e52b5-d1ba-4d1c-8ddd-ebeacb138582 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-0c7ca546-0254-40ce-a462-bd3cc5b61cb4/0a/shuffle_17_0_0.data.cf89cf3e-b636-44c7-a9ac-02e166ab34a6 (No such file or directory)
======================================================================
ERROR: test_multimap_side_input_type_coercion (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 267, in test_multimap_side_input_type_coercion
equal_to([('a', [1, 3]), ('b', [2])]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_multimap_side_input_type_coercion_1560859480.19_8eb5d4c5-8c55-4d77-96ee-4aa46bf94671 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-0c7ca546-0254-40ce-a462-bd3cc5b61cb4/32/shuffle_20_0_0.data.6db4d00e-a0f4-4d02-9d74-4b489e37b9bb (No such file or directory)
======================================================================
ERROR: test_no_subtransform_composite (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 673, in test_no_subtransform_composite
assert_that((pcoll_a, pcoll_b) | First(), equal_to(['a']))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_no_subtransform_composite_1560859489.48_3f399491-caae-4878-b851-16cc5418911c failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-0c7ca546-0254-40ce-a462-bd3cc5b61cb4/11/shuffle_21_0_0.data.ac8c17ba-6cac-4ff5-a04e-c273b6ea8cfc (No such file or directory)
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 176, in test_pardo_side_and_main_outputs
assert_that(unnamed.odd, equal_to([1, 3]), label='unnamed.odd')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_and_main_outputs_1560859516.79_7f58d4a4-c46c-49ea-925b-41828700ec01 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-0c7ca546-0254-40ce-a462-bd3cc5b61cb4/10/shuffle_26_0_0.index.2eebda07-c47d-43ff-94dc-a9e9e7040e49 (No such file or directory)
======================================================================
ERROR: test_pardo_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 187, in test_pardo_side_inputs
('a', 'y'), ('b', 'y'), ('c', 'y')]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_inputs_1560859525.45_5fba679b-679e-42ca-ae10-a4f760f85938 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-0c7ca546-0254-40ce-a462-bd3cc5b61cb4/0b/shuffle_27_0_0.data.5fbb620c-53ab-49cd-8667-89c6fd35bb72 (No such file or directory)
======================================================================
ERROR: test_pardo_side_outputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 158, in test_pardo_side_outputs
assert_that(xy.y, equal_to(['y', 'xy']), label='y')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_outputs_1560859530.76_58146008-f173-40d3-9614-40d8ee22f8c7 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-0c7ca546-0254-40ce-a462-bd3cc5b61cb4/11/temp_shuffle_0b74289b-8c97-424e-ace5-ec88986578a0 (No such file or directory)
======================================================================
ERROR: test_pardo_state_only (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 308, in test_pardo_state_only
equal_to(expected))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_state_only_1560859536.55_af04a5dc-e0a1-4c57-a20c-8cabd0625309 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-0c7ca546-0254-40ce-a462-bd3cc5b61cb4/11/temp_shuffle_0190fe22-eccf-418e-b49f-a65331267acc (No such file or directory)
======================================================================
ERROR: test_pardo_state_timers (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 401, in test_pardo_state_timers
self._run_pardo_state_timers(False)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 461, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_state_timers_1560859552.59_bd32ece9-54a9-4b73-bbec-d0f2f18311ae failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-0c7ca546-0254-40ce-a462-bd3cc5b61cb4/25/temp_shuffle_4e2e3f67-285a-4ec7-8799-a1db5cd4c489 (No such file or directory)
======================================================================
ERROR: test_pardo_timers (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 361, in test_pardo_timers
assert_that(actual, equal_to(expected))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_timers_1560859555.69_576b0ab2-f1e4-4525-8293-2b680a3ae93a failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-0c7ca546-0254-40ce-a462-bd3cc5b61cb4/10/shuffle_37_0_0.index.faed8768-2214-466f-ac31-15117129ea37 (No such file or directory)
======================================================================
ERROR: test_pardo_unfusable_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 277, in test_pardo_unfusable_side_inputs
equal_to([('a', 'a'), ('a', 'b'), ('b', 'a'), ('b', 'b')]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_unfusable_side_inputs_1560859562.34_a3e3b35f-1bb4-4ad4-bec1-1ab6622001d0 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-0c7ca546-0254-40ce-a462-bd3cc5b61cb4/36/shuffle_39_0_0.data.039c6b4d-8eb8-49f0-97f8-4e22268dd91c (No such file or directory)
======================================================================
ERROR: test_pardo_windowed_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 214, in test_pardo_windowed_side_inputs
label='windowed')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_windowed_side_inputs_1560859567.58_c41aee65-6117-450b-90f3-7726d928535c failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-0c7ca546-0254-40ce-a462-bd3cc5b61cb4/13/shuffle_41_0_0.data.7bc935bb-9d91-4467-a5d2-830d494d935f (No such file or directory)
======================================================================
ERROR: test_read (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 592, in test_read
equal_to(['a', 'b', 'c']))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_read_1560859575.38_671b03f4-058d-49c8-b8b4-cb18bd0f4bc0 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-0c7ca546-0254-40ce-a462-bd3cc5b61cb4/11/shuffle_43_0_0.data.0740cc89-c06d-4a3b-9973-ce90db83a7d0 (No such file or directory)
======================================================================
ERROR: test_reshuffle (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 562, in test_reshuffle
equal_to([1, 2, 3]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_reshuffle_1560859580.85_b20eb9c3-43a2-41a8-be33-476121b73fe5 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-0c7ca546-0254-40ce-a462-bd3cc5b61cb4/0e/shuffle_46_0_0.index.fcf7e487-ef6f-4fd0-b0c5-c292d23a0487 (No such file or directory)
======================================================================
ERROR: test_sdf_wrapper_overrides_read (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/mock-2.0.0-py2.7.egg/mock/mock.py",> line 1305, in patched
return func(*args, **keywargs)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 545, in test_sdf_wrapper_overrides_read
self._run_sdf_wrapper_pipeline(RangeSource(0, 4), ['1'])
File "apache_beam/runners/portability/fn_api_runner_test.py", line 534, in _run_sdf_wrapper_pipeline
p | beam.io.Read(source)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_sdf_wrapper_overrides_read_1560859590.02_c07c9835-8d87-4ae5-a27d-52d2416450f1 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-0c7ca546-0254-40ce-a462-bd3cc5b61cb4/10/shuffle_48_0_0.index.8cb698ec-79ce-41e8-83a3-8d430dcf6334 (No such file or directory)
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 404, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 461, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_windowed_pardo_state_timers_1560859594.61_7ed0a7c8-76a6-4e0a-989d-4f3d9cfa222a failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-0c7ca546-0254-40ce-a462-bd3cc5b61cb4/1d/temp_shuffle_7f239989-c3e3-42e4-9b5b-77d8a3d484a7 (No such file or directory)
======================================================================
ERROR: test_windowing (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 604, in test_windowing
assert_that(res, equal_to([('k', [1, 2]), ('k', [100, 101, 102])]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_windowing_1560859598.9_c5a736f6-5094-47df-9ee9-2e21a22dad11 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-0c7ca546-0254-40ce-a462-bd3cc5b61cb4/0a/temp_shuffle_40ce1f8e-ba23-4fc7-84ff-a64e9710d958 (No such file or directory)
----------------------------------------------------------------------
Ran 38 tests in 231.238s
FAILED (errors=23, skipped=10)
> Task :sdks:python:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/build.gradle'> line: 251
* What went wrong:
Execution failed for task ':sdks:python:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 32s
60 actionable tasks: 47 executed, 13 from cache
Publishing build scan...
https://gradle.com/s/a4bho7qbl54jm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Python_VR_Spark
#160
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/160/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org