You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/06/14 06:04:14 UTC
Build failed in Jenkins: beam_PostCommit_Python_VR_Spark #117
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/117/display/redirect>
------------------------------------------
[...truncated 1.21 MB...]
RuntimeError: Pipeline test_multimap_side_input_1560492208.58_91ecd8b0-78cd-4117-a744-564d53a01b1a failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-ed9c27cf-1179-4000-b947-d1d90f7c1263/27/temp_shuffle_58cc737f-6280-4252-8077-d54761bd26c9 (No such file or directory)
======================================================================
ERROR: test_multimap_side_input_type_coercion (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 267, in test_multimap_side_input_type_coercion
equal_to([('a', [1, 3]), ('b', [2])]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_multimap_side_input_type_coercion_1560492210.34_98f649fd-6f19-4b66-b911-a16ee8725510 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-ed9c27cf-1179-4000-b947-d1d90f7c1263/11/shuffle_21_0_0.data.33e117a0-8165-4aa7-8570-a134c18b7384 (No such file or directory)
======================================================================
ERROR: test_no_subtransform_composite (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 673, in test_no_subtransform_composite
assert_that((pcoll_a, pcoll_b) | First(), equal_to(['a']))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_no_subtransform_composite_1560492213.72_163c4ecc-0f9b-4de9-bd49-22d27ceff5e7 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-ed9c27cf-1179-4000-b947-d1d90f7c1263/34/shuffle_22_0_0.index.88bbdd84-7ba4-4272-94e5-c0f64d638929 (No such file or directory)
======================================================================
ERROR: test_pardo (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 104, in test_pardo
assert_that(res, equal_to(['aax', 'bcbcx']))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_1560492215.96_0ccf5b67-8c53-490c-8e84-657b1c62f48f failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-ed9c27cf-1179-4000-b947-d1d90f7c1263/13/temp_shuffle_834a3d82-e3c5-45cf-984a-a5cb74eb0846 (No such file or directory)
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 176, in test_pardo_side_and_main_outputs
assert_that(unnamed.odd, equal_to([1, 3]), label='unnamed.odd')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_and_main_outputs_1560492218.84_1182b1fd-b175-4cff-a0da-94a9dded8097 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-ed9c27cf-1179-4000-b947-d1d90f7c1263/0b/shuffle_27_0_0.data.843da8e0-5ff0-41b6-9977-e7e3366707d9 (No such file or directory)
======================================================================
ERROR: test_pardo_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 187, in test_pardo_side_inputs
('a', 'y'), ('b', 'y'), ('c', 'y')]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_inputs_1560492221.26_6739c78e-2307-4f3d-b83e-11230cc9d675 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-ed9c27cf-1179-4000-b947-d1d90f7c1263/2d/shuffle_29_0_0.index.733eb753-c160-4e28-bda2-5acf8304b40f (No such file or directory)
======================================================================
ERROR: test_pardo_side_outputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 158, in test_pardo_side_outputs
assert_that(xy.y, equal_to(['y', 'xy']), label='y')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_outputs_1560492226.93_d6ba354f-b698-4b80-bc44-88bb463f4a07 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-ed9c27cf-1179-4000-b947-d1d90f7c1263/2d/shuffle_33_1_0.index.6051f6e8-9de7-4cd3-9a75-6d2cd9dd671e (No such file or directory)
======================================================================
ERROR: test_pardo_state_only (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 308, in test_pardo_state_only
equal_to(expected))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_state_only_1560492231.39_601d94b7-3f0d-4d1d-bfbe-76356f958ef5 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-ed9c27cf-1179-4000-b947-d1d90f7c1263/13/shuffle_36_0_0.data.5c4c0bad-3be3-401f-accb-30b8b3bc5f49 (No such file or directory)
======================================================================
ERROR: test_pardo_state_timers (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 401, in test_pardo_state_timers
self._run_pardo_state_timers(False)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 461, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_state_timers_1560492233.13_dc9e156c-04aa-4812-83ee-d7ea3556129c failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-ed9c27cf-1179-4000-b947-d1d90f7c1263/24/temp_shuffle_7b99ed65-2ee7-4f14-a02f-bc2ce30f4418 (No such file or directory)
======================================================================
ERROR: test_pardo_timers (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 361, in test_pardo_timers
assert_that(actual, equal_to(expected))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_timers_1560492234.43_97dec3bc-0f87-4b75-8ecd-de4dcc39e2af failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-ed9c27cf-1179-4000-b947-d1d90f7c1263/36/shuffle_42_0_0.index.13783688-3d8b-423f-88e9-a8bc5d4d7616 (No such file or directory)
======================================================================
ERROR: test_pardo_unfusable_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 277, in test_pardo_unfusable_side_inputs
equal_to([('a', 'a'), ('a', 'b'), ('b', 'a'), ('b', 'b')]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_unfusable_side_inputs_1560492235.97_b1f0722c-bdd8-4cf5-bbcd-ccd95260f470 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-ed9c27cf-1179-4000-b947-d1d90f7c1263/2d/temp_shuffle_d4418760-d141-4693-ad23-0fc5d19e3d40 (No such file or directory)
======================================================================
ERROR: test_pardo_windowed_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 214, in test_pardo_windowed_side_inputs
label='windowed')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_windowed_side_inputs_1560492237.34_4ed31f9c-d8fc-43f2-9605-1acd4b923a0a failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-ed9c27cf-1179-4000-b947-d1d90f7c1263/11/temp_shuffle_2c6e63e5-f2a9-45e6-aea6-971befe00025 (No such file or directory)
======================================================================
ERROR: test_read (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 592, in test_read
equal_to(['a', 'b', 'c']))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_read_1560492240.59_60a631d0-7f64-4a41-a428-ce7fa4655020 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-ed9c27cf-1179-4000-b947-d1d90f7c1263/0e/shuffle_46_0_0.index.9fd066f3-12e4-4ac5-b6fb-598507b6a882 (No such file or directory)
======================================================================
ERROR: test_reshuffle (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 562, in test_reshuffle
equal_to([1, 2, 3]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_reshuffle_1560492243.27_98010da0-e7ce-40eb-a5fe-a9b3ea85d150 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-ed9c27cf-1179-4000-b947-d1d90f7c1263/34/temp_shuffle_b614d1fc-8480-4bbe-ac0f-0da6b7a48a58 (No such file or directory)
======================================================================
ERROR: test_sdf_wrap_range_source (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 548, in test_sdf_wrap_range_source
self._run_sdf_wrapper_pipeline(RangeSource(0, 4), [0, 1, 2, 3])
File "apache_beam/runners/portability/fn_api_runner_test.py", line 534, in _run_sdf_wrapper_pipeline
p | beam.io.Read(source)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_sdf_wrap_range_source_1560492246.13_b50d4551-01e1-4cd1-92c0-4e5ccded0b16 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-ed9c27cf-1179-4000-b947-d1d90f7c1263/33/temp_shuffle_f75802c5-eada-4928-9088-eaa3c47b8b6a (No such file or directory)
======================================================================
ERROR: test_sdf_wrapper_overrides_read (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/mock-2.0.0-py2.7.egg/mock/mock.py",> line 1305, in patched
return func(*args, **keywargs)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 545, in test_sdf_wrapper_overrides_read
self._run_sdf_wrapper_pipeline(RangeSource(0, 4), ['1'])
File "apache_beam/runners/portability/fn_api_runner_test.py", line 534, in _run_sdf_wrapper_pipeline
p | beam.io.Read(source)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_sdf_wrapper_overrides_read_1560492247.45_1c1f4017-74d7-4cbe-89fe-6c4268220361 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-ed9c27cf-1179-4000-b947-d1d90f7c1263/33/shuffle_52_0_0.data.733e555f-e61a-491a-b7bc-c255c9be1a67 (No such file or directory)
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 404, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 461, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_windowed_pardo_state_timers_1560492248.66_8ca71967-945d-4d68-b403-6ec62ef93d75 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-ed9c27cf-1179-4000-b947-d1d90f7c1263/33/temp_shuffle_b9f00e84-8460-49fc-a8d6-5135a742fcfd (No such file or directory)
======================================================================
ERROR: test_windowing (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 604, in test_windowing
assert_that(res, equal_to([('k', [1, 2]), ('k', [100, 101, 102])]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_windowing_1560492250.1_0c2cfef2-62e4-4228-8c40-59d9883567af failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-ed9c27cf-1179-4000-b947-d1d90f7c1263/13/shuffle_58_0_0.data.8b7424a1-a210-48d5-afae-00256a9529e9 (No such file or directory)
----------------------------------------------------------------------
Ran 38 tests in 88.396s
FAILED (errors=22, skipped=10)
> Task :sdks:python:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/build.gradle'> line: 251
* What went wrong:
Execution failed for task ':sdks:python:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 59s
60 actionable tasks: 47 executed, 13 from cache
Publishing build scan...
https://gradle.com/s/dv5xnqhm7hyqu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Python_VR_Spark
#118
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/118/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org