You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/06/13 00:04:18 UTC
Build failed in Jenkins: beam_PostCommit_Python_VR_Spark #98
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/98/display/redirect?page=changes>
Changes:
[angoenka] [BEAM-7407] Adds portable wordcount test for Python 3 with Flink runner.
------------------------------------------
[...truncated 1.08 MB...]
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_flattened_side_input_1560384196.61_4897d189-4c3d-4004-949d-a64fb31aa836 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-96598b31-f0be-4ebd-95b5-edd524b664ca/11/shuffle_10_2_0.data.49d51c7b-e2e6-452a-be4a-7408827f1d2b (No such file or directory)
======================================================================
ERROR: test_gbk_side_input (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 242, in test_gbk_side_input
equal_to([(None, {'a': [1]})]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_gbk_side_input_1560384203.08_29fac92b-422d-4100-8a14-3939769de9e9 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-96598b31-f0be-4ebd-95b5-edd524b664ca/36/temp_shuffle_5b4af5cf-1e7b-47b9-8eda-3120c9474d03 (No such file or directory)
======================================================================
ERROR: test_group_by_key (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 525, in test_group_by_key
assert_that(res, equal_to([('a', [1, 2]), ('b', [3])]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_group_by_key_1560384204.92_6b7e977d-ffaa-4b12-b6b6-38874386672a failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-96598b31-f0be-4ebd-95b5-edd524b664ca/13/shuffle_14_0_0.data.72d31efe-ed7c-4114-b65d-5c5c9f06f446 (No such file or directory)
======================================================================
ERROR: test_large_elements (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 592, in test_large_elements
assert_that(gbk_res, equal_to(['a', 'b']), label='gbk')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_large_elements_1560384206.28_eb3b2397-383a-42ff-b373-b965bed1a1fd failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-96598b31-f0be-4ebd-95b5-edd524b664ca/36/shuffle_16_1_0.data.fc002184-57b3-43b1-b7d8-1256c030dc7f (No such file or directory)
======================================================================
ERROR: test_multimap_side_input (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 253, in test_multimap_side_input
equal_to([('a', [1, 3]), ('b', [2])]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_multimap_side_input_1560384212.93_6c458a21-7a15-4d2f-b4ca-9cc646b241e4 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-96598b31-f0be-4ebd-95b5-edd524b664ca/0e/shuffle_17_0_0.index.2e497ac9-c2d2-4fd1-a781-ba4d412d876f (No such file or directory)
======================================================================
ERROR: test_multimap_side_input_type_coercion (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 266, in test_multimap_side_input_type_coercion
equal_to([('a', [1, 3]), ('b', [2])]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_multimap_side_input_type_coercion_1560384214.43_fcb0a967-1ad6-44dc-84f6-603c3d805acc failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-96598b31-f0be-4ebd-95b5-edd524b664ca/36/shuffle_20_0_0.index.7e8b6e96-adf1-4b95-a832-71a80ab9704f (No such file or directory)
======================================================================
ERROR: test_no_subtransform_composite (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 642, in test_no_subtransform_composite
assert_that((pcoll_a, pcoll_b) | First(), equal_to(['a']))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_no_subtransform_composite_1560384217.71_c31e251a-5900-46e3-af55-98977a20ef8c failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-96598b31-f0be-4ebd-95b5-edd524b664ca/11/shuffle_21_0_0.data.dcb132cf-df2a-4d4e-8b00-96c69f6e6723 (No such file or directory)
======================================================================
ERROR: test_pardo (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 103, in test_pardo
assert_that(res, equal_to(['aax', 'bcbcx']))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_1560384220.01_b09188da-bb0d-4c15-a177-2351ec6507a4 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-96598b31-f0be-4ebd-95b5-edd524b664ca/1d/temp_shuffle_d286d96a-dde6-47d5-a466-c21563388ce5 (No such file or directory)
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 175, in test_pardo_side_and_main_outputs
assert_that(unnamed.odd, equal_to([1, 3]), label='unnamed.odd')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_and_main_outputs_1560384223.09_bb9fa6df-f99a-4ccb-b359-f22eb5969f6f failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-96598b31-f0be-4ebd-95b5-edd524b664ca/24/temp_shuffle_77b3f8a5-cae5-43f1-9775-cdef23dac139 (No such file or directory)
======================================================================
ERROR: test_pardo_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 186, in test_pardo_side_inputs
('a', 'y'), ('b', 'y'), ('c', 'y')]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_inputs_1560384227.87_a663443a-5e78-4608-960c-86d52ec0605a failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-96598b31-f0be-4ebd-95b5-edd524b664ca/09/temp_shuffle_e2c51e47-ad45-42e5-b863-583bd10aa606 (No such file or directory)
======================================================================
ERROR: test_pardo_side_outputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 157, in test_pardo_side_outputs
assert_that(xy.y, equal_to(['y', 'xy']), label='y')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_outputs_1560384229.3_e7c8edf5-9fd4-49fd-b63d-fd58c03cb78a failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-96598b31-f0be-4ebd-95b5-edd524b664ca/09/shuffle_28_1_0.data.269c1708-04d9-4f97-8856-1df0daaba2df (No such file or directory)
======================================================================
ERROR: test_pardo_state_only (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 307, in test_pardo_state_only
equal_to(expected))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_state_only_1560384232.79_272a67a6-d3d5-4804-b5a5-a4fcf40ae6c6 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-96598b31-f0be-4ebd-95b5-edd524b664ca/24/temp_shuffle_3ac3400c-77f6-40e5-9d94-29a2d3f3e603 (No such file or directory)
======================================================================
ERROR: test_pardo_unfusable_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 276, in test_pardo_unfusable_side_inputs
equal_to([('a', 'a'), ('a', 'b'), ('b', 'a'), ('b', 'b')]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_unfusable_side_inputs_1560384238.02_d45bdb49-1900-48a4-8333-effe21b2c727 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-96598b31-f0be-4ebd-95b5-edd524b664ca/08/temp_shuffle_673d601f-7de1-45d5-a973-fc905c49d581 (No such file or directory)
======================================================================
ERROR: test_pardo_windowed_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 213, in test_pardo_windowed_side_inputs
label='windowed')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_windowed_side_inputs_1560384241.26_8201b52a-0268-4519-8dbc-93e771359b13 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-96598b31-f0be-4ebd-95b5-edd524b664ca/13/shuffle_36_0_0.data.2e039a92-a0a1-437e-a4b8-1ef8fc11ddd3 (No such file or directory)
======================================================================
ERROR: test_reshuffle (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 531, in test_reshuffle
equal_to([1, 2, 3]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_reshuffle_1560384249.83_e7495812-6f1d-4bab-b433-6e6df70ae68a failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-96598b31-f0be-4ebd-95b5-edd524b664ca/13/shuffle_41_0_0.data.a2c94f8b-6851-4918-b1a7-a470806dd668 (No such file or directory)
======================================================================
ERROR: test_sdf_wrap_range_source (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 517, in test_sdf_wrap_range_source
self._run_sdf_wrapper_pipeline(RangeSource(0, 4), [0, 1, 2, 3])
File "apache_beam/runners/portability/fn_api_runner_test.py", line 503, in _run_sdf_wrapper_pipeline
p | beam.io.Read(source)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_sdf_wrap_range_source_1560384251.26_42b93805-c2db-49ec-aae6-b96d7318b8fc failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-96598b31-f0be-4ebd-95b5-edd524b664ca/28/temp_shuffle_6cff7c7b-05e8-43ba-b2af-542304ecf75d (No such file or directory)
======================================================================
ERROR: test_sdf_wrapper_overrides_read (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/mock-2.0.0-py2.7.egg/mock/mock.py",> line 1305, in patched
return func(*args, **keywargs)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 514, in test_sdf_wrapper_overrides_read
self._run_sdf_wrapper_pipeline(RangeSource(0, 4), ['1'])
File "apache_beam/runners/portability/fn_api_runner_test.py", line 503, in _run_sdf_wrapper_pipeline
p | beam.io.Read(source)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_sdf_wrapper_overrides_read_1560384252.38_9e867371-32f2-4c72-b7f2-f0a7b1c32f82 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-96598b31-f0be-4ebd-95b5-edd524b664ca/09/temp_shuffle_1bfe3fa5-0b93-4fa6-b1e9-43ff87c0844d (No such file or directory)
======================================================================
ERROR: test_windowing (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 573, in test_windowing
assert_that(res, equal_to([('k', [1, 2]), ('k', [100, 101, 102])]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_windowing_1560384253.51_a645acf2-3aed-48a9-93b8-59c369e9bb79 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-96598b31-f0be-4ebd-95b5-edd524b664ca/0e/shuffle_46_0_0.index.92d2606c-0ac5-4e2e-8faf-2abfd9fbb27d (No such file or directory)
----------------------------------------------------------------------
Ran 37 tests in 85.355s
FAILED (errors=19, skipped=12)
> Task :sdks:python:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/build.gradle'> line: 251
* What went wrong:
Execution failed for task ':sdks:python:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 4s
60 actionable tasks: 59 executed, 1 from cache
Publishing build scan...
https://gradle.com/s/gw47gol5gdo2u
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Python_VR_Spark
#99
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/99/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org