You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/06/11 06:03:54 UTC
Build failed in Jenkins: beam_PostCommit_Python_VR_Spark #77
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/77/display/redirect>
------------------------------------------
[...truncated 1.06 MB...]
... 3 more
19/06/11 06:03:52 INFO BeamFileSystemArtifactRetrievalService: Manifest at /tmp/sparktestMGEEmD/job_045f5b78-f86f-40cd-a605-dab1deeeedba/MANIFEST has 0 artifact locations
19/06/11 06:03:52 INFO BeamFileSystemArtifactStagingService: Removed dir /tmp/sparktestMGEEmD/job_045f5b78-f86f-40cd-a605-dab1deeeedba/
ERROR:root:java.io.FileNotFoundException: /tmp/blockmgr-f22fdef4-c8c5-4642-92b5-48545ec3ae2d/36/shuffle_42_0_0.index.08f15beb-316e-4432-b134-c2e9617658bc (No such file or directory)
INFO:root:Job state changed to FAILED
E
======================================================================
ERROR: test_flattened_side_input (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/runners/portability/spark_runner_test.py",> line 144, in test_flattened_side_input
with_transcoding=False)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 234, in test_flattened_side_input
label='CheckFlattenOfSideInput')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_flattened_side_input_1560232988.51_2efe3607-f797-4028-9b9f-40a0e473a974 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-f22fdef4-c8c5-4642-92b5-48545ec3ae2d/16/temp_shuffle_21ff5fe3-402d-49ec-a8aa-14eaf321550b (No such file or directory)
======================================================================
ERROR: test_gbk_side_input (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 242, in test_gbk_side_input
equal_to([(None, {'a': [1]})]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_gbk_side_input_1560232999.1_ef7bb5f5-e34e-4834-9293-65bf07ff4391 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-f22fdef4-c8c5-4642-92b5-48545ec3ae2d/35/temp_shuffle_6b12b544-6f0f-49ea-a9f9-6342d5fa809d (No such file or directory)
======================================================================
ERROR: test_group_by_key (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 525, in test_group_by_key
assert_that(res, equal_to([('a', [1, 2]), ('b', [3])]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_group_by_key_1560233000.33_7c67e077-2f95-40a4-ad2d-8e878f63eded failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-f22fdef4-c8c5-4642-92b5-48545ec3ae2d/21/temp_shuffle_2c77bc97-7857-46e1-8f07-049aa24aad96 (No such file or directory)
======================================================================
ERROR: test_large_elements (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 592, in test_large_elements
assert_that(gbk_res, equal_to(['a', 'b']), label='gbk')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_large_elements_1560233001.86_b3690d1b-fd77-4966-abed-837e49b24287 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-f22fdef4-c8c5-4642-92b5-48545ec3ae2d/19/temp_shuffle_ea25d79d-14c9-4c3a-9535-fdd945f9644b (No such file or directory)
======================================================================
ERROR: test_multimap_side_input (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 253, in test_multimap_side_input
equal_to([('a', [1, 3]), ('b', [2])]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_multimap_side_input_1560233003.4_fabf177f-a74d-417e-a55a-ad74888d030a failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-f22fdef4-c8c5-4642-92b5-48545ec3ae2d/38/temp_shuffle_7b676263-35a8-4412-8440-6706a7a33a0e (No such file or directory)
======================================================================
ERROR: test_multimap_side_input_type_coercion (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 266, in test_multimap_side_input_type_coercion
equal_to([('a', [1, 3]), ('b', [2])]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_multimap_side_input_type_coercion_1560233004.77_6ca81c35-b67e-456d-a713-8a772126d70b failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-f22fdef4-c8c5-4642-92b5-48545ec3ae2d/0b/temp_shuffle_9d65f959-2b99-4c22-bb2d-106808b806e6 (No such file or directory)
======================================================================
ERROR: test_no_subtransform_composite (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 642, in test_no_subtransform_composite
assert_that((pcoll_a, pcoll_b) | First(), equal_to(['a']))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_no_subtransform_composite_1560233006.13_a2f07893-097d-4f54-8401-7da5bd9881d1 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-f22fdef4-c8c5-4642-92b5-48545ec3ae2d/1b/temp_shuffle_388ab5e1-4ee3-404c-9ba9-a755deed859b (No such file or directory)
======================================================================
ERROR: test_pardo (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 103, in test_pardo
assert_that(res, equal_to(['aax', 'bcbcx']))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_1560233009.07_e57159bc-ddef-4075-94be-18533b9a814d failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-f22fdef4-c8c5-4642-92b5-48545ec3ae2d/16/temp_shuffle_3cbfacc8-7f87-4f9d-93e9-c8082c9416ed (No such file or directory)
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 175, in test_pardo_side_and_main_outputs
assert_that(unnamed.odd, equal_to([1, 3]), label='unnamed.odd')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_and_main_outputs_1560233010.5_ae4a835e-0d28-4da3-b383-507462b965b5 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-f22fdef4-c8c5-4642-92b5-48545ec3ae2d/01/temp_shuffle_bd381a7c-4ef3-447a-aad2-3a2c8342d429 (No such file or directory)
======================================================================
ERROR: test_pardo_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 186, in test_pardo_side_inputs
('a', 'y'), ('b', 'y'), ('c', 'y')]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_inputs_1560233013.95_4106a393-4563-4859-85a1-8e43fc856ec8 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-f22fdef4-c8c5-4642-92b5-48545ec3ae2d/0b/shuffle_27_0_0.data.d400d21e-58f7-4578-9dcd-3e6796a9f64f (No such file or directory)
======================================================================
ERROR: test_pardo_side_outputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 157, in test_pardo_side_outputs
assert_that(xy.y, equal_to(['y', 'xy']), label='y')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_outputs_1560233017.53_36b0951a-c3d4-4278-b261-654e355a4dd9 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-f22fdef4-c8c5-4642-92b5-48545ec3ae2d/37/shuffle_29_0_0.data.291d573c-6993-4280-b42c-a8fbf79a6fcc (No such file or directory)
======================================================================
ERROR: test_pardo_unfusable_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 276, in test_pardo_unfusable_side_inputs
equal_to([('a', 'a'), ('a', 'b'), ('b', 'a'), ('b', 'b')]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_unfusable_side_inputs_1560233018.9_4e5480ce-346e-4103-b1b3-14cf9e1eda91 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-f22fdef4-c8c5-4642-92b5-48545ec3ae2d/21/temp_shuffle_00b010a0-4229-416d-8554-f4d79c527018 (No such file or directory)
======================================================================
ERROR: test_pardo_windowed_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 213, in test_pardo_windowed_side_inputs
label='windowed')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_windowed_side_inputs_1560233020.08_0a2d9f24-3890-4111-a741-eb10421b366f failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-f22fdef4-c8c5-4642-92b5-48545ec3ae2d/3d/temp_shuffle_c5d09a54-8a4e-401d-af5d-fb5a131d5d22 (No such file or directory)
======================================================================
ERROR: test_read (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 561, in test_read
equal_to(['a', 'b', 'c']))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_read_1560233023.34_961a277c-601a-4be3-bb85-51a278714e13 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-f22fdef4-c8c5-4642-92b5-48545ec3ae2d/03/temp_shuffle_bc43a2dc-8810-4583-afc4-b1c94144c556 (No such file or directory)
======================================================================
ERROR: test_reshuffle (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 531, in test_reshuffle
equal_to([1, 2, 3]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_reshuffle_1560233026.05_1b60edd0-6c8a-4cb2-80fb-7faf0246d996 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-f22fdef4-c8c5-4642-92b5-48545ec3ae2d/34/shuffle_37_0_0.data.fb208bbe-8b73-4ce4-85b5-90e33c87571b (No such file or directory)
======================================================================
ERROR: test_sdf_wrapper_overrides_read (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/mock-2.0.0-py2.7.egg/mock/mock.py",> line 1305, in patched
return func(*args, **keywargs)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 514, in test_sdf_wrapper_overrides_read
self._run_sdf_wrapper_pipeline(RangeSource(0, 4), ['1'])
File "apache_beam/runners/portability/fn_api_runner_test.py", line 503, in _run_sdf_wrapper_pipeline
p | beam.io.Read(source)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_sdf_wrapper_overrides_read_1560233029.8_d05ec806-a700-44e6-a22f-4a7eb595b98f failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-f22fdef4-c8c5-4642-92b5-48545ec3ae2d/36/shuffle_39_0_0.data.566ff1de-9241-415a-91a4-3ccd7d167f7c (No such file or directory)
======================================================================
ERROR: test_windowing (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 573, in test_windowing
assert_that(res, equal_to([('k', [1, 2]), ('k', [100, 101, 102])]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_windowing_1560233030.84_58f56b35-9c01-4392-87d5-7e4be09fd01f failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-f22fdef4-c8c5-4642-92b5-48545ec3ae2d/36/shuffle_42_0_0.index.08f15beb-316e-4432-b134-c2e9617658bc (No such file or directory)
----------------------------------------------------------------------
Ran 37 tests in 73.763s
FAILED (errors=17, skipped=13)
> Task :sdks:python:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/build.gradle'> line: 284
* What went wrong:
Execution failed for task ':sdks:python:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 44s
60 actionable tasks: 47 executed, 13 from cache
Publishing build scan...
https://gradle.com/s/hra5wcxjmcgrc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Python_VR_Spark
#78
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/78/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org