You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/06/08 00:03:57 UTC
Build failed in Jenkins: beam_PostCommit_Python_VR_Spark #54
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/54/display/redirect>
------------------------------------------
[...truncated 1.01 MB...]
... 3 more
19/06/08 00:03:54 INFO BeamFileSystemArtifactRetrievalService: Manifest at /tmp/sparktestkp7rKw/job_fe54c197-5b38-4f6d-9e21-a2098a6e5d19/MANIFEST has 0 artifact locations
19/06/08 00:03:54 INFO BeamFileSystemArtifactStagingService: Removed dir /tmp/sparktestkp7rKw/job_fe54c197-5b38-4f6d-9e21-a2098a6e5d19/
ERROR:root:java.io.FileNotFoundException: /tmp/blockmgr-95c27114-d016-4c6b-be11-d5ca2d0cf38b/13/shuffle_41_0_0.data.4ac6b650-996b-4d22-b076-bca73d4d88ff (No such file or directory)
INFO:root:Job state changed to FAILED
E
======================================================================
ERROR: test_flattened_side_input (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/runners/portability/spark_runner_test.py",> line 144, in test_flattened_side_input
with_transcoding=False)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 234, in test_flattened_side_input
label='CheckFlattenOfSideInput')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_flattened_side_input_1559952196.42_72858e7d-387a-4b4b-bde8-745bfe71116b failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-95c27114-d016-4c6b-be11-d5ca2d0cf38b/2c/shuffle_10_1_0.index.8efd72a4-8f45-4073-9dcd-55018e96cffa (No such file or directory)
======================================================================
ERROR: test_gbk_side_input (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 242, in test_gbk_side_input
equal_to([(None, {'a': [1]})]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_gbk_side_input_1559952199.79_2a7d359c-c117-472b-992e-547a1acca4fd failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-95c27114-d016-4c6b-be11-d5ca2d0cf38b/2c/shuffle_11_0_0.index.7409808e-c027-4c3a-a2ce-7d96ee3a43a6 (No such file or directory)
======================================================================
ERROR: test_group_by_key (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 525, in test_group_by_key
assert_that(res, equal_to([('a', [1, 2]), ('b', [3])]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_group_by_key_1559952201.59_e7c7140b-e311-4c69-babb-652fc5ff264a failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-95c27114-d016-4c6b-be11-d5ca2d0cf38b/13/shuffle_14_0_0.data.ed8c7676-9fab-4f51-b9a7-dd40b47e583c (No such file or directory)
======================================================================
ERROR: test_large_elements (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 592, in test_large_elements
assert_that(gbk_res, equal_to(['a', 'b']), label='gbk')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_large_elements_1559952203.07_ab4fbf47-2e3c-4d86-bc7f-873e4e7f2cfd failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-95c27114-d016-4c6b-be11-d5ca2d0cf38b/3f/temp_shuffle_04ae6aec-f28e-42a9-93f0-0f6dc3015b37 (No such file or directory)
======================================================================
ERROR: test_multimap_side_input (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 253, in test_multimap_side_input
equal_to([('a', [1, 3]), ('b', [2])]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_multimap_side_input_1559952204.71_076c2bed-dc4a-433a-b5cc-4df7b00aa22d failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-95c27114-d016-4c6b-be11-d5ca2d0cf38b/03/temp_shuffle_d591bcf0-c2ca-4464-a2b9-561a1dab65d5 (No such file or directory)
======================================================================
ERROR: test_multimap_side_input_type_coercion (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 266, in test_multimap_side_input_type_coercion
equal_to([('a', [1, 3]), ('b', [2])]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_multimap_side_input_type_coercion_1559952206.16_23c22896-928c-4e4b-abb5-086a9498344d failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-95c27114-d016-4c6b-be11-d5ca2d0cf38b/0e/shuffle_17_0_0.index.0b3afa31-1583-45e5-8602-7ec82273125b (No such file or directory)
======================================================================
ERROR: test_no_subtransform_composite (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 642, in test_no_subtransform_composite
assert_that((pcoll_a, pcoll_b) | First(), equal_to(['a']))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_no_subtransform_composite_1559952207.54_70efdb7e-d466-44e2-8f06-b48cb2fc5e41 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-95c27114-d016-4c6b-be11-d5ca2d0cf38b/09/temp_shuffle_3fe8aa03-7217-4f7b-a282-9990da42d3da (No such file or directory)
======================================================================
ERROR: test_pardo (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 103, in test_pardo
assert_that(res, equal_to(['aax', 'bcbcx']))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_1559952210.59_83f609a2-1265-4e7f-bc87-d200c6e99099 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-95c27114-d016-4c6b-be11-d5ca2d0cf38b/36/shuffle_20_0_0.index.22b15396-2617-43e5-8502-3d07350186cd (No such file or directory)
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 175, in test_pardo_side_and_main_outputs
assert_that(unnamed.odd, equal_to([1, 3]), label='unnamed.odd')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_and_main_outputs_1559952212.1_254b0843-204d-4a17-b1d1-6e8e42a6da34 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-95c27114-d016-4c6b-be11-d5ca2d0cf38b/31/shuffle_22_1_0.data.ca4120d4-1ee0-4350-83fb-043f0e7fd7d0 (No such file or directory)
======================================================================
ERROR: test_pardo_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 186, in test_pardo_side_inputs
('a', 'y'), ('b', 'y'), ('c', 'y')]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_inputs_1559952216.59_00e88480-b1cf-4695-b8cc-a753c568a582 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-95c27114-d016-4c6b-be11-d5ca2d0cf38b/11/temp_shuffle_3a6c8da4-497a-4ff1-84cc-2da7beda336b (No such file or directory)
======================================================================
ERROR: test_pardo_side_outputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 157, in test_pardo_side_outputs
assert_that(xy.y, equal_to(['y', 'xy']), label='y')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_outputs_1559952219.98_64ce555f-67b3-4674-84b1-22918189d6f8 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-95c27114-d016-4c6b-be11-d5ca2d0cf38b/2a/shuffle_28_0_0.data.83ecaf83-0647-4e14-9575-4e6b3d2a0be0 (No such file or directory)
======================================================================
ERROR: test_pardo_unfusable_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 276, in test_pardo_unfusable_side_inputs
equal_to([('a', 'a'), ('a', 'b'), ('b', 'a'), ('b', 'b')]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_unfusable_side_inputs_1559952221.46_6acc004c-cf06-460e-95c2-c6e513864422 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-95c27114-d016-4c6b-be11-d5ca2d0cf38b/2a/shuffle_30_1_0.index.d01bf0ad-235c-4d12-8468-0825fef73f18 (No such file or directory)
======================================================================
ERROR: test_pardo_windowed_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 213, in test_pardo_windowed_side_inputs
label='windowed')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_windowed_side_inputs_1559952225.81_89b4ced1-a1b0-4226-895e-94bbebfbe55c failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-95c27114-d016-4c6b-be11-d5ca2d0cf38b/2a/shuffle_31_0_0.index.c64602cb-5778-41ec-bf7f-6d2bc6ce0836 (No such file or directory)
======================================================================
ERROR: test_read (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 561, in test_read
equal_to(['a', 'b', 'c']))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_read_1559952227.32_ca3434d8-1e97-44d7-ab79-3e7501e4b67d failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-95c27114-d016-4c6b-be11-d5ca2d0cf38b/2c/temp_shuffle_f6815568-8151-4bae-8016-37c4598b8272 (No such file or directory)
======================================================================
ERROR: test_reshuffle (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 531, in test_reshuffle
equal_to([1, 2, 3]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_reshuffle_1559952228.76_1f2eac87-7b24-4eb6-a802-6352894405ec failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-95c27114-d016-4c6b-be11-d5ca2d0cf38b/13/shuffle_36_0_0.data.a3128eaf-54cc-4895-9810-0c3a352e2a89 (No such file or directory)
======================================================================
ERROR: test_sdf_wrapper_overrides_read (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/mock-2.0.0-py2.7.egg/mock/mock.py",> line 1305, in patched
return func(*args, **keywargs)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 514, in test_sdf_wrapper_overrides_read
self._run_sdf_wrapper_pipeline(RangeSource(0, 4), ['1'])
File "apache_beam/runners/portability/fn_api_runner_test.py", line 503, in _run_sdf_wrapper_pipeline
p | beam.io.Read(source)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_sdf_wrapper_overrides_read_1559952232.35_d568489b-5441-43a5-a065-36620a33b777 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-95c27114-d016-4c6b-be11-d5ca2d0cf38b/25/temp_shuffle_42231702-cf88-43bc-80e0-6e5ad75ca152 (No such file or directory)
======================================================================
ERROR: test_windowing (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 573, in test_windowing
assert_that(res, equal_to([('k', [1, 2]), ('k', [100, 101, 102])]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_windowing_1559952233.5_53a39bea-0d23-40c2-b7d1-b8619efad1ba failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-95c27114-d016-4c6b-be11-d5ca2d0cf38b/13/shuffle_41_0_0.data.4ac6b650-996b-4d22-b076-bca73d4d88ff (No such file or directory)
----------------------------------------------------------------------
Ran 37 tests in 69.550s
FAILED (errors=17, skipped=13)
> Task :sdks:python:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/build.gradle'> line: 284
* What went wrong:
Execution failed for task ':sdks:python:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 43s
60 actionable tasks: 47 executed, 13 from cache
Publishing build scan...
https://gradle.com/s/g2wzk3qcg6bpu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Python_VR_Spark
#55
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/55/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org