You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/06/18 06:03:44 UTC
Build failed in Jenkins: beam_PostCommit_Python_VR_Spark #157
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/157/display/redirect?page=changes>
Changes:
[amaliujia] [BEAM-7461] disalbe flaky tests due to flaky
------------------------------------------
[...truncated 1.23 MB...]
at org.apache.spark.storage.DiskBlockObjectWriter.write(DiskBlockObjectWriter.scala:237)
at org.apache.spark.shuffle.sort.BypassMergeSortShuffleWriter.write(BypassMergeSortShuffleWriter.java:151)
at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:99)
at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:55)
at org.apache.spark.scheduler.Task.run(Task.scala:121)
at org.apache.spark.executor.Executor$TaskRunner$$anonfun$10.apply(Executor.scala:408)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1360)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:414)
... 3 more
19/06/18 06:03:42 INFO BeamFileSystemArtifactRetrievalService: Manifest at /tmp/sparktestundCfw/job_af92e32c-ab2f-48ac-808a-31d04e69018a/MANIFEST has 0 artifact locations
19/06/18 06:03:42 INFO BeamFileSystemArtifactStagingService: Removed dir /tmp/sparktestundCfw/job_af92e32c-ab2f-48ac-808a-31d04e69018a/
ERROR:root:java.io.FileNotFoundException: /tmp/blockmgr-56398859-05a8-4110-8d9b-19987a0082ba/1f/temp_shuffle_74892227-a130-47e4-8952-1e7ea2eebf5b (No such file or directory)
INFO:root:Job state changed to FAILED
E
======================================================================
ERROR: test_no_subtransform_composite (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 673, in test_no_subtransform_composite
assert_that((pcoll_a, pcoll_b) | First(), equal_to(['a']))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_no_subtransform_composite_1560837793.77_25617bb9-bb17-4bd6-a819-6740329f714f failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-56398859-05a8-4110-8d9b-19987a0082ba/39/temp_shuffle_226b9a81-0f3b-4ab6-aa1b-1292cfb21037 (No such file or directory)
======================================================================
ERROR: test_pardo (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 104, in test_pardo
assert_that(res, equal_to(['aax', 'bcbcx']))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_1560837796.84_ca9beb7a-cc19-4e23-99fa-0dfedeebb7a9 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-56398859-05a8-4110-8d9b-19987a0082ba/37/shuffle_29_0_0.data.a9055e31-1df9-4e40-b074-f29d4941888f (No such file or directory)
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 176, in test_pardo_side_and_main_outputs
assert_that(unnamed.odd, equal_to([1, 3]), label='unnamed.odd')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_and_main_outputs_1560837798.33_a81cd6a0-989f-4d59-9814-e566681a16b0 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-56398859-05a8-4110-8d9b-19987a0082ba/23/temp_shuffle_bd12c420-ae06-44fa-9c4d-2375fe833edb (No such file or directory)
======================================================================
ERROR: test_pardo_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 187, in test_pardo_side_inputs
('a', 'y'), ('b', 'y'), ('c', 'y')]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_inputs_1560837801.52_cae7115e-059c-4f2e-bdba-30a9a54bfe87 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-56398859-05a8-4110-8d9b-19987a0082ba/06/temp_shuffle_a831c47b-5b5f-4fa2-b5f4-b74a361ffe94 (No such file or directory)
======================================================================
ERROR: test_pardo_side_outputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 158, in test_pardo_side_outputs
assert_that(xy.y, equal_to(['y', 'xy']), label='y')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_outputs_1560837803.33_902fea6a-6e41-4f3e-bec8-5118b04519cd failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-56398859-05a8-4110-8d9b-19987a0082ba/17/temp_shuffle_a8e37065-8a8c-47eb-8a86-b93398096b81 (No such file or directory)
======================================================================
ERROR: test_pardo_state_only (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 308, in test_pardo_state_only
equal_to(expected))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_state_only_1560837805.82_cf714f02-9204-48d2-83b0-bfce110bc3e9 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-56398859-05a8-4110-8d9b-19987a0082ba/3e/temp_shuffle_47bdec56-bd4e-426e-af42-f979315e68a2 (No such file or directory)
======================================================================
ERROR: test_pardo_state_timers (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 401, in test_pardo_state_timers
self._run_pardo_state_timers(False)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 461, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_state_timers_1560837809.43_0d6dd499-8786-4eaf-820a-55148acddb94 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-56398859-05a8-4110-8d9b-19987a0082ba/13/shuffle_41_0_0.data.2c9760dc-d5f0-4e36-a96b-c3ae7c9980ac (No such file or directory)
======================================================================
ERROR: test_pardo_timers (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 361, in test_pardo_timers
assert_that(actual, equal_to(expected))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_timers_1560837811.12_e31cdc24-7ced-4314-a229-8b755610dde6 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-56398859-05a8-4110-8d9b-19987a0082ba/16/temp_shuffle_d016ac78-e124-4508-baa4-567cf23b9d8a (No such file or directory)
======================================================================
ERROR: test_pardo_unfusable_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 277, in test_pardo_unfusable_side_inputs
equal_to([('a', 'a'), ('a', 'b'), ('b', 'a'), ('b', 'b')]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_unfusable_side_inputs_1560837812.41_f1f30484-ded1-426c-b8b1-14431bab8585 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-56398859-05a8-4110-8d9b-19987a0082ba/07/temp_shuffle_29c3246b-00cd-45c3-822f-0ce2a9a8773e (No such file or directory)
======================================================================
ERROR: test_pardo_windowed_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 214, in test_pardo_windowed_side_inputs
label='windowed')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_windowed_side_inputs_1560837813.66_2730f04b-ebdc-4c06-8eac-ef5e18f3efbd failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-56398859-05a8-4110-8d9b-19987a0082ba/02/temp_shuffle_cbfb8581-7d56-4b4e-ab28-b5ef38980082 (No such file or directory)
======================================================================
ERROR: test_read (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 592, in test_read
equal_to(['a', 'b', 'c']))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_read_1560837815.12_04c8d4bc-55e0-4cdd-a6d4-56ff9c016a10 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-56398859-05a8-4110-8d9b-19987a0082ba/07/temp_shuffle_ed6fc47b-e9c9-44c2-a813-a497ddbb7238 (No such file or directory)
======================================================================
ERROR: test_reshuffle (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 562, in test_reshuffle
equal_to([1, 2, 3]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_reshuffle_1560837816.4_30ef8492-7b45-440b-a161-7c4d8ad92fd0 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-56398859-05a8-4110-8d9b-19987a0082ba/26/temp_shuffle_e01087d1-0253-4185-9e67-48874b13c55b (No such file or directory)
======================================================================
ERROR: test_sdf_wrap_range_source (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 548, in test_sdf_wrap_range_source
self._run_sdf_wrapper_pipeline(RangeSource(0, 4), [0, 1, 2, 3])
File "apache_beam/runners/portability/fn_api_runner_test.py", line 534, in _run_sdf_wrapper_pipeline
p | beam.io.Read(source)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_sdf_wrap_range_source_1560837817.75_0ae43bc3-b949-4bcc-9c91-ec5c5b0a58c5 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-56398859-05a8-4110-8d9b-19987a0082ba/39/temp_shuffle_484e1a3f-3fc4-4ede-bb56-444c75ff37ff (No such file or directory)
======================================================================
ERROR: test_sdf_wrapper_overrides_read (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/mock-2.0.0-py2.7.egg/mock/mock.py",> line 1305, in patched
return func(*args, **keywargs)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 545, in test_sdf_wrapper_overrides_read
self._run_sdf_wrapper_pipeline(RangeSource(0, 4), ['1'])
File "apache_beam/runners/portability/fn_api_runner_test.py", line 534, in _run_sdf_wrapper_pipeline
p | beam.io.Read(source)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_sdf_wrapper_overrides_read_1560837818.83_dc993711-3d3e-409f-9260-5d4620fae7ab failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-56398859-05a8-4110-8d9b-19987a0082ba/18/temp_shuffle_60dcdcbb-c232-4761-9c46-79f4b195f33f (No such file or directory)
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 404, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 461, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_windowed_pardo_state_timers_1560837819.91_199bfe62-8333-4e83-aa0f-fc2f7b368c1a failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-56398859-05a8-4110-8d9b-19987a0082ba/3a/temp_shuffle_43ed2b0f-89b5-45a1-b148-e25aeeddf1cf (No such file or directory)
======================================================================
ERROR: test_windowing (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 604, in test_windowing
assert_that(res, equal_to([('k', [1, 2]), ('k', [100, 101, 102])]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_windowing_1560837821.21_3dcd3ef6-26b8-4a37-85da-984f5d6ca1a5 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-56398859-05a8-4110-8d9b-19987a0082ba/1f/temp_shuffle_74892227-a130-47e4-8952-1e7ea2eebf5b (No such file or directory)
----------------------------------------------------------------------
Ran 38 tests in 105.354s
FAILED (errors=16, skipped=10)
> Task :sdks:python:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/build.gradle'> line: 251
* What went wrong:
Execution failed for task ':sdks:python:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 13s
60 actionable tasks: 47 executed, 13 from cache
Publishing build scan...
https://gradle.com/s/vdnl2x2vvkhuu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Python_VR_Spark
#158
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/158/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org