You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/09/10 21:48:53 UTC
Build failed in Jenkins: beam_PostCommit_Python_VR_Spark #906
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/906/display/redirect?page=changes>
Changes:
[github] Update verify release branch in release-guide.md
------------------------------------------
[...truncated 935.35 KB...]
at org.apache.spark.storage.DiskBlockObjectWriter.initialize(DiskBlockObjectWriter.scala:103)
at org.apache.spark.storage.DiskBlockObjectWriter.open(DiskBlockObjectWriter.scala:116)
at org.apache.spark.storage.DiskBlockObjectWriter.write(DiskBlockObjectWriter.scala:237)
at org.apache.spark.shuffle.sort.BypassMergeSortShuffleWriter.write(BypassMergeSortShuffleWriter.java:151)
at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:99)
at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:55)
at org.apache.spark.scheduler.Task.run(Task.scala:123)
at org.apache.spark.executor.Executor$TaskRunner$$anonfun$10.apply(Executor.scala:408)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1360)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:414)
... 3 more
19/09/10 21:48:50 INFO BeamFileSystemArtifactRetrievalService: Manifest at /tmp/sparktestYlH9aA/job_95d17a98-70b9-4c40-a4c6-7c7c70086d56/MANIFEST has 0 artifact locations
19/09/10 21:48:50 INFO BeamFileSystemArtifactStagingService: Removed dir /tmp/sparktestYlH9aA/job_95d17a98-70b9-4c40-a4c6-7c7c70086d56/
ERROR:root:java.io.FileNotFoundException: /tmp/blockmgr-3719d09a-fb5a-4a9a-89d5-da20040e754a/37/temp_shuffle_d3d21fae-1e3e-4741-b3ce-cbc7591e31aa (No such file or directory)
INFO:root:Job state changed to FAILED
E
======================================================================
ERROR: test_multimap_side_input (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 255, in test_multimap_side_input
equal_to([('a', [1, 3]), ('b', [2])]))
File "apache_beam/pipeline.py", line 427, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 444, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_multimap_side_input_1568152087.06_25878d90-a709-4602-98a8-98561ead48de failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-3719d09a-fb5a-4a9a-89d5-da20040e754a/02/temp_shuffle_25ee5a2c-17b1-48e3-9e06-bd7a65712432 (No such file or directory)
======================================================================
ERROR: test_multimap_side_input_type_coercion (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 268, in test_multimap_side_input_type_coercion
equal_to([('a', [1, 3]), ('b', [2])]))
File "apache_beam/pipeline.py", line 427, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 444, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_multimap_side_input_type_coercion_1568152093.35_c335a2f1-894e-497d-b48e-1007cb8c2b03 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-3719d09a-fb5a-4a9a-89d5-da20040e754a/2e/shuffle_24_0_0.data.3634f467-a873-4ff6-b8c9-dd0ca9fb5ac7 (No such file or directory)
======================================================================
ERROR: test_no_subtransform_composite (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 676, in test_no_subtransform_composite
assert_that((pcoll_a, pcoll_b) | First(), equal_to(['a']))
File "apache_beam/pipeline.py", line 427, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 444, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_no_subtransform_composite_1568152095.34_1dd75292-2af6-46f5-aaad-e4e5a9484f35 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-3719d09a-fb5a-4a9a-89d5-da20040e754a/2e/temp_shuffle_5a92a932-71b4-40e4-8a37-aaffe011e074 (No such file or directory)
======================================================================
ERROR: test_pardo (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 105, in test_pardo
assert_that(res, equal_to(['aax', 'bcbcx']))
File "apache_beam/pipeline.py", line 427, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 444, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_1568152097.68_fb7e1f65-895a-4283-9960-bdd8daa753ae failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-3719d09a-fb5a-4a9a-89d5-da20040e754a/39/temp_shuffle_fd8d306c-c276-4439-afa8-586e7032f257 (No such file or directory)
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 177, in test_pardo_side_and_main_outputs
assert_that(unnamed.odd, equal_to([1, 3]), label='unnamed.odd')
File "apache_beam/pipeline.py", line 427, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 444, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_and_main_outputs_1568152099.86_341c9f5e-2835-4731-b3c7-83bdd95b3f3a failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-3719d09a-fb5a-4a9a-89d5-da20040e754a/2e/temp_shuffle_06e7d4d5-3495-4728-9a29-ff0b05749088 (No such file or directory)
======================================================================
ERROR: test_pardo_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 188, in test_pardo_side_inputs
('a', 'y'), ('b', 'y'), ('c', 'y')]))
File "apache_beam/pipeline.py", line 427, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 444, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_inputs_1568152103.86_c241192f-78e5-4495-97dc-2c99cbdcf176 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-3719d09a-fb5a-4a9a-89d5-da20040e754a/00/temp_shuffle_c6c451f0-4f3e-4c86-a9d4-f2e3fceb0b42 (No such file or directory)
======================================================================
ERROR: test_pardo_side_outputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 159, in test_pardo_side_outputs
assert_that(xy.y, equal_to(['y', 'xy']), label='y')
File "apache_beam/pipeline.py", line 427, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 444, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_outputs_1568152105.83_fd6ed332-e55b-4547-a6f1-d7336b41fdce failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-3719d09a-fb5a-4a9a-89d5-da20040e754a/15/shuffle_32_0_0.index.3410ab9e-634d-4acc-a53f-452c4692e440 (No such file or directory)
======================================================================
ERROR: test_pardo_state_only (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 309, in test_pardo_state_only
equal_to(expected))
File "apache_beam/pipeline.py", line 427, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 444, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_state_only_1568152107.96_6a3e1eaf-2694-484b-8288-8980acfe30ac failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-3719d09a-fb5a-4a9a-89d5-da20040e754a/13/temp_shuffle_9081d7ba-b8b1-40b2-a240-e9ddd541c59e (No such file or directory)
======================================================================
ERROR: test_pardo_state_timers (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 402, in test_pardo_state_timers
self._run_pardo_state_timers(False)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 462, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 427, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 444, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_state_timers_1568152109.68_e800b3a3-babb-4331-89bf-69f8b42ac14a failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-3719d09a-fb5a-4a9a-89d5-da20040e754a/10/shuffle_37_0_0.index.12724767-2666-4961-b71f-d79fb430b8e2 (No such file or directory)
======================================================================
ERROR: test_pardo_timers (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 362, in test_pardo_timers
assert_that(actual, equal_to(expected))
File "apache_beam/pipeline.py", line 427, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 444, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_timers_1568152111.48_7eac2c4c-af37-4c0b-8396-592810bc32c6 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-3719d09a-fb5a-4a9a-89d5-da20040e754a/26/temp_shuffle_ca85ce72-37b2-4e48-8963-c18a3a727f54 (No such file or directory)
======================================================================
ERROR: test_pardo_unfusable_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 278, in test_pardo_unfusable_side_inputs
equal_to([('a', 'a'), ('a', 'b'), ('b', 'a'), ('b', 'b')]))
File "apache_beam/pipeline.py", line 427, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 444, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_unfusable_side_inputs_1568152113.19_db49ecba-ed88-47d8-b5e3-8bcfccc20aa0 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-3719d09a-fb5a-4a9a-89d5-da20040e754a/00/temp_shuffle_b9f28d87-f14e-4af9-9e6e-7cc6381a59ee (No such file or directory)
======================================================================
ERROR: test_read (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 595, in test_read
equal_to(['a', 'b', 'c']))
File "apache_beam/pipeline.py", line 427, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 444, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_read_1568152120.08_806601da-31bb-4d3b-ba0b-96eb92b03704 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-3719d09a-fb5a-4a9a-89d5-da20040e754a/3a/temp_shuffle_79534d84-f6af-412d-a923-87e3e701f295 (No such file or directory)
======================================================================
ERROR: test_reshuffle (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 565, in test_reshuffle
equal_to([1, 2, 3]))
File "apache_beam/pipeline.py", line 427, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 444, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_reshuffle_1568152121.69_a6f3cca5-e113-41d7-b11b-8055a3707261 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-3719d09a-fb5a-4a9a-89d5-da20040e754a/2c/shuffle_48_0_0.data.6664615e-2d84-455d-a523-7f1f14e7a413 (No such file or directory)
======================================================================
ERROR: test_sdf_wrapper_overrides_read (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/mock/mock.py",> line 1305, in patched
return func(*args, **keywargs)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 548, in test_sdf_wrapper_overrides_read
self._run_sdf_wrapper_pipeline(RangeSource(0, 4), ['1'])
File "apache_beam/runners/portability/fn_api_runner_test.py", line 537, in _run_sdf_wrapper_pipeline
p | beam.io.Read(source)
File "apache_beam/pipeline.py", line 427, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 444, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_sdf_wrapper_overrides_read_1568152125.64_c0147341-26b3-47f3-b324-e90a204e4def failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-3719d09a-fb5a-4a9a-89d5-da20040e754a/17/shuffle_52_0_0.index.164e2b64-ba17-4fb7-b247-584f30a865fd (No such file or directory)
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 405, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 462, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 427, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 444, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_windowed_pardo_state_timers_1568152126.82_f0f57aba-e322-4462-b6de-05f8c28d19ec failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-3719d09a-fb5a-4a9a-89d5-da20040e754a/3e/temp_shuffle_5434a07e-3b0d-46b7-99da-0fd87f283085 (No such file or directory)
======================================================================
ERROR: test_windowing (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 607, in test_windowing
assert_that(res, equal_to([('k', [1, 2]), ('k', [100, 101, 102])]))
File "apache_beam/pipeline.py", line 427, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 444, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_windowing_1568152128.66_f4b6cd5c-4702-4fef-bd2b-cfdd93fc9db8 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-3719d09a-fb5a-4a9a-89d5-da20040e754a/37/temp_shuffle_d3d21fae-1e3e-4741-b3ce-cbc7591e31aa (No such file or directory)
----------------------------------------------------------------------
Ran 38 tests in 105.142s
FAILED (errors=16, skipped=10)
> Task :sdks:python:test-suites:portable:py2:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py2/build.gradle'> line: 186
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py2:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 11s
60 actionable tasks: 48 executed, 12 from cache
Publishing build scan...
https://gradle.com/s/vkkiu4oe2km7i
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Python_VR_Spark
#907
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/907/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org