You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/06/07 06:03:57 UTC

Build failed in Jenkins: beam_PostCommit_Python_VR_Spark #35

See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/35/display/redirect>

------------------------------------------
[...truncated 989.84 KB...]
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 543, in test_flatten
    assert_that(res, equal_to(['a', 'b', 'c'] + additional))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_flatten_1559887398.45_e897b299-cd5a-4f97-a217-d5664cc7c88c failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-578f2860-59c2-4a63-bb1c-40db1ae02cc8/3d/temp_shuffle_a7bfa8a4-50ce-4c11-8d6a-a6fd3d693779 (No such file or directory)

======================================================================
ERROR: test_flattened_side_input (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/runners/portability/spark_runner_test.py",> line 144, in test_flattened_side_input
    with_transcoding=False)
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 234, in test_flattened_side_input
    label='CheckFlattenOfSideInput')
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_flattened_side_input_1559887400.03_9721eed0-db3c-4590-9bf4-202b65bccd20 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-578f2860-59c2-4a63-bb1c-40db1ae02cc8/10/shuffle_10_1_0.data.6246c42d-6243-4752-b07a-934050eea321 (No such file or directory)

======================================================================
ERROR: test_gbk_side_input (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 242, in test_gbk_side_input
    equal_to([(None, {'a': [1]})]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_gbk_side_input_1559887403.57_d8a0d78b-ac1f-49c6-8f4f-035693aac1f9 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-578f2860-59c2-4a63-bb1c-40db1ae02cc8/1d/temp_shuffle_76fd6920-0006-452b-b779-ea4dc5aa9698 (No such file or directory)

======================================================================
ERROR: test_group_by_key (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 525, in test_group_by_key
    assert_that(res, equal_to([('a', [1, 2]), ('b', [3])]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_group_by_key_1559887405.39_1d7dd9e0-c82e-434d-8826-b4dd43a434ce failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-578f2860-59c2-4a63-bb1c-40db1ae02cc8/13/shuffle_14_0_0.data.c5d31492-5ab6-40b5-a7d2-b5a459b92b3d (No such file or directory)

======================================================================
ERROR: test_large_elements (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 592, in test_large_elements
    assert_that(gbk_res, equal_to(['a', 'b']), label='gbk')
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_large_elements_1559887406.75_7e0e0abe-2493-4621-b16e-c11c99c4394c failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-578f2860-59c2-4a63-bb1c-40db1ae02cc8/10/shuffle_15_0_0.index.a0b488b3-8ab9-406a-8c9c-4a85419c9021 (No such file or directory)

======================================================================
ERROR: test_multimap_side_input (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 253, in test_multimap_side_input
    equal_to([('a', [1, 3]), ('b', [2])]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_multimap_side_input_1559887408.34_009f0981-2c91-41c8-bc44-dfa6974898a5 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-578f2860-59c2-4a63-bb1c-40db1ae02cc8/07/temp_shuffle_c934f63a-ce52-4b4a-9afc-469715f38430 (No such file or directory)

======================================================================
ERROR: test_multimap_side_input_type_coercion (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 266, in test_multimap_side_input_type_coercion
    equal_to([('a', [1, 3]), ('b', [2])]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_multimap_side_input_type_coercion_1559887409.83_3e7b2207-6cc8-4cc1-b9c0-39ea98871f97 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-578f2860-59c2-4a63-bb1c-40db1ae02cc8/0e/shuffle_17_0_0.index.560a493f-78dc-4427-8b66-6ee2016872c8 (No such file or directory)

======================================================================
ERROR: test_no_subtransform_composite (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 642, in test_no_subtransform_composite
    assert_that((pcoll_a, pcoll_b) | First(), equal_to(['a']))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_no_subtransform_composite_1559887411.62_da2a8b64-f992-4411-a5e2-5b91afa1b6a8 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-578f2860-59c2-4a63-bb1c-40db1ae02cc8/24/temp_shuffle_3966cd5a-cc03-40c3-8c0b-44f8433a3e14 (No such file or directory)

======================================================================
ERROR: test_pardo (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 103, in test_pardo
    assert_that(res, equal_to(['aax', 'bcbcx']))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_1559887413.94_82d37b3f-f0b0-43df-b181-4058420f829a failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-578f2860-59c2-4a63-bb1c-40db1ae02cc8/36/shuffle_20_0_0.index.3c61e4fa-b8b8-4a5f-8c24-76a618c9a594 (No such file or directory)

======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 175, in test_pardo_side_and_main_outputs
    assert_that(unnamed.odd, equal_to([1, 3]), label='unnamed.odd')
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_and_main_outputs_1559887416.01_9773b366-4260-4060-952c-a415aa51f356 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-578f2860-59c2-4a63-bb1c-40db1ae02cc8/07/temp_shuffle_392c8c3b-769a-4f11-9520-66f21fb9dc2a (No such file or directory)

======================================================================
ERROR: test_pardo_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 186, in test_pardo_side_inputs
    ('a', 'y'), ('b', 'y'), ('c', 'y')]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_inputs_1559887418.22_b9a0f2b2-17d4-45d9-952a-d96656e4fab1 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-578f2860-59c2-4a63-bb1c-40db1ae02cc8/1c/temp_shuffle_153d5fad-537b-4e92-98dc-f22c505f2011 (No such file or directory)

======================================================================
ERROR: test_pardo_side_outputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 157, in test_pardo_side_outputs
    assert_that(xy.y, equal_to(['y', 'xy']), label='y')
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_outputs_1559887419.66_801bf43c-d68b-4474-8a9f-2a34f4bfbb17 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-578f2860-59c2-4a63-bb1c-40db1ae02cc8/10/shuffle_26_0_0.index.9ccc7b1b-4fd8-4f57-8007-8946c12c2024 (No such file or directory)

======================================================================
ERROR: test_pardo_unfusable_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 276, in test_pardo_unfusable_side_inputs
    equal_to([('a', 'a'), ('a', 'b'), ('b', 'a'), ('b', 'b')]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_unfusable_side_inputs_1559887421.14_88e26613-36d2-47c7-83d1-9525cb9723b0 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-578f2860-59c2-4a63-bb1c-40db1ae02cc8/0b/shuffle_27_0_0.data.3868fcc2-9001-4e93-9b17-0fcac4143a65 (No such file or directory)

======================================================================
ERROR: test_pardo_windowed_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 213, in test_pardo_windowed_side_inputs
    label='windowed')
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_windowed_side_inputs_1559887422.68_15ec7fb1-3d53-4fd1-b597-fdd106434633 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-578f2860-59c2-4a63-bb1c-40db1ae02cc8/18/temp_shuffle_a4ace3cf-b236-4f5f-9302-5c0f69eba82d (No such file or directory)

======================================================================
ERROR: test_read (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 561, in test_read
    equal_to(['a', 'b', 'c']))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_read_1559887424.09_ab3b7947-0cce-4121-bc71-d73025dbf925 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-578f2860-59c2-4a63-bb1c-40db1ae02cc8/1f/temp_shuffle_bfa6ff82-bd1b-4624-adbc-bbed4c93639b (No such file or directory)

======================================================================
ERROR: test_reshuffle (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 531, in test_reshuffle
    equal_to([1, 2, 3]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_reshuffle_1559887427.34_0ffce6f8-61dc-4215-a74b-40c921394764 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-578f2860-59c2-4a63-bb1c-40db1ae02cc8/36/temp_shuffle_f9dfb920-1646-4375-8663-dab2340015df (No such file or directory)

======================================================================
ERROR: test_sdf_wrap_range_source (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 517, in test_sdf_wrap_range_source
    self._run_sdf_wrapper_pipeline(RangeSource(0, 4), [0, 1, 2, 3])
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 503, in _run_sdf_wrapper_pipeline
    p | beam.io.Read(source)
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_sdf_wrap_range_source_1559887429.68_54e12751-4e95-4657-b2b6-6f756a53256c failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-578f2860-59c2-4a63-bb1c-40db1ae02cc8/11/shuffle_34_0_0.data.a5cf54fd-492a-474f-8f42-3ee6debcb3fa (No such file or directory)

======================================================================
ERROR: test_windowing (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 573, in test_windowing
    assert_that(res, equal_to([('k', [1, 2]), ('k', [100, 101, 102])]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_windowing_1559887433.1_b8e91307-9b82-4949-a34d-415de171078d failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-578f2860-59c2-4a63-bb1c-40db1ae02cc8/11/temp_shuffle_8fd14234-77d7-4271-a625-99637c3792f7 (No such file or directory)

----------------------------------------------------------------------
Ran 37 tests in 64.287s

FAILED (errors=18, skipped=13)

> Task :sdks:python:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/build.gradle'> line: 284

* What went wrong:
Execution failed for task ':sdks:python:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 3m 44s
60 actionable tasks: 47 executed, 13 from cache

Publishing build scan...
https://gradle.com/s/tyoj4vc2j4pgw

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_Python_VR_Spark #36

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/36/display/redirect?page=changes>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org