You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/06/06 18:04:08 UTC

Build failed in Jenkins: beam_PostCommit_Python_VR_Spark #21

See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/21/display/redirect>

------------------------------------------
[...truncated 1.04 MB...]
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_flattened_side_input_1559844198.89_a18c072e-8ecf-4bf2-b7a5-c1e9bb264c43 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-47458655-eb16-4cb5-9d25-da5abbccad45/02/temp_shuffle_926d71fa-5498-45ac-81b9-c51113037fa7 (No such file or directory)

======================================================================
ERROR: test_gbk_side_input (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 242, in test_gbk_side_input
    equal_to([(None, {'a': [1]})]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_gbk_side_input_1559844202.44_94d5f1d4-2592-483e-b76d-62d19af685c6 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-47458655-eb16-4cb5-9d25-da5abbccad45/11/shuffle_12_0_0.data.bd5bb530-72f0-4aee-8d43-d590a88037d2 (No such file or directory)

======================================================================
ERROR: test_group_by_key (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 525, in test_group_by_key
    assert_that(res, equal_to([('a', [1, 2]), ('b', [3])]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_group_by_key_1559844206.32_07187e90-b8ea-40b4-9f0c-8ff27c426f3f failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-47458655-eb16-4cb5-9d25-da5abbccad45/13/shuffle_14_0_0.data.14d92909-820d-4a28-8a3f-22d444385f3e (No such file or directory)

======================================================================
ERROR: test_large_elements (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 592, in test_large_elements
    assert_that(gbk_res, equal_to(['a', 'b']), label='gbk')
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_large_elements_1559844209.38_e383aca5-2b94-4b12-89ab-9795d02c60c2 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-47458655-eb16-4cb5-9d25-da5abbccad45/0e/shuffle_17_0_0.index.baed61dd-6519-4a85-b22b-a568d80335de (No such file or directory)

======================================================================
ERROR: test_multimap_side_input (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 253, in test_multimap_side_input
    equal_to([('a', [1, 3]), ('b', [2])]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_multimap_side_input_1559844214.68_67ed8816-2e9b-4738-bc16-4284e789d50e failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-47458655-eb16-4cb5-9d25-da5abbccad45/33/shuffle_18_0_0.index.5d30d925-2292-47f5-98ef-d923575d0c5f (No such file or directory)

======================================================================
ERROR: test_multimap_side_input_type_coercion (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 266, in test_multimap_side_input_type_coercion
    equal_to([('a', [1, 3]), ('b', [2])]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_multimap_side_input_type_coercion_1559844216.49_e11f2ede-1513-4ad0-94d6-83d4de6aa25f failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-47458655-eb16-4cb5-9d25-da5abbccad45/0b/temp_shuffle_ca5b5940-f9ba-4909-8563-05fc05033f5e (No such file or directory)

======================================================================
ERROR: test_no_subtransform_composite (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 642, in test_no_subtransform_composite
    assert_that((pcoll_a, pcoll_b) | First(), equal_to(['a']))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_no_subtransform_composite_1559844218.13_11a531f2-cd81-44d1-9cc1-2bcffeddafff failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-47458655-eb16-4cb5-9d25-da5abbccad45/26/temp_shuffle_1daa90bd-e45f-4d29-a361-de2bfe5dd525 (No such file or directory)

======================================================================
ERROR: test_pardo (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 103, in test_pardo
    assert_that(res, equal_to(['aax', 'bcbcx']))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_1559844220.48_b3a064a9-9da0-4c1f-9c83-87f3a1ad95fb failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-47458655-eb16-4cb5-9d25-da5abbccad45/09/temp_shuffle_a5b146ba-8c44-45f0-aa0c-94b05cb6e46c (No such file or directory)

======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 175, in test_pardo_side_and_main_outputs
    assert_that(unnamed.odd, equal_to([1, 3]), label='unnamed.odd')
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_and_main_outputs_1559844223.52_65fb3be0-4393-41da-8fa2-bd2ae0b96eb8 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-47458655-eb16-4cb5-9d25-da5abbccad45/05/temp_shuffle_c9e2558e-5666-473b-a725-ada5015444f1 (No such file or directory)

======================================================================
ERROR: test_pardo_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 186, in test_pardo_side_inputs
    ('a', 'y'), ('b', 'y'), ('c', 'y')]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_inputs_1559844226.11_2633a278-3cce-4ab3-a7d8-a7e866ded79d failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-47458655-eb16-4cb5-9d25-da5abbccad45/13/temp_shuffle_29d2b8b4-6413-4eb4-a559-3083abd1d635 (No such file or directory)

======================================================================
ERROR: test_pardo_side_outputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 157, in test_pardo_side_outputs
    assert_that(xy.y, equal_to(['y', 'xy']), label='y')
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_outputs_1559844230.1_40dc4b53-3aec-455d-8a38-9ee31f441eef failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-47458655-eb16-4cb5-9d25-da5abbccad45/0e/temp_shuffle_bd1ca287-83cd-4731-a117-8ae882704bf7 (No such file or directory)

======================================================================
ERROR: test_pardo_unfusable_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 276, in test_pardo_unfusable_side_inputs
    equal_to([('a', 'a'), ('a', 'b'), ('b', 'a'), ('b', 'b')]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_unfusable_side_inputs_1559844233.57_e987ced6-9de3-4c1c-854d-6728a25cf6c0 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-47458655-eb16-4cb5-9d25-da5abbccad45/24/temp_shuffle_174c3731-2d9b-45f9-b194-2226aa510951 (No such file or directory)

======================================================================
ERROR: test_pardo_windowed_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 213, in test_pardo_windowed_side_inputs
    label='windowed')
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_windowed_side_inputs_1559844234.89_776969f7-fa1f-4039-8d13-52164e1499a2 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-47458655-eb16-4cb5-9d25-da5abbccad45/21/temp_shuffle_1a43df0e-6252-4f97-8db1-29e5b5014348 (No such file or directory)

======================================================================
ERROR: test_read (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 561, in test_read
    equal_to(['a', 'b', 'c']))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_read_1559844236.2_776035ec-b113-4bcb-a1e7-fa068ff5ba5c failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-47458655-eb16-4cb5-9d25-da5abbccad45/11/shuffle_34_0_0.data.717e69ac-aeb8-47b9-8d9d-00d306fe8341 (No such file or directory)

======================================================================
ERROR: test_reshuffle (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 531, in test_reshuffle
    equal_to([1, 2, 3]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_reshuffle_1559844237.56_deabc638-71bc-401f-a70b-2d7eadf14a63 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-47458655-eb16-4cb5-9d25-da5abbccad45/09/temp_shuffle_1d7a392d-8f98-4513-abfb-f1b0ba575894 (No such file or directory)

======================================================================
ERROR: test_sdf_wrap_range_source (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 517, in test_sdf_wrap_range_source
    self._run_sdf_wrapper_pipeline(RangeSource(0, 4), [0, 1, 2, 3])
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 503, in _run_sdf_wrapper_pipeline
    p | beam.io.Read(source)
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_sdf_wrap_range_source_1559844239.16_3f934fff-2a5a-4455-aac1-e1b928670f80 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-47458655-eb16-4cb5-9d25-da5abbccad45/3c/temp_shuffle_3bb5839b-b7ba-47ea-bbf6-778d03048700 (No such file or directory)

======================================================================
ERROR: test_sdf_wrapper_overrides_read (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/mock-2.0.0-py2.7.egg/mock/mock.py",> line 1305, in patched
    return func(*args, **keywargs)
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 514, in test_sdf_wrapper_overrides_read
    self._run_sdf_wrapper_pipeline(RangeSource(0, 4), ['1'])
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 503, in _run_sdf_wrapper_pipeline
    p | beam.io.Read(source)
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_sdf_wrapper_overrides_read_1559844241.12_70ef942e-0ed6-4c47-860f-2e0b0c82157c failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-47458655-eb16-4cb5-9d25-da5abbccad45/36/shuffle_39_0_0.data.9c0b2ee7-89c5-4377-8539-65fb2fdbd525 (No such file or directory)

======================================================================
ERROR: test_windowing (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 573, in test_windowing
    assert_that(res, equal_to([('k', [1, 2]), ('k', [100, 101, 102])]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 436, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_windowing_1559844243.11_eb828884-5abf-41a1-ae2c-f874b880ca0d failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-47458655-eb16-4cb5-9d25-da5abbccad45/36/shuffle_42_0_0.index.8ee06cff-9633-4e57-b5e5-d4e28d807013 (No such file or directory)

----------------------------------------------------------------------
Ran 37 tests in 76.941s

FAILED (errors=19, skipped=13)

> Task :sdks:python:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/build.gradle'> line: 284

* What went wrong:
Execution failed for task ':sdks:python:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 3m 57s
60 actionable tasks: 47 executed, 13 from cache

Publishing build scan...
https://gradle.com/s/tsmmgqtasqzoq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_Python_VR_Spark #22

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/22/display/redirect?page=changes>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org