You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/06/13 06:04:13 UTC

Build failed in Jenkins: beam_PostCommit_Python_VR_Spark #100

See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/100/display/redirect>

------------------------------------------
[...truncated 1.05 MB...]
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_flattened_side_input_1560405801.77_5d0bd202-dd58-4177-af1f-2e954f2f2b74 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-c07d4c2b-e5b7-4e6e-8712-02c6c11737c2/1f/temp_shuffle_6d6ef03c-ddc3-4602-b4b2-d04af6dc5101 (No such file or directory)

======================================================================
ERROR: test_gbk_side_input (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 242, in test_gbk_side_input
    equal_to([(None, {'a': [1]})]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_gbk_side_input_1560405807.91_8c27e56f-d653-48bb-a012-1e4c39a4976d failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-c07d4c2b-e5b7-4e6e-8712-02c6c11737c2/36/temp_shuffle_f7dd0b6f-8ba4-4234-a6fb-5942b26720a1 (No such file or directory)

======================================================================
ERROR: test_group_by_key (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 525, in test_group_by_key
    assert_that(res, equal_to([('a', [1, 2]), ('b', [3])]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_group_by_key_1560405809.79_f4aff895-01e4-45c2-90e2-2da3e5f5d10f failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-c07d4c2b-e5b7-4e6e-8712-02c6c11737c2/13/shuffle_14_0_0.data.be2198ca-3c7b-4d59-b85a-3088ccece255 (No such file or directory)

======================================================================
ERROR: test_large_elements (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 592, in test_large_elements
    assert_that(gbk_res, equal_to(['a', 'b']), label='gbk')
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_large_elements_1560405811.17_e35b0628-a905-4183-98db-87d00272b641 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-c07d4c2b-e5b7-4e6e-8712-02c6c11737c2/0e/temp_shuffle_c09756ab-ccaf-40de-b2e5-880e4111428d (No such file or directory)

======================================================================
ERROR: test_multimap_side_input (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 253, in test_multimap_side_input
    equal_to([('a', [1, 3]), ('b', [2])]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_multimap_side_input_1560405812.68_a52d2938-1440-4e78-b01a-05f007bf9b0c failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-c07d4c2b-e5b7-4e6e-8712-02c6c11737c2/0e/shuffle_17_0_0.index.f7f204da-09b1-4b69-bbf0-dc8b7920b032 (No such file or directory)

======================================================================
ERROR: test_multimap_side_input_type_coercion (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 266, in test_multimap_side_input_type_coercion
    equal_to([('a', [1, 3]), ('b', [2])]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_multimap_side_input_type_coercion_1560405819.04_261cf973-cff5-4be3-8625-17ff29e2c8cc failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-c07d4c2b-e5b7-4e6e-8712-02c6c11737c2/08/shuffle_19_0_0.data.19e18aef-21b4-4fa9-b0b9-4844c2a314f6 (No such file or directory)

======================================================================
ERROR: test_no_subtransform_composite (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 642, in test_no_subtransform_composite
    assert_that((pcoll_a, pcoll_b) | First(), equal_to(['a']))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_no_subtransform_composite_1560405820.54_10bdb766-9db2-4def-81d3-741b5d468280 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-c07d4c2b-e5b7-4e6e-8712-02c6c11737c2/0b/temp_shuffle_e06762b0-e3f4-48a7-b5a7-7fddbc3372ae (No such file or directory)

======================================================================
ERROR: test_pardo (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 103, in test_pardo
    assert_that(res, equal_to(['aax', 'bcbcx']))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_1560405822.67_a9c8dd5d-c363-4bdc-9dcf-7ae4544f3e1a failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-c07d4c2b-e5b7-4e6e-8712-02c6c11737c2/34/shuffle_22_0_0.index.c12c333f-7acf-4e64-8800-44fde938ba84 (No such file or directory)

======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 175, in test_pardo_side_and_main_outputs
    assert_that(unnamed.odd, equal_to([1, 3]), label='unnamed.odd')
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_and_main_outputs_1560405824.65_e0f916a1-857a-4a19-a0fd-902362934199 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-c07d4c2b-e5b7-4e6e-8712-02c6c11737c2/01/temp_shuffle_d1a3bb4a-4e1b-4bc5-a152-82f83d4598b6 (No such file or directory)

======================================================================
ERROR: test_pardo_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 186, in test_pardo_side_inputs
    ('a', 'y'), ('b', 'y'), ('c', 'y')]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_side_inputs_1560405827.47_051ee808-8a65-4ec3-a0e2-468dda9e44d2 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-c07d4c2b-e5b7-4e6e-8712-02c6c11737c2/12/shuffle_28_0_0.index.840aae2d-26e1-4bc3-96cb-6e0c7441a027 (No such file or directory)

======================================================================
ERROR: test_pardo_state_only (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 307, in test_pardo_state_only
    equal_to(expected))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_state_only_1560405838.69_46dc4a76-c76c-49aa-b1f9-cf527e74b04e failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-c07d4c2b-e5b7-4e6e-8712-02c6c11737c2/11/shuffle_34_0_0.data.91a5d88a-9db1-40bf-aa84-17fbc1a8521a (No such file or directory)

======================================================================
ERROR: test_pardo_unfusable_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 276, in test_pardo_unfusable_side_inputs
    equal_to([('a', 'a'), ('a', 'b'), ('b', 'a'), ('b', 'b')]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_unfusable_side_inputs_1560405840.26_0646adb5-e4d4-43c7-bd0e-67ea6c59ac5b failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-c07d4c2b-e5b7-4e6e-8712-02c6c11737c2/12/shuffle_35_0_0.index.520808bb-51f4-4ae9-ae82-41a6f45a3bf3 (No such file or directory)

======================================================================
ERROR: test_pardo_windowed_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 213, in test_pardo_windowed_side_inputs
    label='windowed')
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_pardo_windowed_side_inputs_1560405841.62_e0bd1741-3063-4023-b458-b711dedcd5f9 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-c07d4c2b-e5b7-4e6e-8712-02c6c11737c2/13/shuffle_36_0_0.data.1efcf6a4-030d-4672-a91c-25494af1a9b4 (No such file or directory)

======================================================================
ERROR: test_read (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 561, in test_read
    equal_to(['a', 'b', 'c']))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_read_1560405843.09_25a4356a-b7cc-4ac1-8b52-e49f7ce662e8 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-c07d4c2b-e5b7-4e6e-8712-02c6c11737c2/06/temp_shuffle_8ec77dfa-b37d-48d6-b8a5-7b85e3f6d29c (No such file or directory)

======================================================================
ERROR: test_reshuffle (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 531, in test_reshuffle
    equal_to([1, 2, 3]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_reshuffle_1560405845.32_90c26862-325a-47e8-b172-ff0b0aeda6ac failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-c07d4c2b-e5b7-4e6e-8712-02c6c11737c2/13/shuffle_41_0_0.data.63b584a0-e415-4fe1-a45b-223eb9f4751f (No such file or directory)

======================================================================
ERROR: test_sdf_wrap_range_source (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 517, in test_sdf_wrap_range_source
    self._run_sdf_wrapper_pipeline(RangeSource(0, 4), [0, 1, 2, 3])
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 503, in _run_sdf_wrapper_pipeline
    p | beam.io.Read(source)
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_sdf_wrap_range_source_1560405847.08_8692b73a-9ee3-4ee8-badc-a30dcebd8ca4 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-c07d4c2b-e5b7-4e6e-8712-02c6c11737c2/36/shuffle_42_0_0.index.60cf2f92-636c-444b-b925-107fc84269d8 (No such file or directory)

======================================================================
ERROR: test_sdf_wrapper_overrides_read (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/mock-2.0.0-py2.7.egg/mock/mock.py",> line 1305, in patched
    return func(*args, **keywargs)
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 514, in test_sdf_wrapper_overrides_read
    self._run_sdf_wrapper_pipeline(RangeSource(0, 4), ['1'])
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 503, in _run_sdf_wrapper_pipeline
    p | beam.io.Read(source)
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_sdf_wrapper_overrides_read_1560405848.16_f7037013-926e-4c2a-b8a8-9335c7afdfdc failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-c07d4c2b-e5b7-4e6e-8712-02c6c11737c2/11/shuffle_43_0_0.data.1c0bcfad-c62d-4e43-b334-fdd8cbe848ab (No such file or directory)

======================================================================
ERROR: test_windowing (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "apache_beam/runners/portability/fn_api_runner_test.py", line 573, in test_windowing
    assert_that(res, equal_to([('k', [1, 2]), ('k', [100, 101, 102])]))
  File "apache_beam/pipeline.py", line 426, in __exit__
    self.run().wait_until_finish()
  File "apache_beam/runners/portability/portable_runner.py", line 454, in wait_until_finish
    self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_windowing_1560405849.24_cb8ff308-9666-47ab-b6af-00f2e9c7f814 failed in state FAILED: java.io.FileNotFoundException: /tmp/blockmgr-c07d4c2b-e5b7-4e6e-8712-02c6c11737c2/06/temp_shuffle_d809a398-916f-4592-ad3f-e10b1229ecfa (No such file or directory)

----------------------------------------------------------------------
Ran 37 tests in 74.043s

FAILED (errors=20, skipped=12)

> Task :sdks:python:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/build.gradle'> line: 251

* What went wrong:
Execution failed for task ':sdks:python:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 3m 51s
60 actionable tasks: 47 executed, 13 from cache

Publishing build scan...
https://gradle.com/s/mevn2g6q5np7e

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_Python_VR_Spark #101

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/101/display/redirect?page=changes>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org