You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/10/06 06:51:35 UTC

Build failed in Jenkins: beam_PostCommit_Python_VR_Flink #1488

See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/1488/display/redirect?page=changes>

Changes:

[noreply] Merge pull request #15602 from [BEAM-10917] Add support for BigQuery


------------------------------------------
[...truncated 236.40 KB...]
      "payload": "AA==",
      "labels": {
        "PTRANSFORM": "transform_2"
      }
    }, {
      "urn": "beam:metric:pardo_execution_time:start_bundle_msecs:v1",
      "type": "beam:metrics:sum_int64:v1",
      "payload": "AA==",
      "labels": {
        "PTRANSFORM": "transform_2"
      }
    }, {
      "urn": "beam:metric:pardo_execution_time:start_bundle_msecs:v1",
      "type": "beam:metrics:sum_int64:v1",
      "payload": "AA==",
      "labels": {
        "PTRANSFORM": "transform_0"
      }
    }, {
      "urn": "beam:metric:pardo_execution_time:start_bundle_msecs:v1",
      "type": "beam:metrics:sum_int64:v1",
      "payload": "AA==",
      "labels": {
        "PTRANSFORM": "transform_1"
      }
    }, {
      "urn": "beam:metric:ptransform_execution_time:total_msecs:v1",
      "type": "beam:metrics:sum_int64:v1",
      "payload": "AA==",
      "labels": {
        "PTRANSFORM": "fn/read/ref_PCollection_PCollection_5:0"
      }
    }, {
      "urn": "beam:metric:pardo_execution_time:finish_bundle_msecs:v1",
      "type": "beam:metrics:sum_int64:v1",
      "payload": "AA==",
      "labels": {
        "PTRANSFORM": "fn/read/ref_PCollection_PCollection_5:0"
      }
    }, {
      "urn": "beam:metric:pardo_execution_time:process_bundle_msecs:v1",
      "type": "beam:metrics:sum_int64:v1",
      "payload": "AA==",
      "labels": {
        "PTRANSFORM": "fn/read/ref_PCollection_PCollection_5:0"
      }
    }, {
      "urn": "beam:metric:pardo_execution_time:start_bundle_msecs:v1",
      "type": "beam:metrics:sum_int64:v1",
      "payload": "AA==",
      "labels": {
        "PTRANSFORM": "fn/read/ref_PCollection_PCollection_5:0"
      }
    }, {
      "urn": "beam:metric:ptransform_execution_time:total_msecs:v1",
      "type": "beam:metrics:sum_int64:v1",
      "payload": "AA==",
      "labels": {
        "PTRANSFORM": "transform_0"
      }
    }, {
      "urn": "beam:metric:ptransform_execution_time:total_msecs:v1",
      "type": "beam:metrics:sum_int64:v1",
      "payload": "AA==",
      "labels": {
        "PTRANSFORM": "transform_3"
      }
    }, {
      "urn": "beam:metric:ptransform_execution_time:total_msecs:v1",
      "type": "beam:metrics:sum_int64:v1",
      "payload": "AA==",
      "labels": {
        "PTRANSFORM": "fn/write/ref_PCollection_PCollection_9:0"
      }
    }, {
      "urn": "beam:metric:data_channel:read_index:v1",
      "type": "beam:metrics:sum_int64:v1",
      "payload": "bg==",
      "labels": {
        "PTRANSFORM": "fn/read/ref_PCollection_PCollection_5:0"
      }
    }, {
      "urn": "beam:metric:element_count:v1",
      "type": "beam:metrics:sum_int64:v1",
      "payload": "bg==",
      "labels": {
        "PCOLLECTION": "ref_PCollection_PCollection_5"
      }
    }, {
      "urn": "beam:metric:element_count:v1",
      "type": "beam:metrics:sum_int64:v1",
      "payload": "bg==",
      "labels": {
        "PCOLLECTION": "ref_PCollection_PCollection_7"
      }
    }, {
      "urn": "beam:metric:pardo_execution_time:process_bundle_msecs:v1",
      "type": "beam:metrics:sum_int64:v1",
      "payload": "AA==",
      "labels": {
        "PTRANSFORM": "transform_2"
      }
    }, {
      "urn": "beam:metric:pardo_execution_time:process_bundle_msecs:v1",
      "type": "beam:metrics:sum_int64:v1",
      "payload": "AA==",
      "labels": {
        "PTRANSFORM": "transform_1"
      }
    }, {
      "urn": "beam:metric:pardo_execution_time:process_bundle_msecs:v1",
      "type": "beam:metrics:sum_int64:v1",
      "payload": "AA==",
      "labels": {
        "PTRANSFORM": "transform_0"
      }
    }, {
      "urn": "beam:metric:pardo_execution_time:start_bundle_msecs:v1",
      "type": "beam:metrics:sum_int64:v1",
      "payload": "AA==",
      "labels": {
        "PTRANSFORM": "fn/write/ref_PCollection_PCollection_9:0"
      }
    }, {
      "urn": "beam:metric:sampled_byte_size:v1",
      "type": "beam:metrics:distribution_int64:v1",
      "payload": "JfQIHh8=",
      "labels": {
        "PCOLLECTION": "ref_PCollection_PCollection_5"
      }
    }, {
      "urn": "beam:metric:sampled_byte_size:v1",
      "type": "beam:metrics:distribution_int64:v1",
      "payload": "JpQEDg4=",
      "labels": {
        "PCOLLECTION": "ref_PCollection_PCollection_7"
      }
    }, {
      "urn": "beam:metric:sampled_byte_size:v1",
      "type": "beam:metrics:distribution_int64:v1",
      "payload": "H8YEEhM=",
      "labels": {
        "PCOLLECTION": "ref_PCollection_PCollection_6"
      }
    }, {
      "urn": "beam:metric:sampled_byte_size:v1",
      "type": "beam:metrics:distribution_int64:v1",
      "payload": "KKgFERE=",
      "labels": {
        "PCOLLECTION": "ref_PCollection_PCollection_9"
      }
    }, {
      "urn": "beam:metric:sampled_byte_size:v1",
      "type": "beam:metrics:distribution_int64:v1",
      "payload": "KLAEDg4=",
      "labels": {
        "PCOLLECTION": "ref_PCollection_PCollection_8"
      }
    }]
  }
}
Oct 06, 2021 6:43:54 AM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO: Stop job leader service.
Oct 06, 2021 6:43:54 AM org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown
INFO: Shutting down TaskExecutorLocalStateStoresManager.
Oct 06, 2021 6:43:54 AM org.apache.flink.runtime.webmonitor.WebMonitorEndpoint lambda$shutDownInternal$5
INFO: Removing cache directory /tmp/flink-web-ui
Oct 06, 2021 6:43:54 AM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO: FileChannelManager removed spill file directory /tmp/flink-io-dbb74a30-04fb-41dc-aedb-cbd708834c85
Oct 06, 2021 6:43:54 AM org.apache.flink.runtime.io.network.NettyShuffleEnvironment close
INFO: Shutting down the network environment and its components.
Oct 06, 2021 6:43:54 AM org.apache.flink.runtime.rest.RestServerEndpoint lambda$closeAsync$1
INFO: Shut down complete.
Oct 06, 2021 6:43:54 AM org.apache.flink.runtime.resourcemanager.ResourceManager deregisterApplication
INFO: Shut down cluster because application is in CANCELED, diagnostics DispatcherResourceManagerComponent has been closed..
Oct 06, 2021 6:43:54 AM org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent closeAsyncInternal
INFO: Closing components.
Oct 06, 2021 6:43:54 AM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO: FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-4eaaeb27-f73d-4a6a-ab95-4c4c94eb5db6
Oct 06, 2021 6:43:54 AM org.apache.flink.runtime.taskexecutor.KvStateService shutdown
INFO: Shutting down the kvState service and its components.
Oct 06, 2021 6:43:54 AM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO: Stop job leader service.
Oct 06, 2021 6:43:54 AM org.apache.flink.runtime.dispatcher.runner.AbstractDispatcherLeaderProcess closeInternal
INFO: Stopping SessionDispatcherLeaderProcess.
Oct 06, 2021 6:43:54 AM org.apache.flink.runtime.dispatcher.Dispatcher onStop
INFO: Stopping dispatcher akka://flink/user/rpc/dispatcher_38.
Oct 06, 2021 6:43:54 AM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager close
INFO: Closing the slot manager.
Oct 06, 2021 6:43:54 AM org.apache.flink.runtime.dispatcher.Dispatcher terminateRunningJobs
INFO: Stopping all currently running jobs of dispatcher akka://flink/user/rpc/dispatcher_38.
Oct 06, 2021 6:43:54 AM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager suspend
INFO: Suspending the slot manager.
Oct 06, 2021 6:43:54 AM org.apache.flink.runtime.filecache.FileCache shutdown
INFO: removed file cache directory /tmp/flink-dist-cache-1fe6a9a9-fd4a-41ce-b234-92fb4e95585a
Oct 06, 2021 6:43:54 AM org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool releaseSlots
INFO: Releasing slot [04ad27c5c70cbc453859eb2a4aa5b2fe].
Oct 06, 2021 6:43:54 AM org.apache.flink.runtime.jobmaster.JobMaster dissolveResourceManagerConnection
INFO: Close ResourceManager connection 5bb7030cd33a88159817cbcc33df7124: Stopping JobMaster for job test_flink_metrics_1633502619.9555683(14a18602524209af85f4e040aa78d808)..
Oct 06, 2021 6:43:54 AM org.apache.flink.runtime.dispatcher.Dispatcher lambda$onStop$0
INFO: Stopped dispatcher akka://flink/user/rpc/dispatcher_38.
------------------------------ Captured log call -------------------------------
WARNING  root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
WARNING  apache_beam.options.pipeline_options:pipeline_options.py:324 Discarding invalid overrides: {'max_bundle_time_millis': 95130590130}
--------------------------- Captured stderr teardown ---------------------------
Oct 06, 2021 6:43:54 AM org.apache.flink.runtime.taskexecutor.TaskExecutor handleOnStopException
INFO: Stopped TaskExecutor akka://flink/user/rpc/taskmanager_36.
Oct 06, 2021 6:43:54 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO: Stopping Akka RPC service.
Oct 06, 2021 6:43:54 AM org.apache.beam.runners.flink.metrics.FileReporter close
INFO: wrote metrics to <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/tmp/flinktest-conflo89aleq/test-metrics.txt>
=============================== warnings summary ===============================
target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py:42
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/pytest_flink-runner-test.xml> -
======== 1 failed, 127 passed, 37 skipped, 1 warnings in 897.42 seconds ========
ERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> flink-runner-test apache_beam/runners/portability/flink_runner_test.py '--flink_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/runners/flink/1.13/job-server/build/libs/beam-runners-flink-1.13-job-server-2.34.0-SNAPSHOT.jar> --environment_type=LOOPBACK' (exited with code 1)
flink-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
ERROR:   flink-runner-test: commands failed

> Task :sdks:python:test-suites:portable:py38:flinkCompatibilityMatrixLOOPBACK FAILED

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:flinkCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 51m 2s
143 actionable tasks: 100 executed, 41 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/pehcyyednivkw

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_Python_VR_Flink #1489

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/1489/display/redirect>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org