You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/08/12 06:18:03 UTC

Build failed in Jenkins: beam_PostCommit_Go_VR_Flink #5071

See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Flink/5071/display/redirect?page=changes>

Changes:

[noreply] [GoSDK Infra] Limit simultaneous tests binaries to 3. (#15321)


------------------------------------------
[...truncated 3.46 MB...]
  type_urn: "beam:artifact:type:file:v1"
  type_payload: "\ng/tmp/beam-artifact-staging/094f41b53d1de5aa636eb5fe08d46d08eb74e72e423e1c243469f905d36f29da/1-go-worker"
  role_urn: "beam:artifact:role:staging_to:v1"
  role_payload: "\n\006worker"
}

Aug 12, 2021 6:18:00 AM org.apache.beam.runners.fnexecution.logging.GrpcLoggingService close
INFO: 1 Beam Fn Logging clients still connected during shutdown.
Aug 12, 2021 6:18:00 AM org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver onCompleted
WARNING: Hanged up for unknown endpoint.
Aug 12, 2021 6:18:00 AM org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment close
INFO: Closing Docker container d6cb62dc75472cdff3ba667d8d137abec5bf84b6d74b5a44a28c1eb3bd8d3a6f. Logs:
2021/08/12 06:18:00 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-job-7-1628749071882634494"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:flink_master:v1" value:{string_value:"[local]"}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"hooks" value:{string_value:"{}"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0job0701628749071882634494-jenkins-0812061754-e0b68304"}} fields:{key:"beam:option:options_id:v1" value:{number_value:33}} fields:{key:"beam:option:output_executable_path:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}}} logging_endpoint:{url:"localhost:43555"} artifact_endpoint:{url:"localhost:35925"} control_endpoint:{url:"localhost:46071"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\ng/tmp/beam-artifact-staging/094f41b53d1de5aa636eb5fe08d46d08eb74e72e423e1c243469f905d36f29da/1-go-worker" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x06worker"}
2021/08/12 06:18:00 Initializing Go harness: /opt/apache/beam/boot --id=53-1 --provision_endpoint=localhost:34403
2021/08/12 06:18:00 Downloaded: /tmp/staged/worker (sha256: 93f7d10c1cac080544aa8fc9034c57d00464fff7be09742584c6aac596ab8678, size: 27195142)
Worker exited successfully!
2021/08/12 06:18:00 control response channel closed
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: MapPartition (MapPartition at [1]passert.Equals/passert.failIfBadEntries) (1/1)#0 (d82d6b4a301c6e428c6337dd591841fb) switched from RUNNING to FINISHED.
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for MapPartition (MapPartition at [1]passert.Equals/passert.failIfBadEntries) (1/1)#0 (d82d6b4a301c6e428c6337dd591841fb).
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: DataSink (DiscardingOutput) (1/1)#0 (115b10b9d4bd8de28d08237456332f37) switched from RUNNING to FINISHED.
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for DataSink (DiscardingOutput) (1/1)#0 (115b10b9d4bd8de28d08237456332f37).
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task MapPartition (MapPartition at [1]passert.Equals/passert.failIfBadEntries) (1/1)#0 d82d6b4a301c6e428c6337dd591841fb.
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (DiscardingOutput) (1/1)#0 115b10b9d4bd8de28d08237456332f37.
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: MapPartition (MapPartition at [1]passert.Equals/passert.failIfBadEntries) (1/1) (d82d6b4a301c6e428c6337dd591841fb) switched from RUNNING to FINISHED.
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: DataSink (DiscardingOutput) (1/1) (115b10b9d4bd8de28d08237456332f37) switched from RUNNING to FINISHED.
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager processResourceRequirements
INFO: Clearing resource requirements of job ee1705519f47fbd8d9b64f298b4d871a
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.executiongraph.DefaultExecutionGraph transitionState
INFO: Job go0job0701628749071882634494-jenkins-0812061754-e0b68304 (ee1705519f47fbd8d9b64f298b4d871a) switched from state RUNNING to FINISHED.
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.dispatcher.Dispatcher jobReachedTerminalState
INFO: Job ee1705519f47fbd8d9b64f298b4d871a reached terminal state FINISHED.
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.minicluster.MiniCluster closeAsync
INFO: Shutting down Flink Mini Cluster
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.taskexecutor.TaskExecutor onStop
INFO: Stopping TaskExecutor akka://flink/user/rpc/taskmanager_124.
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.rest.RestServerEndpoint closeAsync
INFO: Shutting down rest endpoint.
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.taskexecutor.TaskExecutor closeResourceManagerConnection
INFO: Close ResourceManager connection dd8665ae979475149658d7ec2673a165.
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.jobmaster.JobMaster onStop
INFO: Stopping the JobMaster for job go0job0701628749071882634494-jenkins-0812061754-e0b68304(ee1705519f47fbd8d9b64f298b4d871a).
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.taskexecutor.TaskExecutor disconnectJobManagerConnection
INFO: Close JobManager connection for job ee1705519f47fbd8d9b64f298b4d871a.
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.resourcemanager.ResourceManager closeTaskManagerConnection
INFO: Closing TaskExecutor connection 0c105819-0404-4238-b074-174ad5ea38ec because: The TaskExecutor is shutting down.
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool releaseSlots
INFO: Releasing slot [29381e91421915d5bcfa5a734d0753ee].
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager processResourceRequirements
INFO: Clearing resource requirements of job ee1705519f47fbd8d9b64f298b4d871a
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.jobmaster.JobMaster dissolveResourceManagerConnection
INFO: Close ResourceManager connection dd8665ae979475149658d7ec2673a165: Stopping JobMaster for job go0job0701628749071882634494-jenkins-0812061754-e0b68304(ee1705519f47fbd8d9b64f298b4d871a)..
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:0, state:ALLOCATED, resource profile: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=9.081gb (9750337536 bytes), networkMemory=64.000mb (67108864 bytes)}, allocationId: 29381e91421915d5bcfa5a734d0753ee, jobId: ee1705519f47fbd8d9b64f298b4d871a).
Aug 12, 2021 6:18:01 AM org.apache.beam.runners.flink.FlinkPipelineRunner createPortablePipelineResult
INFO: Execution finished in 6081 msecs
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.resourcemanager.ResourceManager closeJobManagerConnection
INFO: Disconnect job manager a80a621a10e67791c714f2e21d134f05@akka://flink/user/rpc/jobmanager_127 for job ee1705519f47fbd8d9b64f298b4d871a from the resource manager.
Aug 12, 2021 6:18:01 AM org.apache.beam.runners.flink.FlinkPipelineRunner createPortablePipelineResult
INFO: Final accumulator values:
Aug 12, 2021 6:18:01 AM org.apache.beam.runners.flink.FlinkPipelineRunner createPortablePipelineResult
INFO: __metricscontainers : {
  "metrics": {
    "attempted": [{
      "urn": "beam:metric:data_channel:read_index:v1",
      "type": "beam:metrics:sum_int64:v1",
      "payload": "AQ==",
      "labels": {
        "PTRANSFORM": "fn/read/n4:0"
      }
    }, {
      "urn": "beam:metric:element_count:v1",
      "type": "beam:metrics:sum_int64:v1",
      "payload": "AQ==",
      "labels": {
        "PCOLLECTION": "n4"
      }
    }, {
      "urn": "beam:metric:data_channel:read_index:v1",
      "type": "beam:metrics:sum_int64:v1",
      "payload": "AQ==",
      "labels": {
        "PTRANSFORM": "fn/read/n8:0"
      }
    }, {
      "urn": "beam:metric:element_count:v1",
      "type": "beam:metrics:sum_int64:v1",
      "payload": "AQ==",
      "labels": {
        "PCOLLECTION": "n8"
      }
    }, {
      "urn": "beam:metric:element_count:v1",
      "type": "beam:metrics:sum_int64:v1",
      "payload": "AQ==",
      "labels": {
        "PCOLLECTION": "n10"
      }
    }, {
      "urn": "beam:metric:data_channel:read_index:v1",
      "type": "beam:metrics:sum_int64:v1",
      "payload": "AQ==",
      "labels": {
        "PTRANSFORM": "fn/read/n10:0"
      }
    }, {
      "urn": "beam:metric:element_count:v1",
      "type": "beam:metrics:sum_int64:v1",
      "payload": "AQ==",
      "labels": {
        "PCOLLECTION": "n14"
      }
    }, {
      "urn": "beam:metric:data_channel:read_index:v1",
      "type": "beam:metrics:sum_int64:v1",
      "payload": "AQ==",
      "labels": {
        "PTRANSFORM": "fn/read/n14:0"
      }
    }, {
      "urn": "beam:metric:element_count:v1",
      "type": "beam:metrics:sum_int64:v1",
      "payload": "AQ==",
      "labels": {
        "PCOLLECTION": "n1"
      }
    }, {
      "urn": "beam:metric:data_channel:read_index:v1",
      "type": "beam:metrics:sum_int64:v1",
      "payload": "AQ==",
      "labels": {
        "PTRANSFORM": "fn/read/n1:0"
      }
    }]
  }
}
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO: Stop job leader service.
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.taskexecutor.TaskExecutor$JobLeaderListenerImpl jobManagerLostLeadership
INFO: JobManager for job ee1705519f47fbd8d9b64f298b4d871a with leader id a80a621a10e67791c714f2e21d134f05 lost leadership.
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown
INFO: Shutting down TaskExecutorLocalStateStoresManager.
Aug 12, 2021 6:18:01 AM org.apache.beam.runners.jobsubmission.InMemoryJobService getJobMetrics
INFO: Getting job metrics for go0job0701628749071882634494-jenkins-0812061754-e0b68304_7a2cc563-5f01-4e39-943b-457f39bafbd9
Aug 12, 2021 6:18:01 AM org.apache.beam.runners.jobsubmission.InMemoryJobService getJobMetrics
INFO: Finished getting job metrics for go0job0701628749071882634494-jenkins-0812061754-e0b68304_7a2cc563-5f01-4e39-943b-457f39bafbd9
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO: FileChannelManager removed spill file directory /tmp/flink-io-fff68e87-f24e-4ebc-a487-37e2e5aa5e1c
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.io.network.NettyShuffleEnvironment close
INFO: Shutting down the network environment and its components.
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO: FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-2fed392e-3bc4-4f7c-95d3-4b527c22c752
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.taskexecutor.KvStateService shutdown
INFO: Shutting down the kvState service and its components.
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO: Stop job leader service.
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.filecache.FileCache shutdown
INFO: removed file cache directory /tmp/flink-dist-cache-cd35838b-06b1-4be0-9956-fc7349ee872f
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.taskexecutor.TaskExecutor handleOnStopException
INFO: Stopped TaskExecutor akka://flink/user/rpc/taskmanager_124.
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.webmonitor.WebMonitorEndpoint lambda$shutDownInternal$5
INFO: Removing cache directory /tmp/flink-web-ui
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.rest.RestServerEndpoint lambda$closeAsync$1
INFO: Shut down complete.
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.resourcemanager.ResourceManager deregisterApplication
INFO: Shut down cluster because application is in CANCELED, diagnostics DispatcherResourceManagerComponent has been closed..
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent closeAsyncInternal
INFO: Closing components.
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.dispatcher.runner.AbstractDispatcherLeaderProcess closeInternal
INFO: Stopping SessionDispatcherLeaderProcess.
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.dispatcher.Dispatcher onStop
INFO: Stopping dispatcher akka://flink/user/rpc/dispatcher_126.
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager close
INFO: Closing the slot manager.
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.dispatcher.Dispatcher terminateRunningJobs
INFO: Stopping all currently running jobs of dispatcher akka://flink/user/rpc/dispatcher_126.
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager suspend
INFO: Suspending the slot manager.
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.dispatcher.Dispatcher lambda$onStop$0
INFO: Stopped dispatcher akka://flink/user/rpc/dispatcher_126.
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO: Stopping Akka RPC service.
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO: Stopping Akka RPC service.
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService lambda$stopService$7
INFO: Stopped Akka RPC service.
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.blob.BlobServer close
INFO: Stopped BLOB server at 0.0.0.0:37089
Aug 12, 2021 6:18:01 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService lambda$stopService$7
INFO: Stopped Akka RPC service.

if [[ "$RUNNER" == "dataflow" ]]; then
  # Delete the container locally and remotely
  docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
  gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"

  if [[ -n "$TEST_EXPANSION_ADDR" || -n "$IO_EXPANSION_ADDR" ]]; then
    # Delete the java cross-language container locally and remotely
    docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
    gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
  fi

  # Clean up tempdir
  rm -rf $TMPDIR
fi

exit $TEST_EXIT_CODE
exit_background_processes

> Task :sdks:go:test:flinkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/build.gradle'> line: 94

* What went wrong:
Execution failed for task ':sdks:go:test:flinkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 17m 32s
169 actionable tasks: 122 executed, 42 from cache, 5 up-to-date

Publishing build scan...
https://gradle.com/s/ixbxdhnncvgri

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_Go_VR_Flink #5072

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Flink/5072/display/redirect>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org