You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/05/08 12:11:26 UTC
Build failed in Jenkins: beam_PostCommit_Go_VR_Flink #4719
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Flink/4719/display/redirect>
Changes:
------------------------------------------
[...truncated 2.03 MB...]
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task GroupReduce (GroupReduce at CoGBK) (1/1)#0 bf5e7bccec0666537fb5826a4c34e1cc.
May 08, 2021 12:11:17 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: GroupReduce (GroupReduce at CoGBK) (1/1) (bf5e7bccec0666537fb5826a4c34e1cc) switched from RUNNING to FINISHED.
May 08, 2021 12:11:17 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: DataSource: 1 elements in 2195349918 ns
May 08, 2021 12:11:17 PM org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient unref
INFO: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\ng/tmp/beam-artifact-staging/d0f53124394cc249c62241f0b41ccf803b3cb791acdf19ad39afcb383b2a0950/1-go-worker"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
}
May 08, 2021 12:11:17 PM org.apache.beam.runners.fnexecution.logging.GrpcLoggingService close
INFO: 1 Beam Fn Logging clients still connected during shutdown.
May 08, 2021 12:11:17 PM org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver onCompleted
WARNING: Hanged up for unknown endpoint.
May 08, 2021 12:11:17 PM org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment close
INFO: Closing Docker container 8435def4343d925bef3c90441e5e2f4c53670f2df8e2b6655809881f7355cd66. Logs:
2021/05/08 12:11:14 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-job-8-1620475867565942446"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:flink_master:v1" value:{string_value:"[local]"}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"hooks" value:{string_value:"{}"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0job0801620475867565942446-jenkins-0508121112-90844da9"}} fields:{key:"beam:option:options_id:v1" value:{number_value:21}} fields:{key:"beam:option:output_executable_path:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}}} logging_endpoint:{url:"localhost:41201"} artifact_endpoint:{url:"localhost:37415"} control_endpoint:{url:"localhost:37549"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\ng/tmp/beam-artifact-staging/d0f53124394cc249c62241f0b41ccf803b3cb791acdf19ad39afcb383b2a0950/1-go-worker" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x06worker"}
2021/05/08 12:11:14 Initializing Go harness: /opt/apache/beam/boot --id=25-1 --provision_endpoint=localhost:44315
2021/05/08 12:11:14 Downloaded: /tmp/staged/worker (sha256: 2c42d9cfac8ce2f27ca85dc7d1d06207996d4edacc3eee5d1891ae116552f8d4, size: 27138301)
2021/05/08 12:11:14 WARNING: proto: file "v1.proto" is already registered
A future release will panic on registration conflicts. See:
https://developers.google.com/protocol-buffers/docs/reference/go/faq#namespace-conflict
Worker exited successfully!
2021/05/08 12:11:17 control response channel closed
May 08, 2021 12:11:17 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)#0 (5e014a6b66230134f04060ca93ba08de) switched from RUNNING to FINISHED.
May 08, 2021 12:11:17 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)#0 (5e014a6b66230134f04060ca93ba08de).
May 08, 2021 12:11:17 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: DataSink (DiscardingOutput) (1/1)#0 (fb11588ab7fc720d45d2f415e05858fe) switched from RUNNING to FINISHED.
May 08, 2021 12:11:17 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for DataSink (DiscardingOutput) (1/1)#0 (fb11588ab7fc720d45d2f415e05858fe).
May 08, 2021 12:11:17 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)#0 5e014a6b66230134f04060ca93ba08de.
May 08, 2021 12:11:17 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (DiscardingOutput) (1/1)#0 fb11588ab7fc720d45d2f415e05858fe.
May 08, 2021 12:11:17 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (5e014a6b66230134f04060ca93ba08de) switched from RUNNING to FINISHED.
May 08, 2021 12:11:17 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: DataSink (DiscardingOutput) (1/1) (fb11588ab7fc720d45d2f415e05858fe) switched from RUNNING to FINISHED.
May 08, 2021 12:11:17 PM org.apache.flink.runtime.executiongraph.ExecutionGraph transitionState
INFO: Job go0job0801620475867565942446-jenkins-0508121112-90844da9 (9fd9eac60cfe62d6b121a58ec77901fa) switched from state RUNNING to FINISHED.
May 08, 2021 12:11:18 PM org.apache.flink.runtime.dispatcher.Dispatcher jobReachedGloballyTerminalState
INFO: Job 9fd9eac60cfe62d6b121a58ec77901fa reached globally terminal state FINISHED.
May 08, 2021 12:11:18 PM org.apache.flink.runtime.jobmaster.JobMaster onStop
INFO: Stopping the JobMaster for job go0job0801620475867565942446-jenkins-0508121112-90844da9(9fd9eac60cfe62d6b121a58ec77901fa).
May 08, 2021 12:11:18 PM org.apache.flink.runtime.minicluster.MiniCluster closeAsync
INFO: Shutting down Flink Mini Cluster
May 08, 2021 12:11:18 PM org.apache.flink.runtime.taskexecutor.TaskExecutor onStop
INFO: Stopping TaskExecutor akka://flink/user/rpc/taskmanager_80.
May 08, 2021 12:11:18 PM org.apache.flink.runtime.rest.RestServerEndpoint closeAsync
INFO: Shutting down rest endpoint.
May 08, 2021 12:11:18 PM org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl suspend
INFO: Suspending SlotPool.
May 08, 2021 12:11:18 PM org.apache.flink.runtime.taskexecutor.TaskExecutor closeResourceManagerConnection
INFO: Close ResourceManager connection 63e2a988a1224f47b4c6a89accf14b05.
May 08, 2021 12:11:18 PM org.apache.flink.runtime.jobmaster.JobMaster dissolveResourceManagerConnection
INFO: Close ResourceManager connection 63e2a988a1224f47b4c6a89accf14b05: Stopping JobMaster for job go0job0801620475867565942446-jenkins-0508121112-90844da9(9fd9eac60cfe62d6b121a58ec77901fa)..
May 08, 2021 12:11:18 PM org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl close
INFO: Stopping SlotPool.
May 08, 2021 12:11:18 PM org.apache.flink.runtime.taskexecutor.TaskExecutor disconnectJobManagerConnection
INFO: Close JobManager connection for job 9fd9eac60cfe62d6b121a58ec77901fa.
May 08, 2021 12:11:18 PM org.apache.flink.runtime.resourcemanager.ResourceManager closeTaskManagerConnection
INFO: Closing TaskExecutor connection 80da2323-c147-4bbc-b6fb-de190f5aa1de because: The TaskExecutor is shutting down.
May 08, 2021 12:11:18 PM org.apache.flink.runtime.resourcemanager.ResourceManager closeJobManagerConnection
INFO: Disconnect job manager b25c9ea1f8d71469abda7c8578ca4b64@akka://flink/user/rpc/jobmanager_83 for job 9fd9eac60cfe62d6b121a58ec77901fa from the resource manager.
May 08, 2021 12:11:18 PM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:0, state:ALLOCATED, resource profile: ResourceProfile{managedMemory=9.081gb (9750174720 bytes), networkMemory=64.000mb (67108864 bytes)}, allocationId: 1052c59a3d28bd39dd525a15eb749dcf, jobId: 9fd9eac60cfe62d6b121a58ec77901fa).
May 08, 2021 12:11:18 PM org.apache.beam.runners.flink.FlinkPipelineRunner createPortablePipelineResult
INFO: Execution finished in 5188 msecs
May 08, 2021 12:11:18 PM org.apache.beam.runners.flink.FlinkPipelineRunner createPortablePipelineResult
INFO: Final accumulator values:
May 08, 2021 12:11:18 PM org.apache.beam.runners.flink.FlinkPipelineRunner createPortablePipelineResult
INFO: __metricscontainers : {
"metrics": {
"attempted": [{
"urn": "beam:metric:data_channel:read_index:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AQ==",
"labels": {
"PTRANSFORM": "fn/read/n4:0"
}
}, {
"urn": "beam:metric:element_count:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AQ==",
"labels": {
"PCOLLECTION": "n4"
}
}, {
"urn": "beam:metric:data_channel:read_index:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AQ==",
"labels": {
"PTRANSFORM": "fn/read/n7:0"
}
}, {
"urn": "beam:metric:element_count:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AQ==",
"labels": {
"PCOLLECTION": "n7"
}
}, {
"urn": "beam:metric:element_count:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AQ==",
"labels": {
"PCOLLECTION": "n1"
}
}, {
"urn": "beam:metric:data_channel:read_index:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AQ==",
"labels": {
"PTRANSFORM": "fn/read/n1:0"
}
}]
}
}
May 08, 2021 12:11:18 PM org.apache.flink.runtime.taskexecutor.TaskExecutor$JobLeaderListenerImpl jobManagerLostLeadership
INFO: JobManager for job 9fd9eac60cfe62d6b121a58ec77901fa with leader id b25c9ea1f8d71469abda7c8578ca4b64 lost leadership.
May 08, 2021 12:11:18 PM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO: Stop job leader service.
May 08, 2021 12:11:18 PM org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown
INFO: Shutting down TaskExecutorLocalStateStoresManager.
May 08, 2021 12:11:18 PM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO: FileChannelManager removed spill file directory /tmp/flink-io-5ebec6bf-f3ff-4506-b931-2008ee0ee1d9
May 08, 2021 12:11:18 PM org.apache.flink.runtime.io.network.NettyShuffleEnvironment close
INFO: Shutting down the network environment and its components.
May 08, 2021 12:11:18 PM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO: FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-884d6353-ddd4-4625-84ca-e8206d5e8705
May 08, 2021 12:11:18 PM org.apache.flink.runtime.taskexecutor.KvStateService shutdown
INFO: Shutting down the kvState service and its components.
May 08, 2021 12:11:18 PM org.apache.beam.runners.jobsubmission.InMemoryJobService getJobMetrics
INFO: Getting job metrics for go0job0801620475867565942446-jenkins-0508121112-90844da9_fc368216-7395-4807-8584-7ee3692c6b0d
May 08, 2021 12:11:18 PM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO: Stop job leader service.
May 08, 2021 12:11:18 PM org.apache.beam.runners.jobsubmission.InMemoryJobService getJobMetrics
INFO: Finished getting job metrics for go0job0801620475867565942446-jenkins-0508121112-90844da9_fc368216-7395-4807-8584-7ee3692c6b0d
May 08, 2021 12:11:18 PM org.apache.flink.runtime.filecache.FileCache shutdown
INFO: removed file cache directory /tmp/flink-dist-cache-339d323b-ee3b-4d5c-b608-3ad97cc17d59
May 08, 2021 12:11:18 PM org.apache.flink.runtime.taskexecutor.TaskExecutor handleOnStopException
INFO: Stopped TaskExecutor akka://flink/user/rpc/taskmanager_80.
May 08, 2021 12:11:18 PM org.apache.flink.runtime.webmonitor.WebMonitorEndpoint lambda$shutDownInternal$5
INFO: Removing cache directory /tmp/flink-web-ui
May 08, 2021 12:11:18 PM org.apache.flink.runtime.rest.RestServerEndpoint lambda$closeAsync$1
INFO: Shut down complete.
May 08, 2021 12:11:18 PM org.apache.flink.runtime.resourcemanager.ResourceManager deregisterApplication
INFO: Shut down cluster because application is in CANCELED, diagnostics DispatcherResourceManagerComponent has been closed..
May 08, 2021 12:11:18 PM org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent closeAsyncInternal
INFO: Closing components.
May 08, 2021 12:11:18 PM org.apache.flink.runtime.dispatcher.runner.AbstractDispatcherLeaderProcess closeInternal
INFO: Stopping SessionDispatcherLeaderProcess.
May 08, 2021 12:11:18 PM org.apache.flink.runtime.dispatcher.Dispatcher onStop
INFO: Stopping dispatcher akka://flink/user/rpc/dispatcher_82.
May 08, 2021 12:11:18 PM org.apache.flink.runtime.dispatcher.Dispatcher terminateRunningJobs
INFO: Stopping all currently running jobs of dispatcher akka://flink/user/rpc/dispatcher_82.
May 08, 2021 12:11:18 PM org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl close
INFO: Closing the SlotManager.
May 08, 2021 12:11:18 PM org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl suspend
INFO: Suspending the SlotManager.
May 08, 2021 12:11:18 PM org.apache.flink.runtime.rest.handler.legacy.backpressure.BackPressureRequestCoordinator shutDown
INFO: Shutting down back pressure request coordinator.
May 08, 2021 12:11:18 PM org.apache.flink.runtime.dispatcher.Dispatcher lambda$onStop$0
INFO: Stopped dispatcher akka://flink/user/rpc/dispatcher_82.
May 08, 2021 12:11:18 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO: Stopping Akka RPC service.
May 08, 2021 12:11:18 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO: Stopping Akka RPC service.
May 08, 2021 12:11:18 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService lambda$stopService$7
INFO: Stopped Akka RPC service.
May 08, 2021 12:11:18 PM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
May 08, 2021 12:11:18 PM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
May 08, 2021 12:11:18 PM org.apache.flink.runtime.blob.BlobServer close
INFO: Stopped BLOB server at 0.0.0.0:34093
May 08, 2021 12:11:18 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService lambda$stopService$7
INFO: Stopped Akka RPC service.
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
if [[ -n "$EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
exit $TEST_EXIT_CODE
exit_background_processes
> Task :sdks:go:test:flinkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/build.gradle'> line: 92
* What went wrong:
Execution failed for task ':sdks:go:test:flinkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 10m 54s
139 actionable tasks: 96 executed, 41 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/wlzhxawrbzwrq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Go_VR_Flink #4720
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Flink/4720/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org