You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/07/29 18:12:40 UTC
Build failed in Jenkins: beam_PostCommit_Go_VR_Flink #5017
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Flink/5017/display/redirect?page=changes>
Changes:
[noreply] [BEAM-9615] Recover from registration panics. (#15228)
------------------------------------------
[...truncated 3.04 MB...]
type_urn: "beam:artifact:type:file:v1"
type_payload: "\ng/tmp/beam-artifact-staging/01f6bdb96212321cdcba69acfd9a4e4012b6d102f3b3b6c0b2f74b86384b9eaa/1-go-worker"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
}
Jul 29, 2021 6:12:36 PM org.apache.beam.runners.fnexecution.logging.GrpcLoggingService close
INFO: 1 Beam Fn Logging clients still connected during shutdown.
Jul 29, 2021 6:12:36 PM org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver onCompleted
WARNING: Hanged up for unknown endpoint.
Jul 29, 2021 6:12:36 PM org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment close
INFO: Closing Docker container e52fa6e9e92a0356465bc769246c09391a268b912a0183981369754a7758d4bc. Logs:
2021/07/29 18:12:35 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-job-7-1627582334531460177"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:flink_master:v1" value:{string_value:"[local]"}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"hooks" value:{string_value:"{}"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0job0701627582334531460177-jenkins-0729181217-afa214dc"}} fields:{key:"beam:option:options_id:v1" value:{number_value:30}} fields:{key:"beam:option:output_executable_path:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}}} logging_endpoint:{url:"localhost:35663"} artifact_endpoint:{url:"localhost:41661"} control_endpoint:{url:"localhost:41275"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\ng/tmp/beam-artifact-staging/01f6bdb96212321cdcba69acfd9a4e4012b6d102f3b3b6c0b2f74b86384b9eaa/1-go-worker" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x06worker"}
2021/07/29 18:12:35 Initializing Go harness: /opt/apache/beam/boot --id=48-1 --provision_endpoint=localhost:37641
2021/07/29 18:12:36 Downloaded: /tmp/staged/worker (sha256: c2b312c31c3cbf4c84ee3ea0d89e5d15a4b7c001fd9c0638a165772c614a97b6, size: 27178758)
Worker exited successfully!
2021/07/29 18:12:36 control response channel closed
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: MapPartition (MapPartition at [1]passert.Equals/passert.failIfBadEntries) (1/1)#0 (b669d129f785129aad6c1e0670e63de8) switched from RUNNING to FINISHED.
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for MapPartition (MapPartition at [1]passert.Equals/passert.failIfBadEntries) (1/1)#0 (b669d129f785129aad6c1e0670e63de8).
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: DataSink (DiscardingOutput) (1/1)#0 (3644cfd78baa2ea1ff50d3b413c68521) switched from RUNNING to FINISHED.
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for DataSink (DiscardingOutput) (1/1)#0 (3644cfd78baa2ea1ff50d3b413c68521).
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task MapPartition (MapPartition at [1]passert.Equals/passert.failIfBadEntries) (1/1)#0 b669d129f785129aad6c1e0670e63de8.
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (DiscardingOutput) (1/1)#0 3644cfd78baa2ea1ff50d3b413c68521.
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: MapPartition (MapPartition at [1]passert.Equals/passert.failIfBadEntries) (1/1) (b669d129f785129aad6c1e0670e63de8) switched from RUNNING to FINISHED.
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: DataSink (DiscardingOutput) (1/1) (3644cfd78baa2ea1ff50d3b413c68521) switched from RUNNING to FINISHED.
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager processResourceRequirements
INFO: Clearing resource requirements of job 4af7c429223dd9f27fd816c364199651
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.executiongraph.DefaultExecutionGraph transitionState
INFO: Job go0job0701627582334531460177-jenkins-0729181217-afa214dc (4af7c429223dd9f27fd816c364199651) switched from state RUNNING to FINISHED.
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.dispatcher.Dispatcher jobReachedTerminalState
INFO: Job 4af7c429223dd9f27fd816c364199651 reached terminal state FINISHED.
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.minicluster.MiniCluster closeAsync
INFO: Shutting down Flink Mini Cluster
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.taskexecutor.TaskExecutor onStop
INFO: Stopping TaskExecutor akka://flink/user/rpc/taskmanager_112.
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.rest.RestServerEndpoint closeAsync
INFO: Shutting down rest endpoint.
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.taskexecutor.TaskExecutor closeResourceManagerConnection
INFO: Close ResourceManager connection 54461bcaad5763f5bb8dbbd9472e55f5.
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.taskexecutor.TaskExecutor disconnectJobManagerConnection
INFO: Close JobManager connection for job 4af7c429223dd9f27fd816c364199651.
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.resourcemanager.ResourceManager closeTaskManagerConnection
INFO: Closing TaskExecutor connection e5014590-30ad-4e7f-aa38-5ab2a9996f1f because: The TaskExecutor is shutting down.
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.jobmaster.JobMaster onStop
INFO: Stopping the JobMaster for job go0job0701627582334531460177-jenkins-0729181217-afa214dc(4af7c429223dd9f27fd816c364199651).
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool releaseSlots
INFO: Releasing slot [fa62ad5fdc0141bd209aa32888add87a].
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.jobmaster.JobMaster dissolveResourceManagerConnection
INFO: Close ResourceManager connection 54461bcaad5763f5bb8dbbd9472e55f5: Stopping JobMaster for job go0job0701627582334531460177-jenkins-0729181217-afa214dc(4af7c429223dd9f27fd816c364199651)..
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager processResourceRequirements
INFO: Clearing resource requirements of job 4af7c429223dd9f27fd816c364199651
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:0, state:ALLOCATED, resource profile: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=9.077gb (9746209792 bytes), networkMemory=64.000mb (67108864 bytes)}, allocationId: fa62ad5fdc0141bd209aa32888add87a, jobId: 4af7c429223dd9f27fd816c364199651).
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.resourcemanager.ResourceManager closeJobManagerConnection
INFO: Disconnect job manager b49600356daf2aca990a50b2e7344050@akka://flink/user/rpc/jobmanager_115 for job 4af7c429223dd9f27fd816c364199651 from the resource manager.
Jul 29, 2021 6:12:37 PM org.apache.beam.runners.flink.FlinkPipelineRunner createPortablePipelineResult
INFO: Execution finished in 19002 msecs
Jul 29, 2021 6:12:37 PM org.apache.beam.runners.flink.FlinkPipelineRunner createPortablePipelineResult
INFO: Final accumulator values:
Jul 29, 2021 6:12:37 PM org.apache.beam.runners.flink.FlinkPipelineRunner createPortablePipelineResult
INFO: __metricscontainers : {
"metrics": {
"attempted": [{
"urn": "beam:metric:data_channel:read_index:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AQ==",
"labels": {
"PTRANSFORM": "fn/read/n4:0"
}
}, {
"urn": "beam:metric:element_count:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AQ==",
"labels": {
"PCOLLECTION": "n4"
}
}, {
"urn": "beam:metric:data_channel:read_index:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AQ==",
"labels": {
"PTRANSFORM": "fn/read/n8:0"
}
}, {
"urn": "beam:metric:element_count:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AQ==",
"labels": {
"PCOLLECTION": "n8"
}
}, {
"urn": "beam:metric:element_count:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AQ==",
"labels": {
"PCOLLECTION": "n10"
}
}, {
"urn": "beam:metric:data_channel:read_index:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AQ==",
"labels": {
"PTRANSFORM": "fn/read/n10:0"
}
}, {
"urn": "beam:metric:element_count:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AQ==",
"labels": {
"PCOLLECTION": "n14"
}
}, {
"urn": "beam:metric:data_channel:read_index:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AQ==",
"labels": {
"PTRANSFORM": "fn/read/n14:0"
}
}, {
"urn": "beam:metric:element_count:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AQ==",
"labels": {
"PCOLLECTION": "n1"
}
}, {
"urn": "beam:metric:data_channel:read_index:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AQ==",
"labels": {
"PTRANSFORM": "fn/read/n1:0"
}
}]
}
}
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO: Stop job leader service.
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.taskexecutor.TaskExecutor$JobLeaderListenerImpl jobManagerLostLeadership
INFO: JobManager for job 4af7c429223dd9f27fd816c364199651 with leader id b49600356daf2aca990a50b2e7344050 lost leadership.
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown
INFO: Shutting down TaskExecutorLocalStateStoresManager.
Jul 29, 2021 6:12:37 PM org.apache.beam.runners.jobsubmission.InMemoryJobService getJobMetrics
INFO: Getting job metrics for go0job0701627582334531460177-jenkins-0729181217-afa214dc_da41b7e3-c17f-42a2-9cb2-04aab3a8ff76
Jul 29, 2021 6:12:37 PM org.apache.beam.runners.jobsubmission.InMemoryJobService getJobMetrics
INFO: Finished getting job metrics for go0job0701627582334531460177-jenkins-0729181217-afa214dc_da41b7e3-c17f-42a2-9cb2-04aab3a8ff76
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO: FileChannelManager removed spill file directory /tmp/flink-io-334316ed-a670-4b2b-bd51-35b7d93499c0
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.io.network.NettyShuffleEnvironment close
INFO: Shutting down the network environment and its components.
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.webmonitor.WebMonitorEndpoint lambda$shutDownInternal$5
INFO: Removing cache directory /tmp/flink-web-ui
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.rest.RestServerEndpoint lambda$closeAsync$1
INFO: Shut down complete.
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO: FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-2b65fb66-12b5-41b8-92b6-d0b8556d0ea2
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.taskexecutor.KvStateService shutdown
INFO: Shutting down the kvState service and its components.
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.resourcemanager.ResourceManager deregisterApplication
INFO: Shut down cluster because application is in CANCELED, diagnostics DispatcherResourceManagerComponent has been closed..
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO: Stop job leader service.
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent closeAsyncInternal
INFO: Closing components.
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.filecache.FileCache shutdown
INFO: removed file cache directory /tmp/flink-dist-cache-1e960e38-a343-4157-a67a-b80f271416e8
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.taskexecutor.TaskExecutor handleOnStopException
INFO: Stopped TaskExecutor akka://flink/user/rpc/taskmanager_112.
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.dispatcher.runner.AbstractDispatcherLeaderProcess closeInternal
INFO: Stopping SessionDispatcherLeaderProcess.
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.dispatcher.Dispatcher onStop
INFO: Stopping dispatcher akka://flink/user/rpc/dispatcher_114.
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager close
INFO: Closing the slot manager.
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.dispatcher.Dispatcher terminateRunningJobs
INFO: Stopping all currently running jobs of dispatcher akka://flink/user/rpc/dispatcher_114.
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager suspend
INFO: Suspending the slot manager.
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.dispatcher.Dispatcher lambda$onStop$0
INFO: Stopped dispatcher akka://flink/user/rpc/dispatcher_114.
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO: Stopping Akka RPC service.
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO: Stopping Akka RPC service.
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService lambda$stopService$7
INFO: Stopped Akka RPC service.
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.blob.BlobServer close
INFO: Stopped BLOB server at 0.0.0.0:38873
Jul 29, 2021 6:12:37 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService lambda$stopService$7
INFO: Stopped Akka RPC service.
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
if [[ -n "$TEST_EXPANSION_ADDR" || -n "$IO_EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
exit $TEST_EXIT_CODE
exit_background_processes
> Task :sdks:go:test:flinkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/build.gradle'> line: 92
* What went wrong:
Execution failed for task ':sdks:go:test:flinkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 15s
142 actionable tasks: 98 executed, 42 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/4dmjxcfqxrwhk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Go_VR_Flink #5018
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Flink/5018/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org