You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/04/29 18:29:35 UTC
Build failed in Jenkins: beam_PostCommit_Go_VR_Flink #4684
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Flink/4684/display/redirect?page=changes>
Changes:
[Kenneth Knowles] Fix kenn at apache email address in blog author list
[randomstep] [BEAM-8706] Bump antlr4 to 4.9.2
[kwu] [BEAM-12227] Update ExternalWorkerServiceTest
[noreply] [BEAM-12238] Make StateBackedIterable Serializable. (#14660)
[noreply] [BEAM-9615] Use UUIDs in Go SDK Schemas (#14665)
[noreply] [BEAM-12174] Propertly close ExecutableStageContext in DoFnOp#close
[noreply] [BEAM-12118] Fix race introduced in QueeuingBeamFnDataClient triggering
[noreply] [BEAM-9547] WontImplement a few more DeferredGroupBy operations (#14675)
[Kenneth Knowles] Add Beam 2.29.0 release blog post
------------------------------------------
[...truncated 1.92 MB...]
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task GroupReduce (GroupReduce at CoGBK) (1/1)#0 f3601495a7b41dc5fd5519c72ef65cd5.
Apr 29, 2021 6:29:29 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: GroupReduce (GroupReduce at CoGBK) (1/1) (f3601495a7b41dc5fd5519c72ef65cd5) switched from RUNNING to FINISHED.
Apr 29, 2021 6:29:29 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: DataSource: 1 elements in 1263995912 ns
Apr 29, 2021 6:29:29 PM org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient unref
INFO: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\ng/tmp/beam-artifact-staging/b5d433af58d8674b6c9c49d0be4804f91b9888fd25aebe6370a4f029850232b9/1-go-worker"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
}
Apr 29, 2021 6:29:29 PM org.apache.beam.runners.fnexecution.logging.GrpcLoggingService close
INFO: 1 Beam Fn Logging clients still connected during shutdown.
Apr 29, 2021 6:29:29 PM org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver onCompleted
WARNING: Hanged up for unknown endpoint.
Apr 29, 2021 6:29:29 PM org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment close
INFO: Closing Docker container 864caee0f773f305860d9f5c0b06ecadc1df8c6aa29771d73f026ed566be6647. Logs:
2021/04/29 18:29:27 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-job-8-1619720960776788979"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:flink_master:v1" value:{string_value:"[local]"}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"hooks" value:{string_value:"{}"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0job0801619720960776788979-jenkins-0429182924-640868d4"}} fields:{key:"beam:option:options_id:v1" value:{number_value:20}} fields:{key:"beam:option:output_executable_path:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}}} logging_endpoint:{url:"localhost:37785"} artifact_endpoint:{url:"localhost:40309"} control_endpoint:{url:"localhost:38717"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\ng/tmp/beam-artifact-staging/b5d433af58d8674b6c9c49d0be4804f91b9888fd25aebe6370a4f029850232b9/1-go-worker" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x06worker"}
2021/04/29 18:29:27 Initializing Go harness: /opt/apache/beam/boot --id=24-1 --provision_endpoint=localhost:46003
2021/04/29 18:29:28 Downloaded: /tmp/staged/worker (sha256: d6c47c28ab25787392949c2a4214bd073c8917734704a147c1edff788e8f0e80, size: 27024643)
2021/04/29 18:29:28 WARNING: proto: file "v1.proto" is already registered
A future release will panic on registration conflicts. See:
https://developers.google.com/protocol-buffers/docs/reference/go/faq#namespace-conflict
Worker exited successfully!
2021/04/29 18:29:29 control response channel closed
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)#0 (a60016ba28dd2ca65ef2e7622cb3f3cc) switched from RUNNING to FINISHED.
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)#0 (a60016ba28dd2ca65ef2e7622cb3f3cc).
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: DataSink (DiscardingOutput) (1/1)#0 (b9030c4196f68c0dba6971aca42168d3) switched from RUNNING to FINISHED.
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for DataSink (DiscardingOutput) (1/1)#0 (b9030c4196f68c0dba6971aca42168d3).
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)#0 a60016ba28dd2ca65ef2e7622cb3f3cc.
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (DiscardingOutput) (1/1)#0 b9030c4196f68c0dba6971aca42168d3.
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (a60016ba28dd2ca65ef2e7622cb3f3cc) switched from RUNNING to FINISHED.
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: DataSink (DiscardingOutput) (1/1) (b9030c4196f68c0dba6971aca42168d3) switched from RUNNING to FINISHED.
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.executiongraph.ExecutionGraph transitionState
INFO: Job go0job0801619720960776788979-jenkins-0429182924-640868d4 (eb26e9e79dca9e9285bcec8ffc815ac7) switched from state RUNNING to FINISHED.
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.dispatcher.Dispatcher jobReachedGloballyTerminalState
INFO: Job eb26e9e79dca9e9285bcec8ffc815ac7 reached globally terminal state FINISHED.
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.minicluster.MiniCluster closeAsync
INFO: Shutting down Flink Mini Cluster
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.rest.RestServerEndpoint closeAsync
INFO: Shutting down rest endpoint.
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.taskexecutor.TaskExecutor onStop
INFO: Stopping TaskExecutor akka://flink/user/rpc/taskmanager_76.
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.taskexecutor.TaskExecutor closeResourceManagerConnection
INFO: Close ResourceManager connection 3e085f62ab97b9a643c835e2e0aae342.
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.taskexecutor.TaskExecutor disconnectJobManagerConnection
INFO: Close JobManager connection for job eb26e9e79dca9e9285bcec8ffc815ac7.
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.jobmaster.JobMaster onStop
INFO: Stopping the JobMaster for job go0job0801619720960776788979-jenkins-0429182924-640868d4(eb26e9e79dca9e9285bcec8ffc815ac7).
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.resourcemanager.ResourceManager closeTaskManagerConnection
INFO: Closing TaskExecutor connection ed632f48-371e-4456-a4ec-1a3c517597e2 because: The TaskExecutor is shutting down.
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl suspend
INFO: Suspending SlotPool.
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.jobmaster.JobMaster dissolveResourceManagerConnection
INFO: Close ResourceManager connection 3e085f62ab97b9a643c835e2e0aae342: Stopping JobMaster for job go0job0801619720960776788979-jenkins-0429182924-640868d4(eb26e9e79dca9e9285bcec8ffc815ac7)..
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl close
INFO: Stopping SlotPool.
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.resourcemanager.ResourceManager closeJobManagerConnection
INFO: Disconnect job manager ba5943e6b5c6260653d0f4016c1849e3@akka://flink/user/rpc/jobmanager_79 for job eb26e9e79dca9e9285bcec8ffc815ac7 from the resource manager.
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:0, state:ALLOCATED, resource profile: ResourceProfile{managedMemory=9.080gb (9749997568 bytes), networkMemory=64.000mb (67108864 bytes)}, allocationId: 6232fa72526b7d43f00d979febf13e2a, jobId: eb26e9e79dca9e9285bcec8ffc815ac7).
Apr 29, 2021 6:29:30 PM org.apache.beam.runners.flink.FlinkPipelineRunner createPortablePipelineResult
INFO: Execution finished in 5344 msecs
Apr 29, 2021 6:29:30 PM org.apache.beam.runners.flink.FlinkPipelineRunner createPortablePipelineResult
INFO: Final accumulator values:
Apr 29, 2021 6:29:30 PM org.apache.beam.runners.flink.FlinkPipelineRunner createPortablePipelineResult
INFO: __metricscontainers : {
"metrics": {
"attempted": [{
"urn": "beam:metric:data_channel:read_index:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AQ==",
"labels": {
"PTRANSFORM": "fn/read/n4:0"
}
}, {
"urn": "beam:metric:element_count:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AQ==",
"labels": {
"PCOLLECTION": "n4"
}
}, {
"urn": "beam:metric:data_channel:read_index:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AQ==",
"labels": {
"PTRANSFORM": "fn/read/n7:0"
}
}, {
"urn": "beam:metric:element_count:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AQ==",
"labels": {
"PCOLLECTION": "n7"
}
}, {
"urn": "beam:metric:element_count:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AQ==",
"labels": {
"PCOLLECTION": "n1"
}
}, {
"urn": "beam:metric:data_channel:read_index:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AQ==",
"labels": {
"PTRANSFORM": "fn/read/n1:0"
}
}]
}
}
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.taskexecutor.TaskExecutor$JobLeaderListenerImpl jobManagerLostLeadership
INFO: JobManager for job eb26e9e79dca9e9285bcec8ffc815ac7 with leader id ba5943e6b5c6260653d0f4016c1849e3 lost leadership.
Apr 29, 2021 6:29:30 PM org.apache.beam.runners.jobsubmission.InMemoryJobService getJobMetrics
INFO: Getting job metrics for go0job0801619720960776788979-jenkins-0429182924-640868d4_005f83b6-b438-4655-b3f7-2c04f8134ac4
Apr 29, 2021 6:29:30 PM org.apache.beam.runners.jobsubmission.InMemoryJobService getJobMetrics
INFO: Finished getting job metrics for go0job0801619720960776788979-jenkins-0429182924-640868d4_005f83b6-b438-4655-b3f7-2c04f8134ac4
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO: Stop job leader service.
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown
INFO: Shutting down TaskExecutorLocalStateStoresManager.
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO: FileChannelManager removed spill file directory /tmp/flink-io-6cb464a9-9276-4803-887e-dcbdada1f937
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.io.network.NettyShuffleEnvironment close
INFO: Shutting down the network environment and its components.
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO: FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-b0dfd57a-0f8b-45fd-9bfd-1581f6c228af
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.taskexecutor.KvStateService shutdown
INFO: Shutting down the kvState service and its components.
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO: Stop job leader service.
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.filecache.FileCache shutdown
INFO: removed file cache directory /tmp/flink-dist-cache-fc07ae53-e2e7-4d49-91a4-e08e705ecc52
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.taskexecutor.TaskExecutor handleOnStopException
INFO: Stopped TaskExecutor akka://flink/user/rpc/taskmanager_76.
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.webmonitor.WebMonitorEndpoint lambda$shutDownInternal$5
INFO: Removing cache directory /tmp/flink-web-ui
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.rest.RestServerEndpoint lambda$closeAsync$1
INFO: Shut down complete.
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.resourcemanager.ResourceManager deregisterApplication
INFO: Shut down cluster because application is in CANCELED, diagnostics DispatcherResourceManagerComponent has been closed..
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent closeAsyncInternal
INFO: Closing components.
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.dispatcher.runner.AbstractDispatcherLeaderProcess closeInternal
INFO: Stopping SessionDispatcherLeaderProcess.
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl close
INFO: Closing the SlotManager.
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.dispatcher.Dispatcher onStop
INFO: Stopping dispatcher akka://flink/user/rpc/dispatcher_78.
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl suspend
INFO: Suspending the SlotManager.
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.dispatcher.Dispatcher terminateRunningJobs
INFO: Stopping all currently running jobs of dispatcher akka://flink/user/rpc/dispatcher_78.
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.rest.handler.legacy.backpressure.BackPressureRequestCoordinator shutDown
INFO: Shutting down back pressure request coordinator.
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.dispatcher.Dispatcher lambda$onStop$0
INFO: Stopped dispatcher akka://flink/user/rpc/dispatcher_78.
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO: Stopping Akka RPC service.
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO: Stopping Akka RPC service.
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService lambda$stopService$7
INFO: Stopped Akka RPC service.
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.blob.BlobServer close
INFO: Stopped BLOB server at 0.0.0.0:42169
Apr 29, 2021 6:29:30 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService lambda$stopService$7
INFO: Stopped Akka RPC service.
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
if [[ -n "$EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
exit $TEST_EXIT_CODE
exit_background_processes
> Task :sdks:go:test:flinkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/build.gradle'> line: 92
* What went wrong:
Execution failed for task ':sdks:go:test:flinkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 29m 4s
139 actionable tasks: 125 executed, 12 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/o7byagr6f77vk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Go_VR_Flink #4685
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Flink/4685/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org