You are viewing a plain text version of this content. The canonical link for it is here.

Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/05/02 12:12:58 UTC

Build failed in Jenkins: beam_PostCommit_Go_VR_Flink #4695

See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Flink/4695/display/redirect>

Changes:


------------------------------------------
[...truncated 2.01 MB...]
May 02, 2021 12:12:54 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: GroupReduce (GroupReduce at CoGBK) (1/1) (7903dae90b1957fbd8bcd0fb5abb1574) switched from RUNNING to FINISHED.
May 02, 2021 12:12:54 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: DataSource: 1 elements in 941409925 ns
May 02, 2021 12:12:54 PM org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient unref
INFO: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies {
  type_urn: "beam:artifact:type:file:v1"
  type_payload: "\ng/tmp/beam-artifact-staging/ae16bcff51e24067fd08fc247c5b97c03325078be5b4b619e86c3e58fe0ada98/1-go-worker"
  role_urn: "beam:artifact:role:staging_to:v1"
  role_payload: "\n\006worker"
}

May 02, 2021 12:12:54 PM org.apache.beam.runners.fnexecution.logging.GrpcLoggingService close
INFO: 1 Beam Fn Logging clients still connected during shutdown.
May 02, 2021 12:12:54 PM org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver onCompleted
WARNING: Hanged up for unknown endpoint.
May 02, 2021 12:12:54 PM org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment close
INFO: Closing Docker container 0ab47777a6462ec4e98b5a0f240e5fc09a9679c4bc1545ceca38bd870faede8e. Logs:
2021/05/02 12:12:53 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-job-8-1619957568977690910"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:flink_master:v1" value:{string_value:"[local]"}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"hooks" value:{string_value:"{}"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0job0801619957568977690910-jenkins-0502121251-4ec225a"}} fields:{key:"beam:option:options_id:v1" value:{number_value:21}} fields:{key:"beam:option:output_executable_path:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}}} logging_endpoint:{url:"localhost:43715"} artifact_endpoint:{url:"localhost:37737"} control_endpoint:{url:"localhost:39389"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\ng/tmp/beam-artifact-staging/ae16bcff51e24067fd08fc247c5b97c03325078be5b4b619e86c3e58fe0ada98/1-go-worker" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x06worker"}
2021/05/02 12:12:53 Initializing Go harness: /opt/apache/beam/boot --id=25-1 --provision_endpoint=localhost:33257
2021/05/02 12:12:53 Downloaded: /tmp/staged/worker (sha256: 909f05d45e63d00c16c5f125b69ea8ab82f0325d75aca918fd89ed4dbca3b1ec, size: 27120620)
2021/05/02 12:12:53 WARNING: proto: file "v1.proto" is already registered
A future release will panic on registration conflicts. See:
https://developers.google.com/protocol-buffers/docs/reference/go/faq#namespace-conflict

Worker exited successfully!
2021/05/02 12:12:54 control response channel closed
May 02, 2021 12:12:55 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)#0 (d2026a4bfd675e8ff6ad846a0e7a0e6f) switched from RUNNING to FINISHED.
May 02, 2021 12:12:55 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)#0 (d2026a4bfd675e8ff6ad846a0e7a0e6f).
May 02, 2021 12:12:55 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: DataSink (DiscardingOutput) (1/1)#0 (a180c30c996bc7afd91232111a3b3e36) switched from RUNNING to FINISHED.
May 02, 2021 12:12:55 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for DataSink (DiscardingOutput) (1/1)#0 (a180c30c996bc7afd91232111a3b3e36).
May 02, 2021 12:12:55 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)#0 d2026a4bfd675e8ff6ad846a0e7a0e6f.
May 02, 2021 12:12:55 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (DiscardingOutput) (1/1)#0 a180c30c996bc7afd91232111a3b3e36.
May 02, 2021 12:12:55 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (d2026a4bfd675e8ff6ad846a0e7a0e6f) switched from RUNNING to FINISHED.
May 02, 2021 12:12:55 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: DataSink (DiscardingOutput) (1/1) (a180c30c996bc7afd91232111a3b3e36) switched from RUNNING to FINISHED.
May 02, 2021 12:12:55 PM org.apache.flink.runtime.executiongraph.ExecutionGraph transitionState
INFO: Job go0job0801619957568977690910-jenkins-0502121251-4ec225a (4640fa6e6bde9dba1fabb077df301995) switched from state RUNNING to FINISHED.
May 02, 2021 12:12:55 PM org.apache.flink.runtime.dispatcher.Dispatcher jobReachedGloballyTerminalState
INFO: Job 4640fa6e6bde9dba1fabb077df301995 reached globally terminal state FINISHED.
May 02, 2021 12:12:55 PM org.apache.flink.runtime.minicluster.MiniCluster closeAsync
INFO: Shutting down Flink Mini Cluster
May 02, 2021 12:12:55 PM org.apache.flink.runtime.taskexecutor.TaskExecutor onStop
INFO: Stopping TaskExecutor akka://flink/user/rpc/taskmanager_80.
May 02, 2021 12:12:55 PM org.apache.flink.runtime.jobmaster.JobMaster onStop
INFO: Stopping the JobMaster for job go0job0801619957568977690910-jenkins-0502121251-4ec225a(4640fa6e6bde9dba1fabb077df301995).
May 02, 2021 12:12:55 PM org.apache.flink.runtime.taskexecutor.TaskExecutor closeResourceManagerConnection
INFO: Close ResourceManager connection a30093fd852e5f7dbf8b972152e26c63.
May 02, 2021 12:12:55 PM org.apache.flink.runtime.rest.RestServerEndpoint closeAsync
INFO: Shutting down rest endpoint.
May 02, 2021 12:12:55 PM org.apache.flink.runtime.taskexecutor.TaskExecutor disconnectJobManagerConnection
INFO: Close JobManager connection for job 4640fa6e6bde9dba1fabb077df301995.
May 02, 2021 12:12:55 PM org.apache.flink.runtime.resourcemanager.ResourceManager closeTaskManagerConnection
INFO: Closing TaskExecutor connection 3a029882-092c-448f-a124-4ab7ae143dae because: The TaskExecutor is shutting down.
May 02, 2021 12:12:55 PM org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl suspend
INFO: Suspending SlotPool.
May 02, 2021 12:12:55 PM org.apache.flink.runtime.jobmaster.JobMaster dissolveResourceManagerConnection
INFO: Close ResourceManager connection a30093fd852e5f7dbf8b972152e26c63: Stopping JobMaster for job go0job0801619957568977690910-jenkins-0502121251-4ec225a(4640fa6e6bde9dba1fabb077df301995)..
May 02, 2021 12:12:55 PM org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl close
INFO: Stopping SlotPool.
May 02, 2021 12:12:55 PM org.apache.flink.runtime.resourcemanager.ResourceManager closeJobManagerConnection
INFO: Disconnect job manager 8d4fb2001dc32c43f917c08cfb794d9d@akka://flink/user/rpc/jobmanager_83 for job 4640fa6e6bde9dba1fabb077df301995 from the resource manager.
May 02, 2021 12:12:55 PM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:0, state:ALLOCATED, resource profile: ResourceProfile{managedMemory=9.081gb (9750277120 bytes), networkMemory=64.000mb (67108864 bytes)}, allocationId: fb7769aa02743c0e224d15fd42112772, jobId: 4640fa6e6bde9dba1fabb077df301995).
May 02, 2021 12:12:55 PM org.apache.beam.runners.flink.FlinkPipelineRunner createPortablePipelineResult
INFO: Execution finished in 3272 msecs
May 02, 2021 12:12:55 PM org.apache.beam.runners.flink.FlinkPipelineRunner createPortablePipelineResult
INFO: Final accumulator values:
May 02, 2021 12:12:55 PM org.apache.beam.runners.flink.FlinkPipelineRunner createPortablePipelineResult
INFO: __metricscontainers : {
  "metrics": {
    "attempted": [{
      "urn": "beam:metric:data_channel:read_index:v1",
      "type": "beam:metrics:sum_int64:v1",
      "payload": "AQ==",
      "labels": {
        "PTRANSFORM": "fn/read/n4:0"
      }
    }, {
      "urn": "beam:metric:element_count:v1",
      "type": "beam:metrics:sum_int64:v1",
      "payload": "AQ==",
      "labels": {
        "PCOLLECTION": "n4"
      }
    }, {
      "urn": "beam:metric:data_channel:read_index:v1",
      "type": "beam:metrics:sum_int64:v1",
      "payload": "AQ==",
      "labels": {
        "PTRANSFORM": "fn/read/n7:0"
      }
    }, {
      "urn": "beam:metric:element_count:v1",
      "type": "beam:metrics:sum_int64:v1",
      "payload": "AQ==",
      "labels": {
        "PCOLLECTION": "n7"
      }
    }, {
      "urn": "beam:metric:element_count:v1",
      "type": "beam:metrics:sum_int64:v1",
      "payload": "AQ==",
      "labels": {
        "PCOLLECTION": "n1"
      }
    }, {
      "urn": "beam:metric:data_channel:read_index:v1",
      "type": "beam:metrics:sum_int64:v1",
      "payload": "AQ==",
      "labels": {
        "PTRANSFORM": "fn/read/n1:0"
      }
    }]
  }
}
May 02, 2021 12:12:55 PM org.apache.flink.runtime.taskexecutor.TaskExecutor$JobLeaderListenerImpl jobManagerLostLeadership
INFO: JobManager for job 4640fa6e6bde9dba1fabb077df301995 with leader id 8d4fb2001dc32c43f917c08cfb794d9d lost leadership.
May 02, 2021 12:12:55 PM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO: Stop job leader service.
May 02, 2021 12:12:55 PM org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown
INFO: Shutting down TaskExecutorLocalStateStoresManager.
May 02, 2021 12:12:55 PM org.apache.flink.runtime.webmonitor.WebMonitorEndpoint lambda$shutDownInternal$5
INFO: Removing cache directory /tmp/flink-web-ui
May 02, 2021 12:12:55 PM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO: FileChannelManager removed spill file directory /tmp/flink-io-0f3b496d-fa24-4768-b782-5980e3a1569b
May 02, 2021 12:12:55 PM org.apache.flink.runtime.io.network.NettyShuffleEnvironment close
INFO: Shutting down the network environment and its components.
May 02, 2021 12:12:55 PM org.apache.beam.runners.jobsubmission.InMemoryJobService getJobMetrics
INFO: Getting job metrics for go0job0801619957568977690910-jenkins-0502121251-4ec225a_3ceb031a-4316-41e0-8c42-0df16b86f7bd
May 02, 2021 12:12:55 PM org.apache.flink.runtime.rest.RestServerEndpoint lambda$closeAsync$1
INFO: Shut down complete.
May 02, 2021 12:12:55 PM org.apache.beam.runners.jobsubmission.InMemoryJobService getJobMetrics
INFO: Finished getting job metrics for go0job0801619957568977690910-jenkins-0502121251-4ec225a_3ceb031a-4316-41e0-8c42-0df16b86f7bd
May 02, 2021 12:12:55 PM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO: FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-6f870ae7-3e72-4a61-875a-490439d4e3c9
May 02, 2021 12:12:55 PM org.apache.flink.runtime.taskexecutor.KvStateService shutdown
INFO: Shutting down the kvState service and its components.
May 02, 2021 12:12:55 PM org.apache.flink.runtime.resourcemanager.ResourceManager deregisterApplication
INFO: Shut down cluster because application is in CANCELED, diagnostics DispatcherResourceManagerComponent has been closed..
May 02, 2021 12:12:55 PM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO: Stop job leader service.
May 02, 2021 12:12:55 PM org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent closeAsyncInternal
INFO: Closing components.
May 02, 2021 12:12:55 PM org.apache.flink.runtime.filecache.FileCache shutdown
INFO: removed file cache directory /tmp/flink-dist-cache-200ded93-ef16-46dc-9089-ddfcd51123ed
May 02, 2021 12:12:55 PM org.apache.flink.runtime.taskexecutor.TaskExecutor handleOnStopException
INFO: Stopped TaskExecutor akka://flink/user/rpc/taskmanager_80.
May 02, 2021 12:12:55 PM org.apache.flink.runtime.dispatcher.runner.AbstractDispatcherLeaderProcess closeInternal
INFO: Stopping SessionDispatcherLeaderProcess.
May 02, 2021 12:12:55 PM org.apache.flink.runtime.dispatcher.Dispatcher onStop
INFO: Stopping dispatcher akka://flink/user/rpc/dispatcher_82.
May 02, 2021 12:12:55 PM org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl close
INFO: Closing the SlotManager.
May 02, 2021 12:12:55 PM org.apache.flink.runtime.dispatcher.Dispatcher terminateRunningJobs
INFO: Stopping all currently running jobs of dispatcher akka://flink/user/rpc/dispatcher_82.
May 02, 2021 12:12:55 PM org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl suspend
INFO: Suspending the SlotManager.
May 02, 2021 12:12:55 PM org.apache.flink.runtime.rest.handler.legacy.backpressure.BackPressureRequestCoordinator shutDown
INFO: Shutting down back pressure request coordinator.
May 02, 2021 12:12:55 PM org.apache.flink.runtime.dispatcher.Dispatcher lambda$onStop$0
INFO: Stopped dispatcher akka://flink/user/rpc/dispatcher_82.
May 02, 2021 12:12:55 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO: Stopping Akka RPC service.
May 02, 2021 12:12:55 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO: Stopping Akka RPC service.
May 02, 2021 12:12:55 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService lambda$stopService$7
INFO: Stopped Akka RPC service.
May 02, 2021 12:12:55 PM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
May 02, 2021 12:12:55 PM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
May 02, 2021 12:12:55 PM org.apache.flink.runtime.blob.BlobServer close
INFO: Stopped BLOB server at 0.0.0.0:40931
May 02, 2021 12:12:55 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService lambda$stopService$7
INFO: Stopped Akka RPC service.

if [[ "$RUNNER" == "dataflow" ]]; then
  # Delete the container locally and remotely
  docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
  gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"

  if [[ -n "$EXPANSION_ADDR" ]]; then
    # Delete the java cross-language container locally and remotely
    docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
    gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
  fi

  # Clean up tempdir
  rm -rf $TMPDIR
fi

exit $TEST_EXIT_CODE
exit_background_processes

> Task :sdks:go:test:flinkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/build.gradle'> line: 92

* What went wrong:
Execution failed for task ':sdks:go:test:flinkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 12m 33s
139 actionable tasks: 96 executed, 41 from cache, 2 up-to-date
Gradle was unable to watch the file system for changes. The inotify watches limit is too low.

Publishing build scan...
https://gradle.com/s/q3uwqnsw7ahr4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org