You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/02/22 06:14:56 UTC
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #112
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/112/display/redirect>
------------------------------------------
[...truncated 304.84 KB...]
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1698793408/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1698793408/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1698793408/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:169)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1698793408/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f79ccd0a938> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1583393314
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 22, 2019 6:14:26 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@508c1ea5
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1583393314/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1583393314/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1583393314/MANIFEST has 0 artifact locations
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1583393314/MANIFEST -> 0 artifacts
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-3] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-3] INFO sdk_worker_main.start - Status HTTP server running at localhost:41465
[grpc-default-executor-3] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-3] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-3] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1550816065.16', 'job_endpoint': u'localhost:39975'}
[grpc-default-executor-3] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:40461.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-3] INFO data_plane.create_data_channel - Creating channel for localhost:45865
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@6ac96116[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@24dec5c1[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@3b77629e[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@4c18e240[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@6df8eb04[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@3fdacbb7[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@3f393d40[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@3438c205[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f79ccd0a938> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-468263900
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 22, 2019 6:14:41 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@7832d090
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-468263900/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-468263900/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-468263900/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-468263900/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:46617
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1550816079.55', 'job_endpoint': u'localhost:39975'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:33461.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] INFO data_plane.create_data_channel - Creating channel for localhost:36707
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-468263900/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-468263900/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-468263900/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:169)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-468263900/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--955099942 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 195.050s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 387
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 58s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/p4lzp6dcnqs6a
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #189
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/189/display/redirect>
------------------------------------------
[...truncated 306.34 KB...]
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1419934391/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1419934391/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1419934391/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1419934391/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f2dd0e588c0> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-569471537
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 04, 2019 6:08:46 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@33d2e714
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-569471537/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-569471537/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-569471537/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-569471537/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:45395
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551722925.55', 'job_endpoint': u'localhost:54895'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:38823.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:36995
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@4f956362[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@50c5cbde[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@35cf701f[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@2f3120b9[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@4bdbd84e[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@35be71d0[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@7b3fa0f0[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@5dad73c6[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f2dd0e588c0> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-730820478
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 04, 2019 6:09:01 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@3c145179
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-730820478/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-730820478/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-730820478/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-730820478/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:41779
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551722939.99', 'job_endpoint': u'localhost:54895'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:34831.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:37591
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-730820478/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-730820478/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-730820478/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-730820478/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-231398050 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 194.610s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 6s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/b2beyyqzge7tm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #188
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/188/display/redirect>
------------------------------------------
[...truncated 306.89 KB...]
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1104434866/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1104434866/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1104434866/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1104434866/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f37761548c0> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1408670191
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 04, 2019 12:08:46 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@5f4a95a2
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1408670191/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1408670191/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1408670191/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1408670191/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:44843
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551701325.39', 'job_endpoint': u'localhost:57457'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:44117.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:43041
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@6e74cccd[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@6d43ca93[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@756e8431[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@5134054f[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@196eb900[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@6a0affec[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@6b44b190[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@1aabdfca[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f37761548c0> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-2121436502
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 04, 2019 12:09:01 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@209d5f7e
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-2121436502/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-2121436502/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-2121436502/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-2121436502/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:36687
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551701339.91', 'job_endpoint': u'localhost:57457'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:45023.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:33301
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-2121436502/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-2121436502/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-2121436502/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-2121436502/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--1114543016 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 194.057s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 5s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/tc42thvjaecnc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #187
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/187/display/redirect>
------------------------------------------
[...truncated 306.65 KB...]
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-151407545/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-151407545/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-151407545/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-151407545/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f00494188c0> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1673381961
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 04, 2019 6:08:49 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@6268d8e1
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1673381961/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1673381961/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1673381961/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1673381961/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:40265
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551679727.98', 'job_endpoint': u'localhost:42681'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:34921.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:41499
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@16eca643[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@7867b6f7[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@47fbc931[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@610fa0ca[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@12a2dc16[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@57b710bb[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@4e9ce93d[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@520909d4[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f00494188c0> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1535064974
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 04, 2019 6:09:03 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@3bbbbee4
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1535064974/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1535064974/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1535064974/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1535064974/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:45687
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551679742.34', 'job_endpoint': u'localhost:42681'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:36697.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:43467
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1535064974/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1535064974/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1535064974/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1535064974/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-2130466408 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 194.091s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 6s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/4zcvycwdk7pdi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #186
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/186/display/redirect>
------------------------------------------
[...truncated 306.50 KB...]
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1126895568/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1126895568/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1126895568/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1126895568/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fb811c588c0> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-2025946265
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 04, 2019 12:08:51 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@4ff4ab68
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-2025946265/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-2025946265/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-2025946265/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-2025946265/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:39709
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551658129.78', 'job_endpoint': u'localhost:60539'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:32813.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:32893
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@26cceb30[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@65fa7c88[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@344f1521[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@2a717dc2[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@6b2596d7[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@5d8db907[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@11a7598a[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@3019a911[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fb811c588c0> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-523404522
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 04, 2019 12:09:05 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@366b663a
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-523404522/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-523404522/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-523404522/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-523404522/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:40881
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551658144.23', 'job_endpoint': u'localhost:60539'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:36781.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:45135
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-523404522/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-523404522/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-523404522/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-523404522/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-915891708 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 196.199s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 10s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/efoebh3m2su3u
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #185
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/185/display/redirect>
------------------------------------------
[...truncated 306.68 KB...]
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:0:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1263216214/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1263216214/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1263216214/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1263216214/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fe95c8958c0> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1586158284
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 03, 2019 6:08:51 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@4ba7e588
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1586158284/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1586158284/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1586158284/MANIFEST has 0 artifact locations
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1586158284/MANIFEST -> 0 artifacts
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-3] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-3] INFO sdk_worker_main.start - Status HTTP server running at localhost:35835
[grpc-default-executor-3] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-3] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-3] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551636529.94', 'job_endpoint': u'localhost:43701'}
[grpc-default-executor-3] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:38877.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-3] INFO data_plane.create_data_channel - Creating channel for localhost:44489
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@5efed054[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@38c0fbcc[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@f74e45f[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@34314dc0[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@1ce55762[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@23c4d1a9[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@b3a9f92[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@355b9c78[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fe95c8958c0> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-316739858
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 03, 2019 6:09:05 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@54a60cf2
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-316739858/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-316739858/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-316739858/MANIFEST has 0 artifact locations
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-316739858/MANIFEST -> 0 artifacts
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-3] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-3] INFO sdk_worker_main.start - Status HTTP server running at localhost:33123
[grpc-default-executor-3] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-3] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-3] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551636544.38', 'job_endpoint': u'localhost:43701'}
[grpc-default-executor-3] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:46653.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-3] INFO data_plane.create_data_channel - Creating channel for localhost:33857
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-316739858/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-316739858/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-316739858/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-316739858/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--1105481505 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 194.529s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 11s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/gukmbiw7c3ut2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #184
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/184/display/redirect>
------------------------------------------
[...truncated 306.28 KB...]
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1007156126/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1007156126/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1007156126/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1007156126/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f8fe56988c0> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job765311682
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 03, 2019 12:08:40 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@1fcd2f95
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job765311682/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job765311682/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job765311682/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job765311682/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:36283
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551614918.72', 'job_endpoint': u'localhost:52011'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:39185.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:41119
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@7df2cd54[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@38f04c8e[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@1a69f632[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@982f324[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@62f1172d[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@58dfb3c1[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@dd2168e[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@1357dfc3[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f8fe56988c0> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-843515977
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 03, 2019 12:08:54 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@1274655d
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-843515977/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-843515977/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-843515977/MANIFEST has 0 artifact locations
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-843515977/MANIFEST -> 0 artifacts
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-3] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-3] INFO sdk_worker_main.start - Status HTTP server running at localhost:42343
[grpc-default-executor-3] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-3] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-3] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551614933.16', 'job_endpoint': u'localhost:52011'}
[grpc-default-executor-3] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:37197.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] INFO data_plane.create_data_channel - Creating channel for localhost:33661
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-843515977/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-843515977/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-843515977/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-843515977/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--1770359686 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 197.100s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 59s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/5h66je7skufdu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #183
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/183/display/redirect>
------------------------------------------
[...truncated 306.44 KB...]
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:0:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-643464165/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-643464165/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-643464165/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-643464165/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f4587dd88c0> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1314863148
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 03, 2019 6:10:07 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@19e1c7e6
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1314863148/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1314863148/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1314863148/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1314863148/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:45499
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551593406.55', 'job_endpoint': u'localhost:34757'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:40813.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:37347
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@2e5667c6[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@784ad902[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@7face304[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@5097f453[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@4d62d1d0[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@634e93b7[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@7be2f819[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@14b8be5a[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f4587dd88c0> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1116500541
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 03, 2019 6:10:22 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@34e95d57
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1116500541/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1116500541/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1116500541/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1116500541/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:38069
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551593420.96', 'job_endpoint': u'localhost:34757'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:34007.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:39303
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1116500541/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1116500541/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1116500541/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1116500541/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--1530289898 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 194.760s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 10m 27s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/abcqbgvajcipw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #182
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/182/display/redirect>
------------------------------------------
[...truncated 306.71 KB...]
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job431259878/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job431259878/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job431259878/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job431259878/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f0a626188c0> ====================
[grpc-default-executor-4] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-714715337
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 03, 2019 12:09:50 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@49e2e175
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-714715337/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-714715337/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-714715337/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-714715337/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:37605
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551571789.39', 'job_endpoint': u'localhost:33085'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:34237.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:46005
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@6e8af117[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@6ab5681e[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@2fb7fb2c[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@27e9cbc7[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@1e529464[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@5fe6fa28[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@4f980463[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@26c649a4[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f0a626188c0> ====================
[grpc-default-executor-4] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job2086496908
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 03, 2019 12:10:05 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@12b315c6
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job2086496908/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job2086496908/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job2086496908/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job2086496908/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:42225
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551571803.9', 'job_endpoint': u'localhost:33085'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:43197.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:35349
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job2086496908/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job2086496908/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job2086496908/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job2086496908/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--1786389637 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 201.510s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 10m 11s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/zyck6f4vycivw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #181
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/181/display/redirect>
------------------------------------------
[...truncated 307.15 KB...]
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1888549394/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1888549394/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1888549394/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1888549394/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7ffa5b0968c0> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job741465304
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 02, 2019 6:10:48 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@6e7bde6d
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job741465304/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job741465304/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job741465304/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job741465304/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:43319
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551550246.89', 'job_endpoint': u'localhost:32863'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:36041.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:42457
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@10f6a28b[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@55f43ef1[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@39d974a5[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@646b6830[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@41ac7ccc[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@35dbc1be[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@47d5e7fc[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@78c02dde[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7ffa5b0968c0> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-337778371
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 02, 2019 6:11:02 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@1233452e
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-337778371/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-337778371/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-337778371/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-337778371/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:44309
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551550261.33', 'job_endpoint': u'localhost:32863'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:46193.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:36481
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-337778371/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-337778371/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-337778371/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-337778371/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--1056586389 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 199.407s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 11m 8s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/dk42vqd724mqg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #180
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/180/display/redirect>
------------------------------------------
[...truncated 306.69 KB...]
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:0:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job951270701/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job951270701/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job951270701/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job951270701/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f160d6968c0> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1811729838
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 02, 2019 12:08:58 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@58991d06
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1811729838/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1811729838/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1811729838/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1811729838/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:34223
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551528537.26', 'job_endpoint': u'localhost:48999'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:44519.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:37801
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@7ce96fb3[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@78d6e4f6[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@3dd46588[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@3b008f0b[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@ca3fb2f[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@439d4f19[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@5dfb9ac7[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@623c2ea4[Not completed, 1 dependents]}
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f160d6968c0> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-619824926
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 02, 2019 12:09:14 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@343a1658
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-619824926/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-619824926/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-619824926/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-619824926/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:42587
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551528552.66', 'job_endpoint': u'localhost:48999'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:43517.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:33957
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-619824926/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-619824926/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-619824926/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-619824926/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-546479620 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 201.044s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 18s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/2kl6aui2lvlao
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #179
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/179/display/redirect>
------------------------------------------
[...truncated 306.39 KB...]
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:0:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job2103096465/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job2103096465/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job2103096465/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job2103096465/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fb274c968c0> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job763591350
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 02, 2019 6:08:50 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@1553e08b
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job763591350/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job763591350/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job763591350/MANIFEST has 0 artifact locations
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job763591350/MANIFEST -> 0 artifacts
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-3] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-3] INFO sdk_worker_main.start - Status HTTP server running at localhost:39689
[grpc-default-executor-3] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-3] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-3] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551506929.34', 'job_endpoint': u'localhost:33301'}
[grpc-default-executor-3] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:33245.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] INFO data_plane.create_data_channel - Creating channel for localhost:42009
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@769e21df[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@339cb168[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@7de1a686[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@265e14a[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@5f2a800[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@53b34e27[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@23960741[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@ed4cdc8[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fb274c968c0> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1605157506
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 02, 2019 6:09:05 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@549606ee
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1605157506/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1605157506/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1605157506/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1605157506/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:39417
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551506943.7', 'job_endpoint': u'localhost:33301'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:39665.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:43843
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1605157506/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1605157506/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1605157506/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1605157506/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--846628453 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 194.279s
FAILED (errors=1, skipped=17)
Segmentation fault (core dumped)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 139
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 10s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/uor7htshja7ps
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #178
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/178/display/redirect?page=changes>
Changes:
[github] [BEAM-6711] Fix bq_to_table test for google (#7968)
------------------------------------------
[...truncated 306.94 KB...]
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1007841899/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1007841899/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1007841899/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1007841899/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f886e9188c0> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job574117779
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 02, 2019 2:41:37 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@debf151
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job574117779/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job574117779/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job574117779/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job574117779/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:40153
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551494495.78', 'job_endpoint': u'localhost:49725'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:39597.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:38139
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@13405381[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@6fb5e81[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@128763e4[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@67cc58a9[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@7681d38a[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@2a52948d[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@3634a60[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@66f43b5[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f886e9188c0> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job601193413
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 02, 2019 2:41:51 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@44df53f0
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job601193413/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job601193413/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job601193413/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job601193413/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:32793
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551494510.24', 'job_endpoint': u'localhost:49725'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:41729.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:42011
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job601193413/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job601193413/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job601193413/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job601193413/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--646973125 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 194.660s
FAILED (errors=1, skipped=17)
Segmentation fault (core dumped)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 139
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 21s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/ecut4gsiorflg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #177
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/177/display/redirect>
------------------------------------------
[...truncated 306.80 KB...]
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job509185328/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job509185328/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job509185328/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job509185328/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f93257188c0> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1438802598
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 02, 2019 12:08:26 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@5fbb25f9
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1438802598/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1438802598/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1438802598/MANIFEST has 0 artifact locations
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1438802598/MANIFEST -> 0 artifacts
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-3] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-3] INFO sdk_worker_main.start - Status HTTP server running at localhost:39631
[grpc-default-executor-3] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-3] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-3] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551485305.09', 'job_endpoint': u'localhost:40419'}
[grpc-default-executor-3] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:40209.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:38281
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@1cc7db74[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@59c55688[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@32117224[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@68d6ad11[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@4ae8d704[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@39eaa9c7[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@d36c8c[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@5d30f7a2[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f93257188c0> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job409102089
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 02, 2019 12:08:40 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@2fb6dfa3
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job409102089/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job409102089/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job409102089/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job409102089/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:41917
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551485319.47', 'job_endpoint': u'localhost:40419'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:45553.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:32843
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job409102089/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job409102089/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job409102089/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job409102089/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-1087677945 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 198.019s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 45s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/75a5qbzwsnpoi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #176
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/176/display/redirect?page=changes>
Changes:
[amaliujia] add missing bytes
------------------------------------------
[...truncated 307.65 KB...]
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job74531220/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job74531220/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job74531220/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job74531220/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f5492a988c0> ====================
[grpc-default-executor-4] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1372670292
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 9:44:11 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@6a4eb44c
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1372670292/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1372670292/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1372670292/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1372670292/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:38759
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551476650.22', 'job_endpoint': u'localhost:52957'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:42099.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:44575
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@41d6590c[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@45e9c5ee[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@eb5337[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@424c78ea[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@31215796[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@3a6c22e9[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@60c4ac78[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@416e03a2[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f5492a988c0> ====================
[grpc-default-executor-4] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job2067205821
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 9:44:26 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@78e3a217
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job2067205821/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job2067205821/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job2067205821/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job2067205821/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:41299
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551476664.72', 'job_endpoint': u'localhost:52957'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:45821.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:45793
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job2067205821/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job2067205821/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job2067205821/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job2067205821/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-108555339 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 196.053s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 23s
61 actionable tasks: 47 executed, 13 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/2jbcewgrytylg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #175
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/175/display/redirect?page=changes>
Changes:
[kcweaver] [BEAM-6725] share some Flink job invocation code with Samza runner
------------------------------------------
[...truncated 309.69 KB...]
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job418498950/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job418498950/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job418498950/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job418498950/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f40ff6548c0> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-250223245
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 9:22:38 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@71be447e
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-250223245/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-250223245/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-250223245/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-250223245/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:37573
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551475357.36', 'job_endpoint': u'localhost:56755'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:39151.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:35203
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@7f152830[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@7b2ab30a[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@3e28220b[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@59de2cbc[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@fdcdb1f[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@21c08b0d[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@5e07dd44[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@7614a1f4[Not completed, 1 dependents]}
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-4] ERROR sdk_worker_main.main - Python sdk harness failed:
Traceback (most recent call last):
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker_main.py", line 145, in main
sdk_pipeline_options.view_as(pipeline_options.ProfilingOptions))
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 126, in run
for work_request in control_stub.Control(get_responses()):
File "/usr/local/lib/python2.7/site-packages/grpc/_channel.py", line 366, in next
return self._next()
File "/usr/local/lib/python2.7/site-packages/grpc/_channel.py", line 346, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Runner closed connection"
debug_error_string = "{"created":"@1551475361.846554711","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1099,"grpc_message":"Runner closed connection","grpc_status":1}"
>
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f40ff6548c0> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-534217427
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 9:22:54 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@5d5ed98e
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-534217427/MANIFEST
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-534217427/MANIFEST
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-534217427/MANIFEST has 0 artifact locations
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-534217427/MANIFEST -> 0 artifacts
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-4] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-4] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-4] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-4] INFO sdk_worker_main.start - Status HTTP server running at localhost:36305
[grpc-default-executor-4] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-4] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551475372.79', 'job_endpoint': u'localhost:56755'}
[grpc-default-executor-4] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:38305.
[grpc-default-executor-4] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-4] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:38093
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-534217427/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-534217427/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-534217427/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-534217427/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-1065704641 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 206.548s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 11m 0s
61 actionable tasks: 48 executed, 12 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/p7bhtzo73m3zu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #174
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/174/display/redirect?page=changes>
Changes:
[kenn] [BEAM-6554] Adjust Jenkins directory for spotbugs report
------------------------------------------
[...truncated 306.78 KB...]
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job173396926/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job173396926/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job173396926/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job173396926/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f6f926d48c0> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1197672518
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 7:22:14 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@11d6ca6c
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1197672518/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1197672518/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1197672518/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1197672518/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:43533
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551468133.6', 'job_endpoint': u'localhost:50237'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:46101.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:35607
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@4a6634d8[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@597b494f[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@4651fad[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@21627173[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@5a594173[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@59eb5a46[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@75dfbea1[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@4704a080[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f6f926d48c0> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job608233033
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 7:22:29 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@42189e49
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job608233033/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job608233033/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job608233033/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job608233033/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:34675
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551468148.02', 'job_endpoint': u'localhost:50237'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:44673.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:32843
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job608233033/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job608233033/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job608233033/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job608233033/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-45886662 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 195.327s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 51s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/k3wzrtves4bqa
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #173
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/173/display/redirect>
------------------------------------------
[...truncated 306.39 KB...]
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-552277700/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-552277700/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-552277700/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-552277700/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fe45c6588c0> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1420465981
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 6:08:42 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@3f1bc202
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1420465981/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1420465981/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1420465981/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1420465981/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:33725
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551463720.75', 'job_endpoint': u'localhost:36281'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:39101.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:43473
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {12=java.util.concurrent.CompletableFuture@6251464f[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@1237f39b[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@53790245[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@6af5e92f[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@27eb900[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@2ff829ff[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@34887d6f[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fe45c6588c0> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-2113517767
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 6:08:56 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@7da4042
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-2113517767/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-2113517767/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-2113517767/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-2113517767/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:35705
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551463735.13', 'job_endpoint': u'localhost:36281'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:41181.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:46267
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-2113517767/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-2113517767/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-2113517767/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-2113517767/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-422074365 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 195.258s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 2s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/erw3pio3nakk6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #172
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/172/display/redirect?page=changes>
Changes:
[ehudm] Allow setting dataflow_endpoint for Python ITs
------------------------------------------
[...truncated 306.46 KB...]
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job219193627/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job219193627/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job219193627/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job219193627/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f3fe13d88c0> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job788620100
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 5:54:17 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@7b84c260
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job788620100/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job788620100/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job788620100/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job788620100/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:41619
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551462856.14', 'job_endpoint': u'localhost:42411'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:39877.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:34303
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@2d086831[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@71a65021[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@6a895b18[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@58ab064a[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@360ca48e[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@75e8cd36[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@55990908[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@5500cca7[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f3fe13d88c0> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-485656148
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 5:54:31 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@20ca584a
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-485656148/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-485656148/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-485656148/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-485656148/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:35431
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551462870.6', 'job_endpoint': u'localhost:42411'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:35523.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:35821
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-485656148/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-485656148/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-485656148/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-485656148/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-845552830 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 194.303s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 58s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/3p7emctc4qe7a
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #171
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/171/display/redirect?page=changes>
Changes:
[github] Merge pull request #7353: [BEAM-4461] Support inner and outer style
------------------------------------------
[...truncated 308.20 KB...]
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-769404131/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-769404131/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-769404131/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-769404131/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fa1e40558c0> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1457883014
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 3:15:48 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@79ca9d1e
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1457883014/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1457883014/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1457883014/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1457883014/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:33885
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551453347.56', 'job_endpoint': u'localhost:40721'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:34589.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:43195
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@7b390ec2[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@7598056d[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@63124ced[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@4c0bc907[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@7f77915a[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@4af140b4[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@3b751823[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@2924bdbb[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fa1e40558c0> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1658928814
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 3:16:03 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@94de74a
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1658928814/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1658928814/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1658928814/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1658928814/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:33181
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551453362.01', 'job_endpoint': u'localhost:40721'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:44823.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:35091
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1658928814/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1658928814/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1658928814/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1658928814/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-1946223284 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 195.171s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 13s
61 actionable tasks: 50 executed, 10 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/ljjn6b7anrfqg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #170
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/170/display/redirect>
------------------------------------------
[...truncated 306.22 KB...]
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:0:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1535888643/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1535888643/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1535888643/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1535888643/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f3ac59168c0> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1625843654
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 12:08:39 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@7cba47fd
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1625843654/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1625843654/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1625843654/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1625843654/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:36791
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551442118.01', 'job_endpoint': u'localhost:35385'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:44737.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:36643
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@5b551266[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@1a34f3f5[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@4e76a5c0[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@2cae4c4b[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@5f1bad9a[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@628d56d7[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@192ea7e3[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@47bc6c99[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f3ac59168c0> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-438215540
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 12:08:53 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@5ebc6222
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-438215540/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-438215540/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-438215540/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-438215540/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:33261
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551442132.45', 'job_endpoint': u'localhost:35385'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:39473.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:35859
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-438215540/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-438215540/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-438215540/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-438215540/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-371792397 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 197.284s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 56s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/u2umlq32japdm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #169
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/169/display/redirect?page=changes>
Changes:
[ttanay100] Fix link to Design Principles in PTransform Style Guide
[ttanay100] Change text as well
------------------------------------------
[...truncated 306.56 KB...]
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job925593003/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job925593003/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job925593003/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job925593003/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fdf434588c0> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-762797282
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 11:38:57 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@5dfca085
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-762797282/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-762797282/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-762797282/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-762797282/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:38021
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551440336.33', 'job_endpoint': u'localhost:52373'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:37837.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:45875
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@549adfd1[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@d6962dd[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@1fc14ccc[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@4df85d88[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@4f9e77b1[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@9279b15[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@1c9511d1[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fdf434588c0> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1583090287
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 11:39:12 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@7b862de9
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1583090287/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1583090287/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1583090287/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1583090287/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:39991
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551440350.76', 'job_endpoint': u'localhost:52373'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:44893.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:42491
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1583090287/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1583090287/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1583090287/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1583090287/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-405028259 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 194.209s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 7s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/cmdu46l4trjis
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #168
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/168/display/redirect>
------------------------------------------
[...truncated 307.20 KB...]
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-236897036/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-236897036/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-236897036/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-236897036/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f35948d88c0> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1522899299
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 6:08:22 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@b7324cf
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1522899299/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1522899299/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1522899299/MANIFEST has 0 artifact locations
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1522899299/MANIFEST -> 0 artifacts
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-3] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-3] INFO sdk_worker_main.start - Status HTTP server running at localhost:34859
[grpc-default-executor-3] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-3] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-3] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551420501.54', 'job_endpoint': u'localhost:34005'}
[grpc-default-executor-3] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:38533.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] INFO data_plane.create_data_channel - Creating channel for localhost:33485
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@427639af[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@621263be[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@3a0550cb[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@33a4ab3d[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@40ec57a7[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@3112d397[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@21015e76[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@37eaf428[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f35948d88c0> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1105441218
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 6:08:37 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@4dd43c81
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1105441218/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1105441218/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1105441218/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1105441218/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:44013
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551420515.9', 'job_endpoint': u'localhost:34005'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:41439.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:44027
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1105441218/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1105441218/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1105441218/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1105441218/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-1682200073 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 194.976s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 37s
61 actionable tasks: 48 executed, 12 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/zd6zngr2m5rjq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #167
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/167/display/redirect?page=changes>
Changes:
[kenn] [BEAM-6554] Migrate from findbugs to spotbugs
------------------------------------------
[...truncated 340.43 KB...]
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1113994376/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1113994376/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1113994376/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1113994376/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f313bc588c0> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job491703874
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 4:10:38 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@4725486
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job491703874/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job491703874/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job491703874/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job491703874/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:40705
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551413436.99', 'job_endpoint': u'localhost:46915'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:39329.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:36391
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@37a783cf[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@72a51b5f[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@307d0fa4[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@431d2bfe[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@482f61a9[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@128ae410[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@4a52c9ca[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@60ba49a5[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f313bc588c0> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-154127616
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 4:10:52 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@51fd70c1
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-154127616/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-154127616/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-154127616/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-154127616/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:38947
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551413451.42', 'job_endpoint': u'localhost:46915'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:33521.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:38511
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-154127616/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-154127616/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-154127616/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-154127616/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-579455623 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 194.367s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 26s
61 actionable tasks: 59 executed, 1 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/okejxgowmyzpu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #166
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/166/display/redirect>
------------------------------------------
[...truncated 306.46 KB...]
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1044793535/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1044793535/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1044793535/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1044793535/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f45aed588c0> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1330398005
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 12:31:18 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@5565b96c
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1330398005/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1330398005/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1330398005/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1330398005/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:42455
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551400277.39', 'job_endpoint': u'localhost:53899'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:34275.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:40533
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@46d5c7b1[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@42ea4bb3[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@7e8cd8a[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@5ea5e18c[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@36a54da6[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@26023f12[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@67c732c5[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@161f0630[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f45aed588c0> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job447511198
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 12:31:33 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@76cd46ac
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job447511198/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job447511198/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job447511198/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job447511198/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:42399
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551400291.77', 'job_endpoint': u'localhost:53899'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:46639.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:45323
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job447511198/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job447511198/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job447511198/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job447511198/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--1807501300 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 195.534s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 10m 17s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/o66ape5hppros
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #165
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/165/display/redirect?page=changes>
Changes:
[ccy] Allow Python 3.6 jobs on DataflowRunner
[aaltay] [BEAM-6596] Use multiple interpreter versions for SDK release
------------------------------------------
[...truncated 334.60 KB...]
debug_error_string = "{"created":"@1551389354.762145293","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
FAILED (errors=1, skipped=17)
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551389354.762058605","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551389354.762138186","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551389354.762106740","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551389354.762076539","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551389354.762130423","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551389354.762068371","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551389354.762122874","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551389354.762115356","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551389354.762083763","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551389354.762091567","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551389354.762032654","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551389354.762099434","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 59s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/ffvyjlstm24qs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #164
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/164/display/redirect?page=changes>
Changes:
[github] Update dataflowlib comment
------------------------------------------
[...truncated 311.47 KB...]
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1798768990/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f71a0b8cc80> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1669771980
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 28, 2019 7:56:18 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@3495ac82
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1669771980/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1669771980/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1669771980/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1669771980/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:35959
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551383776.86', 'job_endpoint': u'localhost:52851'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:41573.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:45245
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] ERROR data_plane._read_inputs - Failed to read inputs in the data plane
Traceback (most recent call last):
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/data_plane.py", line 271, in _read_inputs
for elements in elements_iterator:
File "/usr/local/lib/python2.7/site-packages/grpc/_channel.py", line 366, in next
return self._next()
File "/usr/local/lib/python2.7/site-packages/grpc/_channel.py", line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1551383783.630178347","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1099,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f71a0b8cc80> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1924911864
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 28, 2019 7:56:41 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@74e14848
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1924911864/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1924911864/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1924911864/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1924911864/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551383793.85', 'job_endpoint': u'localhost:52851'}
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:44385
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:34331.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:37473
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1924911864/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1924911864/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1924911864/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1924911864/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--1530447401 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 210.436s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 50s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/jtqhfdmmdetyk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #163
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/163/display/redirect>
------------------------------------------
[...truncated 306.92 KB...]
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:0:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-112210067/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-112210067/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-112210067/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-112210067/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f90a500bc80> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-919995274
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 28, 2019 6:10:01 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@7bb37214
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-919995274/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-919995274/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-919995274/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-919995274/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:45971
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551377399.85', 'job_endpoint': u'localhost:47645'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:35165.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:34579
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@6f0ef60e[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@36c9d503[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@3e353284[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@4df2d975[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@55d4f843[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@2dcd5e37[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@3a7be818[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@6119a753[Not completed, 1 dependents]}
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f90a500bc80> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-182745289
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 28, 2019 6:10:16 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@f158375
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-182745289/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-182745289/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-182745289/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-182745289/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:44933
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551377415.27', 'job_endpoint': u'localhost:47645'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:39397.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:35469
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-182745289/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-182745289/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-182745289/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-182745289/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-908180173 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 211.264s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 10m 22s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/mrrwai2fi5khi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #162
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/162/display/redirect>
------------------------------------------
[...truncated 308.56 KB...]
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job766079307/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job766079307/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job766079307/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job766079307/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f37a1dccc80> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-569226014
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 28, 2019 12:10:20 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@4b4e69f8
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-569226014/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-569226014/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-569226014/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-569226014/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:36859
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551355819.5', 'job_endpoint': u'localhost:43139'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:44423.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:44957
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@622bad3c[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@25cc3765[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@4d33d8a7[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@3de77cbf[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@29a6472[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@46291c5b[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@158c02d9[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@13088653[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f37a1dccc80> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1996196758
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 28, 2019 12:10:35 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@f4071e7
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1996196758/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1996196758/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1996196758/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1996196758/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:42531
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551355833.88', 'job_endpoint': u'localhost:43139'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:41937.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:41721
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1996196758/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1996196758/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1996196758/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1996196758/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-298439243 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 197.408s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 10m 38s
61 actionable tasks: 56 executed, 4 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/be2kpbzy4bdkc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #161
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/161/display/redirect?page=changes>
Changes:
[mxm] Move abstract methods in JobServerDriver after field declarations
[mxm] [BEAM-6731] Bundle Java ExpansionService with Flink JobServer
------------------------------------------
[...truncated 308.19 KB...]
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1297261212/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1297261212/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1297261212/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1297261212/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f609550cc80> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job466389331
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 28, 2019 9:35:53 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@22f76747
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job466389331/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job466389331/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job466389331/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job466389331/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:33823
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551346552.44', 'job_endpoint': u'localhost:46983'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:35019.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:34233
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@68788879[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@5c0839cc[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@595ae79d[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@24c00897[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@8577736[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@150cf9a9[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@1b64929a[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@3fc4a5d1[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f609550cc80> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job485885983
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 28, 2019 9:36:08 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@613868a7
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job485885983/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job485885983/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job485885983/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job485885983/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:38901
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551346566.92', 'job_endpoint': u'localhost:46983'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:39323.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:41423
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job485885983/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job485885983/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job485885983/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job485885983/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--1995382221 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 198.051s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 34s
61 actionable tasks: 52 executed, 8 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/nses64ftijd64
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #160
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/160/display/redirect?page=changes>
Changes:
[ryan.blake.williams] mv MetricKey from runners/core-construction to core java sdk
[ryan.blake.williams] mv MetricFiltering from runners/core-construction to core java sdk
[ryan.blake.williams] rm empty core/construction/metrics pkg
[ryan.blake.williams] key MetricResult by a MetricKey
------------------------------------------
[...truncated 343.70 KB...]
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1443170989/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1443170989/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1443170989/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1443170989/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f214decdc80> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1893222662
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 28, 2019 9:26:09 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@57b1b832
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1893222662/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1893222662/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1893222662/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1893222662/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:36701
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551345967.93', 'job_endpoint': u'localhost:35877'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:39255.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:40477
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@22d9ffbf[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@57bdfc22[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@13b17b84[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@2f3f26af[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@42f600f0[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@7a92a860[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@62e781ed[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@343bc940[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f214decdc80> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1527314045
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 28, 2019 9:26:24 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@bea2dea
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1527314045/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1527314045/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1527314045/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1527314045/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:33201
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551345983.43', 'job_endpoint': u'localhost:35877'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:36563.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:38947
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1527314045/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1527314045/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1527314045/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1527314045/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--733777891 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 198.237s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 31s
61 actionable tasks: 56 executed, 4 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/5p5rr2bh3dnss
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #159
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/159/display/redirect>
------------------------------------------
[...truncated 306.44 KB...]
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:0:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1167381912/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1167381912/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1167381912/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1167381912/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fcc6e94cc80> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1346879284
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 28, 2019 6:09:05 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@4bc217a8
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1346879284/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1346879284/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1346879284/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1346879284/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:43751
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551334144.3', 'job_endpoint': u'localhost:35445'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:39023.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:42059
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@3c0cf7e[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@7a71fe18[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@9756723[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@2f5d8db3[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@2ae31c19[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@5f17b663[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@7df99edd[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@3e8ab4c4[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fcc6e94cc80> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1977554159
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 28, 2019 6:09:20 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@3737e4e2
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1977554159/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1977554159/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1977554159/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1977554159/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:36427
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551334158.77', 'job_endpoint': u'localhost:35445'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:39375.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:38037
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1977554159/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1977554159/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1977554159/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1977554159/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--651127980 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 198.704s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 23s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/nmfthp6i32f72
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #158
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/158/display/redirect?page=changes>
Changes:
[ehudm] Fix Python 3 compatibility bug in pickler.py
[github] Fixing Python tornadoes test for Google (#7959)
[aaltay] Update python Dataflow API, and add FlexRS pipeline option. (#7932)
------------------------------------------
[...truncated 306.87 KB...]
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-4] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-4] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-4] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-4] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-4] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-4] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-4] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1836425784/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1836425784/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1836425784/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1836425784/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f95f068cc80> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-2081858537
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 28, 2019 12:43:06 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@2af23059
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-2081858537/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-2081858537/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-2081858537/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-2081858537/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:39531
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551314584.49', 'job_endpoint': u'localhost:58891'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:46149.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:34223
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@1bb1efac[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@617a30a7[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@6341e618[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@304f98e4[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@2417cdce[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@14d83ee3[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@78456b46[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@34014412[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f95f068cc80> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1778585616
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 28, 2019 12:43:21 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@3e33cb53
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1778585616/MANIFEST
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1778585616/MANIFEST
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1778585616/MANIFEST has 0 artifact locations
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1778585616/MANIFEST -> 0 artifacts
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-4] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-4] INFO sdk_worker_main.start - Status HTTP server running at localhost:39141
[grpc-default-executor-4] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-4] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-4] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-4] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551314600.07', 'job_endpoint': u'localhost:58891'}
[grpc-default-executor-4] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:42123.
[grpc-default-executor-4] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-4] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-4] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-4] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-4] INFO data_plane.create_data_channel - Creating channel for localhost:32853
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-4] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-4] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-4] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-4] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-4] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-4] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-4] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1778585616/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1778585616/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1778585616/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1778585616/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-534964107 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 217.674s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 46s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/vurcaeak4s2f2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #157
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/157/display/redirect>
------------------------------------------
[...truncated 333.92 KB...]
details = "Socket closed"
debug_error_string = "{"created":"@1551312907.414881485","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551312907.414895970","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551312907.414916239","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551312907.414863690","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551312907.414922613","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551312907.414909834","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551312907.414855424","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551312907.414903707","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551312907.414889643","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551312907.414820342","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551312907.414842683","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551312907.414930057","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551312907.414870929","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 5s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/3cv7ks7xrsvwu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #156
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/156/display/redirect?page=changes>
Changes:
[chamikara] [BEAM-6749] Update BQ tornadoes example to use the storage API. (#7958)
------------------------------------------
[...truncated 307.39 KB...]
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1820920605/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1820920605/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1820920605/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1820920605/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fd851513c08> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1688499445
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 27, 2019 9:27:14 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@3e13755e
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1688499445/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1688499445/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1688499445/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1688499445/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:41579
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551302833.48', 'job_endpoint': u'localhost:50635'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:36953.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:36005
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {12=java.util.concurrent.CompletableFuture@36cbd4d9[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@518a902c[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@67a9cd23[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@2785cd8d[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@4f00a8b8[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@4a8e5a84[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@63e75623[Not completed, 1 dependents]}
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fd851513c08> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1243304799
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 27, 2019 9:27:29 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@38b89817
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1243304799/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1243304799/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1243304799/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1243304799/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:35561
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551302847.94', 'job_endpoint': u'localhost:50635'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:32893.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:33777
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1243304799/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1243304799/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1243304799/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1243304799/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-1533019862 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 194.513s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 27s
61 actionable tasks: 48 executed, 12 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/bmfiflne2wugg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #155
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/155/display/redirect?page=changes>
Changes:
[kenn] Add SonarQube analysis for Java projects (#7463)
------------------------------------------
[...truncated 306.63 KB...]
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1601657788/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1601657788/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1601657788/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1601657788/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f1a48a0ec08> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1191042666
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 27, 2019 8:35:52 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@34655db6
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1191042666/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1191042666/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1191042666/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1191042666/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:44045
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551299751.01', 'job_endpoint': u'localhost:55551'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:33489.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:38939
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@7702ebf8[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@fc730dc[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@463ff91e[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@77107c86[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@172d14b7[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@215a975e[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@18947d62[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@6c14d6ba[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f1a48a0ec08> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job80771674
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 27, 2019 8:36:06 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@730643c1
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job80771674/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job80771674/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job80771674/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job80771674/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:41807
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551299765.47', 'job_endpoint': u'localhost:55551'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:39763.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:45673
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job80771674/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job80771674/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job80771674/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job80771674/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--372568072 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 194.507s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 8s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/bz4sqnfk2dkpy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #154
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/154/display/redirect>
------------------------------------------
[...truncated 306.27 KB...]
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:0:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-787562634/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-787562634/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-787562634/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-787562634/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f456bc96c08> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job286356109
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 27, 2019 6:15:53 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@6a28c757
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job286356109/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job286356109/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job286356109/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job286356109/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:32857
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551291351.71', 'job_endpoint': u'localhost:38777'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:38371.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:37403
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@65714aae[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@2716fd92[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@1bb3e97a[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@ef44c24[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@613f536e[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@7155d8b6[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@75a917df[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@5990e022[Not completed, 1 dependents]}
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f456bc96c08> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1761831434
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 27, 2019 6:16:07 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@5c8247f2
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1761831434/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1761831434/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1761831434/MANIFEST has 0 artifact locations
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1761831434/MANIFEST -> 0 artifacts
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-3] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-3] INFO sdk_worker_main.start - Status HTTP server running at localhost:44829
[grpc-default-executor-3] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-3] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-3] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551291366.17', 'job_endpoint': u'localhost:38777'}
[grpc-default-executor-3] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:39833.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-3] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-3] INFO data_plane.create_data_channel - Creating channel for localhost:34519
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1761831434/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1761831434/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1761831434/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1761831434/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--91577140 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 195.812s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 59s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/bfhtswheitgw2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #153
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/153/display/redirect?page=changes>
Changes:
[reuvenlax] Merge pull request #7939: [BEAM-6705] Fixes
------------------------------------------
[...truncated 307.24 KB...]
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:0:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-743416829/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-743416829/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-743416829/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-743416829/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7faa2460cc08> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1431233148
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 27, 2019 5:05:34 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@1e8562a2
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1431233148/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1431233148/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1431233148/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1431233148/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:40637
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551287132.89', 'job_endpoint': u'localhost:41999'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:33107.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:37065
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@31c06331[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@23ff5da5[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@2b3d774[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@656e5ecd[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@578560ba[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@ece0d9a[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@12da7340[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@555dfe0[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7faa2460cc08> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-443202378
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 27, 2019 5:05:48 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@f1a591c
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-443202378/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-443202378/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-443202378/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-443202378/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:41947
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551287147.32', 'job_endpoint': u'localhost:41999'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:36191.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:42275
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-443202378/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-443202378/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-443202378/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-443202378/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-1106200422 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 194.369s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 10s
61 actionable tasks: 47 executed, 13 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/a24igtimj4sfe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #152
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/152/display/redirect?page=changes>
Changes:
[ryan.blake.williams] move MonitoringInfo protos to model/pipeline module
------------------------------------------
[...truncated 344.42 KB...]
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job983330502/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job983330502/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job983330502/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job983330502/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f36ee4ccc08> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-350603630
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 27, 2019 12:27:13 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@415d3abc
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-350603630/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-350603630/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-350603630/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-350603630/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:38041
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551270432.07', 'job_endpoint': u'localhost:52121'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:40127.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:34287
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@3dbe3949[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@25f24f1b[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@6c574dc4[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@4573077e[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@9cb0ae8[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@3ef6065d[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@6819552a[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@358cf7a0[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f36ee4ccc08> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1274109734
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 27, 2019 12:27:28 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@1463ce9f
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1274109734/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1274109734/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1274109734/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1274109734/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:44139
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551270447.51', 'job_endpoint': u'localhost:52121'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:46179.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:45941
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1274109734/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1274109734/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1274109734/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1274109734/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--607349512 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 199.243s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 10s
61 actionable tasks: 59 executed, 1 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/wl5awtazqvhg4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #151
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/151/display/redirect>
------------------------------------------
[...truncated 308.48 KB...]
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job681279215/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f30e77d3b90> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job833941671
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 27, 2019 12:09:09 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@5c4da878
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job833941671/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job833941671/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job833941671/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job833941671/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:46403
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551269346.8', 'job_endpoint': u'localhost:53109'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:42949.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:45125
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] ERROR data_plane._read_inputs - Failed to read inputs in the data plane
Traceback (most recent call last):
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/data_plane.py", line 271, in _read_inputs
for elements in elements_iterator:
File "/usr/local/lib/python2.7/site-packages/grpc/_channel.py", line 366, in next
return self._next()
File "/usr/local/lib/python2.7/site-packages/grpc/_channel.py", line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1551269353.582813624","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1099,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-worker-ELG-3-15] WARN org.apache.beam.vendor.grpc.v1p13p1.io.netty.channel.nio.NioEventLoop - Selector.select() returned prematurely 512 times in a row; rebuilding Selector org.apache.beam.vendor.grpc.v1p13p1.io.netty.channel.nio.SelectedSelectionKeySetSelector@dc008d4.
[grpc-default-worker-ELG-3-15] INFO org.apache.beam.vendor.grpc.v1p13p1.io.netty.channel.nio.NioEventLoop - Migrated 0 channel(s) to the new Selector.
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f30e77d3b90> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1626980053
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 27, 2019 12:09:27 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@27c39ec3
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1626980053/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1626980053/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1626980053/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1626980053/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:44339
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551269363.74', 'job_endpoint': u'localhost:53109'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:46187.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:38381
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-4] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-4] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-4] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-4] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1626980053/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1626980053/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1626980053/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1626980053/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-991022261 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 218.780s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 32s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/g7ifoq4ig7tcy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #150
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/150/display/redirect?page=changes>
Changes:
[ccy] Use Python 3.6 and 3.7 containers for Dataflow runner
------------------------------------------
[...truncated 305.25 KB...]
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:0:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1373987243/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1373987243/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1373987243/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1373987243/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f674e1d5b90> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job375674344
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 27, 2019 6:59:04 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@5dfdf2b3
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job375674344/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job375674344/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job375674344/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job375674344/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:36199
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551250743.49', 'job_endpoint': u'localhost:56555'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:43727.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:42679
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@1a21a81a[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@1e1e2f86[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@5b1ca221[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@7d7b9c40[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@6a0d9a8d[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@580fa55[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@3b335d6e[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@1a8b4fd4[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f674e1d5b90> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job906015187
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 27, 2019 6:59:19 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@48df03dc
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job906015187/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job906015187/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job906015187/MANIFEST has 0 artifact locations
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job906015187/MANIFEST -> 0 artifacts
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-3] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-3] INFO sdk_worker_main.start - Status HTTP server running at localhost:40525
[grpc-default-executor-3] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-3] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-3] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551250757.86', 'job_endpoint': u'localhost:56555'}
[grpc-default-executor-3] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:43489.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-3] INFO data_plane.create_data_channel - Creating channel for localhost:33933
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job906015187/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job906015187/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job906015187/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job906015187/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-699627798 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 194.124s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 34s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/kxzt5udsqpque
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #149
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/149/display/redirect>
------------------------------------------
[...truncated 305.56 KB...]
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1144023342/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1144023342/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1144023342/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1144023342/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f10a83d4b90> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1265452172
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 27, 2019 6:10:07 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@5de2fedc
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1265452172/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1265452172/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1265452172/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1265452172/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:39475
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551247805.79', 'job_endpoint': u'localhost:54959'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:44319.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:42369
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@24c17905[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@134c9f7c[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@152f7ba8[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@6b48c377[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@44ee864a[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@332e46d4[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@5db28922[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@704caa98[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f10a83d4b90> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job848002640
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 27, 2019 6:10:21 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@6d16776a
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job848002640/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job848002640/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job848002640/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job848002640/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:43079
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551247820.18', 'job_endpoint': u'localhost:54959'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:33853.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:42717
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job848002640/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job848002640/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job848002640/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job848002640/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--1721945117 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 198.563s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 10m 12s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/xzmjek7yivs7o
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #148
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/148/display/redirect>
------------------------------------------
[...truncated 332.91 KB...]
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551226230.722509980","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551226230.722503909","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551226230.722577707","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551226230.722536654","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551226230.722530920","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551226230.722472981","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
======================================================================
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551226230.722524537","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551226230.722570195","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551226230.722551180","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
----------------------------------------------------------------------
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551226230.722585221","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-223814351 failed in state FAILED: unknown error
----------------------------------------------------------------------Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551226230.722495624","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Ran 30 tests in 194.072s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 45s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/f3eic4yiy6bou
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #147
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/147/display/redirect?page=changes>
Changes:
[danduong] Make data size a criteria for batches when writing with bigqueryio.
[danduong] removed some debug code
[danduong] Updating the size calculation to be more accurate
[danduong] Adding some padding to account for overall message overhead.
[danduong] Forgot to reset size to initial size.
[danduong] Setting the write overhead to a constant.
------------------------------------------
[...truncated 305.60 KB...]
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-24806052/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-24806052/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-24806052/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-24806052/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f6f6ff94b90> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1452111903
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 26, 2019 9:20:49 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@4b9b763a
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1452111903/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1452111903/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1452111903/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1452111903/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:37147
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551216047.97', 'job_endpoint': u'localhost:39749'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:37817.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:35875
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@5a485b03[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@74e112c7[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@7c1907e0[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@436bf823[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@5b63330e[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@27e8658f[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@13fa5095[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@fcc0829[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f6f6ff94b90> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job464762539
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 26, 2019 9:21:03 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@36f624ce
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job464762539/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job464762539/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job464762539/MANIFEST has 0 artifact locations
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job464762539/MANIFEST -> 0 artifacts
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-3] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-3] INFO sdk_worker_main.start - Status HTTP server running at localhost:41637
[grpc-default-executor-3] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-3] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-3] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551216062.36', 'job_endpoint': u'localhost:39749'}
[grpc-default-executor-3] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:43395.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] INFO data_plane.create_data_channel - Creating channel for localhost:39245
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job464762539/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job464762539/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job464762539/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job464762539/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--762538836 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 194.216s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 6s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/evsrrg2khrd6m
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #146
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/146/display/redirect>
------------------------------------------
[...truncated 306.09 KB...]
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1759025793/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1759025793/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1759025793/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1759025793/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f953a394b90> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-878147206
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 26, 2019 6:09:55 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@2da98562
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-878147206/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-878147206/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-878147206/MANIFEST has 0 artifact locations
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-878147206/MANIFEST -> 0 artifacts
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-3] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-3] INFO sdk_worker_main.start - Status HTTP server running at localhost:40705
[grpc-default-executor-3] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-3] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-3] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551204594.23', 'job_endpoint': u'localhost:44261'}
[grpc-default-executor-3] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:34561.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] INFO data_plane.create_data_channel - Creating channel for localhost:38811
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {12=java.util.concurrent.CompletableFuture@1c1e169a[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@aa458ea[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@102f36c4[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@3b1a955[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@6ff7c57f[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@473cb363[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@2ecc3456[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f953a394b90> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1272768268
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 26, 2019 6:10:09 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@1e50d687
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1272768268/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1272768268/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1272768268/MANIFEST has 0 artifact locations
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1272768268/MANIFEST -> 0 artifacts
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-3] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-3] INFO sdk_worker_main.start - Status HTTP server running at localhost:36281
[grpc-default-executor-3] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-3] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-3] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551204608.61', 'job_endpoint': u'localhost:44261'}
[grpc-default-executor-3] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:40199.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] INFO data_plane.create_data_channel - Creating channel for localhost:46753
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1272768268/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1272768268/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1272768268/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1272768268/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--841455229 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 198.527s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 10m 13s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/yhvplvicfywg4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #145
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/145/display/redirect?page=changes>
Changes:
[srfrnk] [BEAM-6324] Add filter to query for CassandraIO.Read
------------------------------------------
[...truncated 305.97 KB...]
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1405451846/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1405451846/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1405451846/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1405451846/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fe672f94b90> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-876561659
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 26, 2019 2:49:46 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@3e2d7565
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-876561659/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-876561659/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-876561659/MANIFEST has 0 artifact locations
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-876561659/MANIFEST -> 0 artifacts
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-3] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-3] INFO sdk_worker_main.start - Status HTTP server running at localhost:44351
[grpc-default-executor-3] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-3] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-3] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551192585.38', 'job_endpoint': u'localhost:43863'}
[grpc-default-executor-3] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:39631.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] INFO data_plane.create_data_channel - Creating channel for localhost:35457
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@2f204485[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@7b6bef57[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@79becf53[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@5354f341[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@7efd91c2[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@5ac8c81d[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@55834040[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fe672f94b90> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-619942847
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 26, 2019 2:50:01 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@31610465
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-619942847/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-619942847/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-619942847/MANIFEST has 0 artifact locations
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-619942847/MANIFEST -> 0 artifacts
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-3] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-3] INFO sdk_worker_main.start - Status HTTP server running at localhost:45311
[grpc-default-executor-3] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-3] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-3] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551192599.77', 'job_endpoint': u'localhost:43863'}
[grpc-default-executor-3] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:33677.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] INFO data_plane.create_data_channel - Creating channel for localhost:45811
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-619942847/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-619942847/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-619942847/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-619942847/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--746096570 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 194.494s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 54s
61 actionable tasks: 47 executed, 13 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/wyyentyqifb2k
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #144
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/144/display/redirect?page=changes>
Changes:
[ryan.blake.williams] Add MetricQueryResults.allMetrics() helper
------------------------------------------
[...truncated 342.39 KB...]
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-45077427/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-45077427/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-45077427/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-45077427/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fc1b3613b90> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1863183826
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 26, 2019 12:43:43 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@787d7da7
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1863183826/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1863183826/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1863183826/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1863183826/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:42569
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551185022.48', 'job_endpoint': u'localhost:33263'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:46391.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:42633
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@282218a4[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@6804b9c8[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@79def81f[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@6581ea9[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@3e87c1fe[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@7300f51f[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@7d90e560[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@3bfb012d[Not completed, 1 dependents]}
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fc1b3613b90> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1986333006
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 26, 2019 12:43:58 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@eeface0
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1986333006/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1986333006/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1986333006/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1986333006/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:34919
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551185036.89', 'job_endpoint': u'localhost:33263'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:36575.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:33823
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1986333006/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1986333006/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1986333006/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1986333006/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-291187468 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 194.607s
FAILED (errors=1, skipped=17)
Segmentation fault (core dumped)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 139
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 47s
61 actionable tasks: 56 executed, 4 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/hd2y5lypy45g4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #143
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/143/display/redirect>
------------------------------------------
[...truncated 333.43 KB...]
details = "Socket closed"
debug_error_string = "{"created":"@1551183064.037955116","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551183064.037866872","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551183064.037936427","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551183064.037921390","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Socket closed","grpc_status":14}"
>
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551183064.037912519","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Socket closed","grpc_status":14}"
>
----------------------------------------------------------------------
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551183064.037961303","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551183064.037942115","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551183064.037928613","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Socket closed","grpc_status":14}"
>
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-447953058 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 195.527sException in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551183064.037949246","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551183064.037886249","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551183064.037894914","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Socket closed","grpc_status":14}"
>
FAILED (errors=1, skipped=17)Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551183064.037903159","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Socket closed","grpc_status":14}"
>
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 10m 47s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/cpctruotx6wbu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #142
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/142/display/redirect?page=changes>
Changes:
[chamikara] Upgrades gcsio to 1.9.16
------------------------------------------
[...truncated 305.33 KB...]
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1844779559/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1844779559/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1844779559/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1844779559/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7ff853114b90> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1525309446
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 26, 2019 7:23:09 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@66b55072
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1525309446/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1525309446/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1525309446/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1525309446/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:43375
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551165788.54', 'job_endpoint': u'localhost:56467'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:32869.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:38641
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {12=java.util.concurrent.CompletableFuture@3e519ad0[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@57d883e3[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@69d8ad04[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@8aadcf7[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@3a1f4028[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@29cb1b13[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@5d723a3[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@5bc41a8a[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7ff853114b90> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1863368416
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 26, 2019 7:23:24 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@6d67775d
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1863368416/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1863368416/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1863368416/MANIFEST has 0 artifact locations
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1863368416/MANIFEST -> 0 artifacts
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-3] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-3] INFO sdk_worker_main.start - Status HTTP server running at localhost:34367
[grpc-default-executor-3] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-3] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-3] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551165802.92', 'job_endpoint': u'localhost:56467'}
[grpc-default-executor-3] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:45767.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-3] INFO data_plane.create_data_channel - Creating channel for localhost:46659
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1863368416/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1863368416/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1863368416/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1863368416/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--1159856270 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 194.083s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 52s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/yjku76hkqtpay
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #141
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/141/display/redirect>
------------------------------------------
[...truncated 304.87 KB...]
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:0:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-2086786107/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-2086786107/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-2086786107/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-2086786107/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fd262695b90> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1626982053
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 26, 2019 6:08:44 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@75184f3c
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1626982053/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1626982053/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1626982053/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1626982053/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:33797
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551161322.76', 'job_endpoint': u'localhost:51529'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:45783.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:44697
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@57d5911c[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@53ea0f3e[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@16e89b27[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@5c12ada0[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@27348a4f[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@2424e268[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@76c76468[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@3f71b8bd[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fd262695b90> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-701063258
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 26, 2019 6:08:58 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@59b67008
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-701063258/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-701063258/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-701063258/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-701063258/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:39769
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551161337.14', 'job_endpoint': u'localhost:51529'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:37051.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:46795
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-701063258/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-701063258/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-701063258/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-701063258/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-376890465 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 196.704s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 3s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/fvqiqz4f72vhy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #140
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/140/display/redirect?page=changes>
Changes:
[robert] [BEAM-6738] Cache Combine Invokers.
[juta_staes] [BEAM-5627][BEAM-6569] run gcsio tests
[juta_staes] [BEAM-5315] add all tests to py3-gcp tox
[robert] Do not evict current working key.
------------------------------------------
[...truncated 305.33 KB...]
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job214936090/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job214936090/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job214936090/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job214936090/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fbd40d15b90> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1476422268
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 26, 2019 3:25:10 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@562c2f11
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1476422268/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1476422268/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1476422268/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1476422268/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:41943
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551151508.82', 'job_endpoint': u'localhost:48499'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:33089.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-3] INFO data_plane.create_data_channel - Creating channel for localhost:45545
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {12=java.util.concurrent.CompletableFuture@35ec5615[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@5ec04495[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@4d23e5ea[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@fca569a[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@58c1e588[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@4f9f6e9[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@56274f29[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@b84adf1[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fbd40d15b90> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job981116500
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 26, 2019 3:25:26 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@1e2bb6fe
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job981116500/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job981116500/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job981116500/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job981116500/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:44363
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551151525.21', 'job_endpoint': u'localhost:48499'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:37437.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:33903
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job981116500/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job981116500/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job981116500/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job981116500/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--403796052 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 208.345s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 18s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/t4rz4sdkrbhjc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #139
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/139/display/redirect>
------------------------------------------
[...truncated 305.26 KB...]
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1628454246/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1628454246/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1628454246/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1628454246/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fb3bda15b90> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-346813017
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 26, 2019 12:09:10 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@1319364e
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-346813017/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-346813017/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-346813017/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-346813017/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:41853
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551139749.39', 'job_endpoint': u'localhost:47129'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:33201.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:33367
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@198b603f[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@238355d3[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@524fe1eb[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@5f8d9453[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@1dc59d05[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@24d17ea3[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@9bc836b[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@3a20a103[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fb3bda15b90> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1785231317
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 26, 2019 12:09:25 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@75b90aee
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1785231317/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1785231317/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1785231317/MANIFEST has 0 artifact locations
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1785231317/MANIFEST -> 0 artifacts
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-3] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-3] INFO sdk_worker_main.start - Status HTTP server running at localhost:44489
[grpc-default-executor-3] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-3] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-3] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551139763.8', 'job_endpoint': u'localhost:47129'}
[grpc-default-executor-3] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:37285.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] INFO data_plane.create_data_channel - Creating channel for localhost:44789
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1785231317/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1785231317/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1785231317/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1785231317/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-1981946376 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 197.636s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 26s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/ir5rhwfpkhlm2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #138
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/138/display/redirect?page=changes>
Changes:
[github] [BEAM-6736] Upgrade gcsio dependency to 1.9.15
------------------------------------------
[...truncated 344.03 KB...]
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job2112086797/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job2112086797/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job2112086797/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job2112086797/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f3fbbcd5b90> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job441446147
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 25, 2019 6:13:51 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@1e1a3d9a
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job441446147/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job441446147/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job441446147/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job441446147/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:44117
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551118429.98', 'job_endpoint': u'localhost:43921'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:43447.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:35573
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@622794b3[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@27250693[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@3093d453[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@16c8e3a5[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@48946fc3[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@470af9dc[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@69958c22[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@38118f7e[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f3fbbcd5b90> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job898471859
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 25, 2019 6:14:06 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@3200476a
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job898471859/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job898471859/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job898471859/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job898471859/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:46523
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551118445.47', 'job_endpoint': u'localhost:43921'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:38819.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:43849
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job898471859/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job898471859/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job898471859/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job898471859/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-1093973588 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 199.559s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 9s
61 actionable tasks: 59 executed, 1 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/c3osnva2bzfe2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #137
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/137/display/redirect?page=changes>
Changes:
[amaliujia] [sql][hotifx] remove less useful comments
[amaliujia] update
------------------------------------------
[...truncated 332.55 KB...]
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551116821.770788405","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551116821.770733906","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551116821.770782039","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551116821.770767500","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551116821.770752521","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551116821.770727275","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551116821.770775799","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551116821.770795004","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551116821.770710811","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551116821.770807061","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 386, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1551116821.770801064","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Socket closed","grpc_status":14}"
>
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-2003205371 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 195.499s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 10m 0s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/ceqzrelutmtms
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #136
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/136/display/redirect>
------------------------------------------
[...truncated 305.10 KB...]
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:0:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job268422318/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job268422318/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job268422318/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job268422318/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f39dbb53b90> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1879059256
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 25, 2019 12:08:42 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@2bea4e65
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1879059256/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1879059256/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1879059256/MANIFEST has 0 artifact locations
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1879059256/MANIFEST -> 0 artifacts
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-3] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-3] INFO sdk_worker_main.start - Status HTTP server running at localhost:38595
[grpc-default-executor-3] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-3] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-3] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551096520.68', 'job_endpoint': u'localhost:46249'}
[grpc-default-executor-3] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:46477.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] INFO data_plane.create_data_channel - Creating channel for localhost:33775
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@564dd9c[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@3e4557b4[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@34ab5b34[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@46608fbe[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@654b22d3[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@71a72139[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@1fbba6c2[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f39dbb53b90> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job446601009
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 25, 2019 12:08:56 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@7e0fcae6
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job446601009/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job446601009/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job446601009/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job446601009/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:32961
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551096535.07', 'job_endpoint': u'localhost:46249'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:36947.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:41323
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job446601009/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job446601009/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job446601009/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job446601009/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-247319021 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 196.774s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 1s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/rwnlbo3saxohq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #135
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/135/display/redirect>
------------------------------------------
[...truncated 305.33 KB...]
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job385687257/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job385687257/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job385687257/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job385687257/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fc766715b90> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-718981160
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 25, 2019 6:08:42 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@2f8a356a
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-718981160/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-718981160/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-718981160/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-718981160/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:36939
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551074920.98', 'job_endpoint': u'localhost:56867'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:36877.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:46615
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@6916839[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@30789574[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@7eb073f9[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@619c2f59[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@6c4153f3[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@1866b83a[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@65b43f74[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@65d2327c[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fc766715b90> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1078718944
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 25, 2019 6:08:56 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@7575f8c8
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1078718944/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1078718944/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1078718944/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1078718944/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:41663
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551074935.35', 'job_endpoint': u'localhost:56867'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:39927.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:39505
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1078718944/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1078718944/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1078718944/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1078718944/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-1313073122 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 195.108s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 59s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/qjpwrsrxwa4co
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #134
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/134/display/redirect?page=changes>
Changes:
[kenn] [BEAM-6718] Fix BigQuery SQL postcommit (#7904)
------------------------------------------
[...truncated 305.63 KB...]
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job492122241/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job492122241/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job492122241/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job492122241/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7ff422413b90> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-229413434
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 25, 2019 4:02:04 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@38975595
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-229413434/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-229413434/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-229413434/MANIFEST has 0 artifact locations
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-229413434/MANIFEST -> 0 artifacts
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-3] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-3] INFO sdk_worker_main.start - Status HTTP server running at localhost:40681
[grpc-default-executor-3] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-3] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-3] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551067323.22', 'job_endpoint': u'localhost:34795'}
[grpc-default-executor-3] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:41179.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] INFO data_plane.create_data_channel - Creating channel for localhost:37061
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {12=java.util.concurrent.CompletableFuture@a0f000c[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@36528a4[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@5a287e1a[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@7c3c0e49[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@e417ea2[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@24cb47c6[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@3d8a35eb[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@21d82a55[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7ff422413b90> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1592859528
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 25, 2019 4:02:19 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@7b12b78b
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1592859528/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1592859528/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1592859528/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1592859528/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:46593
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551067337.63', 'job_endpoint': u'localhost:34795'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:37887.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:46155
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1592859528/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1592859528/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1592859528/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1592859528/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--31974457 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 194.690s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 50s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/vz2ekqcc3fcy4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #133
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/133/display/redirect>
------------------------------------------
[...truncated 305.29 KB...]
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:0:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1937089836/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1937089836/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1937089836/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1937089836/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f62852d4b90> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-915976343
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 25, 2019 12:08:33 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@adbaaf0
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-915976343/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-915976343/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-915976343/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-915976343/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:35835
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551053312.02', 'job_endpoint': u'localhost:38157'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:40445.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:33935
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@24d39a47[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@20ec1a05[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@65ee907c[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@6c78da6d[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@54c17407[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@14bd60a8[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@5c16f33[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@2fc06654[Not completed, 1 dependents]}
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f62852d4b90> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-954357069
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 25, 2019 12:08:47 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@5118ecf2
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-954357069/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-954357069/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-954357069/MANIFEST has 0 artifact locations
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-954357069/MANIFEST -> 0 artifacts
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-3] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-3] INFO sdk_worker_main.start - Status HTTP server running at localhost:35359
[grpc-default-executor-3] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-3] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-3] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551053326.4', 'job_endpoint': u'localhost:38157'}
[grpc-default-executor-3] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:37009.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-3] INFO data_plane.create_data_channel - Creating channel for localhost:44317
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-954357069/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-954357069/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-954357069/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-954357069/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--1272224008 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 195.829s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 53s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/f2a3vzrkrvdya
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #132
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/132/display/redirect?page=changes>
Changes:
[sekikn] [BEAM-6432] Set dependent libraries' versions for the starter archetype
------------------------------------------
[...truncated 305.23 KB...]
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job625506836/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job625506836/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job625506836/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job625506836/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f09c4054b90> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1167810174
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 24, 2019 8:01:24 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@489dac34
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1167810174/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1167810174/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1167810174/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1167810174/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:37989
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551038482.86', 'job_endpoint': u'localhost:37253'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:46061.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:45271
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@3e8b2451[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@60088370[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@53dbd6aa[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@7309f26a[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@14c7f9f6[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@30f0eb1d[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@3d13052f[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@1b52a45[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f09c4054b90> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1255393804
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 24, 2019 8:01:38 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@6e97ee5c
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1255393804/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1255393804/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1255393804/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1255393804/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:40761
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551038497.24', 'job_endpoint': u'localhost:37253'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:44439.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:44361
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1255393804/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1255393804/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1255393804/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1255393804/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--1271708383 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 196.244s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 52s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/umhmudg5tl65i
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #131
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/131/display/redirect?page=changes>
Changes:
[github] Update user-defined-function documentation
------------------------------------------
[...truncated 305.99 KB...]
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:0:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1157385660/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1157385660/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1157385660/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1157385660/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f8485594b90> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1174622411
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 24, 2019 7:52:21 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@6a8a9ec1
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1174622411/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1174622411/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1174622411/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1174622411/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:46649
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551037940.18', 'job_endpoint': u'localhost:51491'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:44465.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:41881
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@4ddb98d1[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@49e405b2[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@ce692ea[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@2c2c97ca[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@3d209f8e[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@5400c40d[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@6cc96da5[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@24133531[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f8485594b90> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-751887775
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 24, 2019 7:52:35 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@792c0e58
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-751887775/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-751887775/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-751887775/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-751887775/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:37819
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551037954.56', 'job_endpoint': u'localhost:51491'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:33969.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:45733
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-751887775/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-751887775/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-751887775/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-751887775/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-1579671820 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 198.038s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 58s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/erkoh3tlyboxe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #130
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/130/display/redirect>
------------------------------------------
[...truncated 305.30 KB...]
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:0:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1778121883/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1778121883/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1778121883/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1778121883/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7ff971315b90> ====================
[grpc-default-executor-4] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-77761070
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 24, 2019 6:08:46 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@7935bd37
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-77761070/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-77761070/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-77761070/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-77761070/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:36453
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551031725.2', 'job_endpoint': u'localhost:59267'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:33785.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:39525
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {12=java.util.concurrent.CompletableFuture@3fb62f8a[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@3b89bca4[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@7e8b25b1[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@41fb82c3[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@4f3f3f09[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@39a5c6d6[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@1ea4dafe[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@3d4ae73[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7ff971315b90> ====================
[grpc-default-executor-4] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job331053127
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 24, 2019 6:09:00 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@a57113c
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job331053127/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job331053127/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job331053127/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job331053127/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:45215
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551031739.56', 'job_endpoint': u'localhost:59267'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:45465.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:34781
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job331053127/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job331053127/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job331053127/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job331053127/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--20001764 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 196.593s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 5s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/yn2rr5ulg43d6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #129
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/129/display/redirect>
------------------------------------------
[...truncated 306.18 KB...]
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:0:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-4] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-4] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-4] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-4] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job387862472/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job387862472/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job387862472/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job387862472/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fce93855b90> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1850164974
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 24, 2019 1:54:29 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@6224349c
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1850164974/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1850164974/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1850164974/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1850164974/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:36561
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551016468.4', 'job_endpoint': u'localhost:52501'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:32887.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:35731
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@70f5db8a[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@7bb72215[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@5a1f35c2[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@2a4c6096[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@74bbc7de[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@36def4d6[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@15cc66ea[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@5ccdec15[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fce93855b90> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1292485436
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 24, 2019 1:54:45 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@5a211407
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1292485436/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1292485436/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1292485436/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1292485436/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:46625
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551016483.77', 'job_endpoint': u'localhost:52501'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:33117.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:40145
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1292485436/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1292485436/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1292485436/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1292485436/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--38045807 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 213.426s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 34s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/pvwawu4a5rra6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #128
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/128/display/redirect>
------------------------------------------
[...truncated 304.80 KB...]
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job587388434/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job587388434/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job587388434/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job587388434/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fb6bfb93b90> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1733245740
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 24, 2019 6:08:51 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@5d632895
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1733245740/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1733245740/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1733245740/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1733245740/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:43055
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1550988530.26', 'job_endpoint': u'localhost:37927'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:41569.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:38435
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@7dea2fa2[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@732dde6f[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@771244d2[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@3210d454[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@1eab6a8b[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@3e80197[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@66b9e1ec[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@523f2b1b[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fb6bfb93b90> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job685844592
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 24, 2019 6:09:05 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@7c2bab40
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job685844592/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job685844592/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job685844592/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job685844592/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:38639
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1550988544.65', 'job_endpoint': u'localhost:37927'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:36795.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:41543
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job685844592/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job685844592/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job685844592/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job685844592/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--1128710611 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 202.478s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 5s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/enqhnshu6qzh4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #127
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/127/display/redirect>
------------------------------------------
[...truncated 305.51 KB...]
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1595571014/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1595571014/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1595571014/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1595571014/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fca85e53b90> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1646724855
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 24, 2019 12:08:46 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@7bb24f1b
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1646724855/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1646724855/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1646724855/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1646724855/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:42839
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1550966925.47', 'job_endpoint': u'localhost:54513'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:34985.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:36967
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@534b832c[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@57740d9d[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@12768917[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@2c733eba[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@232e9afb[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@54c173e6[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@72597658[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@47ea0047[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fca85e53b90> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1811177917
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 24, 2019 12:09:01 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@799fa064
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1811177917/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1811177917/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1811177917/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1811177917/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:41049
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1550966939.89', 'job_endpoint': u'localhost:54513'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:43453.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:44159
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1811177917/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1811177917/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1811177917/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1811177917/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-178901245 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 196.657s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 6s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/eqouklqd35b3w
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #126
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/126/display/redirect>
------------------------------------------
[...truncated 304.81 KB...]
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1872262354/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1872262354/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1872262354/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1872262354/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f6e22d54b90> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-588089481
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 23, 2019 6:08:55 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@5e182015
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-588089481/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-588089481/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-588089481/MANIFEST has 0 artifact locations
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-588089481/MANIFEST -> 0 artifacts
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-3] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-3] INFO sdk_worker_main.start - Status HTTP server running at localhost:33903
[grpc-default-executor-3] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-3] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-3] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1550945334.22', 'job_endpoint': u'localhost:57841'}
[grpc-default-executor-3] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:35893.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] INFO data_plane.create_data_channel - Creating channel for localhost:42709
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@359b27ec[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@4607ce9c[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@56874e2e[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@55967a46[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@39de935f[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@41d5d9d6[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@2dcf09fc[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@4b6d0249[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f6e22d54b90> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-620669231
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 23, 2019 6:09:09 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@49c0c56b
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-620669231/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-620669231/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-620669231/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-620669231/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:39743
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1550945348.63', 'job_endpoint': u'localhost:57841'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:38703.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:34827
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-620669231/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-620669231/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-620669231/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-620669231/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--582291113 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 198.377s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 6s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/jup3k7m7bbrcm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #125
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/125/display/redirect>
------------------------------------------
[...truncated 305.78 KB...]
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:0:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job378594890/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job378594890/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job378594890/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job378594890/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f757c993b90> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job69716141
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 23, 2019 12:08:59 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@3e1b85a3
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job69716141/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job69716141/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job69716141/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job69716141/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:37179
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1550923737.73', 'job_endpoint': u'localhost:49377'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:43541.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:42631
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@65737ce[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@43433ef5[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@d8c09ce[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@7f99e4f0[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@404f558a[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@1a216fe0[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@778ed713[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@47000376[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f757c993b90> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job458799465
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 23, 2019 12:09:13 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@745e76d0
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job458799465/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job458799465/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job458799465/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job458799465/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:38253
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1550923752.11', 'job_endpoint': u'localhost:49377'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:34615.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:37303
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job458799465/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job458799465/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job458799465/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job458799465/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--1310737828 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 195.191s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 16s
61 actionable tasks: 47 executed, 13 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/27yrllnozs7w6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #124
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/124/display/redirect?page=changes>
Changes:
[kcweaver] move shareable code from Flink runner to JobServerDriver
------------------------------------------
[...truncated 305.95 KB...]
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-925674311/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-925674311/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-925674311/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-925674311/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f4e7d8d5b90> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-403771729
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 23, 2019 10:47:32 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@47cf0ea3
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-403771729/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-403771729/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-403771729/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-403771729/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:35375
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1550918850.67', 'job_endpoint': u'localhost:54655'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:36313.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:43503
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@7e8bfa93[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@7ab4719a[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@3fb6f0a8[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@2fbd26fe[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@ec30ef8[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@5722861b[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@5f990fe7[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@1955483c[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f4e7d8d5b90> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job960401674
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 23, 2019 10:47:46 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@5c9f9cac
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job960401674/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job960401674/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job960401674/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job960401674/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:39841
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1550918865.07', 'job_endpoint': u'localhost:54655'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:36407.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:37713
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job960401674/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job960401674/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job960401674/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job960401674/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--640424207 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 194.662s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 59s
61 actionable tasks: 48 executed, 12 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/g47jn3hisnuzy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #123
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/123/display/redirect>
------------------------------------------
[...truncated 307.11 KB...]
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1497049692/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1497049692/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1497049692/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:169)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1497049692/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f0b8db16b90> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job578495211
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 23, 2019 6:08:31 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@4d91258e
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job578495211/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job578495211/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job578495211/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job578495211/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:32961
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1550902110.32', 'job_endpoint': u'localhost:60537'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:37107.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:38213
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@468fe4d7[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@72ff96a6[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@171da9f3[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@5eafa203[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@673f4c5d[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@69fbbcba[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@1353d247[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@304fc594[Not completed, 1 dependents]}
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] ERROR sdk_worker_main.main - Python sdk harness failed:
Traceback (most recent call last):
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker_main.py", line 145, in main
sdk_pipeline_options.view_as(pipeline_options.ProfilingOptions))
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 126, in run
for work_request in control_stub.Control(get_responses()):
File "/usr/local/lib/python2.7/site-packages/grpc/_channel.py", line 366, in next
return self._next()
File "/usr/local/lib/python2.7/site-packages/grpc/_channel.py", line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Runner closed connection"
debug_error_string = "{"created":"@1550902115.898973199","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1099,"grpc_message":"Runner closed connection","grpc_status":1}"
>
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f0b8db16b90> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1127998737
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 23, 2019 6:08:48 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@221a2b0f
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1127998737/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1127998737/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1127998737/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1127998737/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:42923
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1550902126.8', 'job_endpoint': u'localhost:60537'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:43471.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:42043
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1127998737/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1127998737/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1127998737/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:169)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1127998737/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--345316843 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 202.467s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 52s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/rhfl36bsjd4iu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #122
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/122/display/redirect?page=changes>
Changes:
[robert] [BEAM-4468] Add lifting cache cap and random eviction policy
------------------------------------------
[...truncated 305.51 KB...]
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job332017319/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job332017319/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job332017319/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:169)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job332017319/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f8027393b90> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1133217890
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 23, 2019 1:16:09 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@53e61ac6
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1133217890/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1133217890/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1133217890/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1133217890/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:40671
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1550884567.67', 'job_endpoint': u'localhost:43093'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:37389.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:38529
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@6a298b74[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@5ea1e151[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@517e6542[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@ce511f6[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@2a315935[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@7b4b9e4b[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@593da015[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@7df37065[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f8027393b90> ====================
[grpc-default-executor-4] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1889105501
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 23, 2019 1:16:23 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@3a93601c
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1889105501/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1889105501/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1889105501/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1889105501/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:46695
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1550884582.04', 'job_endpoint': u'localhost:43093'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:39843.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:37403
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1889105501/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1889105501/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1889105501/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:169)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1889105501/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--1667506266 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 194.143s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 41s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/i5necg5wc2tp6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #121
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/121/display/redirect>
------------------------------------------
[...truncated 304.91 KB...]
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-2046620139/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-2046620139/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-2046620139/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:169)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-2046620139/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f5fef896b90> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job165080275
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 23, 2019 12:08:10 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@569d589e
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job165080275/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job165080275/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job165080275/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job165080275/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:46665
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1550880489.52', 'job_endpoint': u'localhost:39173'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:41891.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:38065
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@db3741d[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@98ce173[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@4c8e7e26[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@6b0dd126[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@7d0853c6[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@1361a26d[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@2ca18169[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@2920e13a[Not completed, 1 dependents]}
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f5fef896b90> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1848425791
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 23, 2019 12:08:25 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@4d507f4d
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1848425791/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1848425791/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1848425791/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1848425791/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:46375
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1550880503.89', 'job_endpoint': u'localhost:39173'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:41761.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:44627
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1848425791/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1848425791/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1848425791/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:169)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1848425791/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--1827648001 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 193.868s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 31s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/zc52tot2eg4rw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #120
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/120/display/redirect?page=changes>
Changes:
[markliu] Update PR template and Python PostCommit status in README
[markliu] [BEAM-6158] Remove test_wordcount_without_save_main_session
------------------------------------------
[...truncated 304.96 KB...]
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job998629739/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job998629739/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job998629739/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:169)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job998629739/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f7d06894b90> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1827718609
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 22, 2019 11:49:41 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@5612d76a
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1827718609/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1827718609/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1827718609/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1827718609/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:36427
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1550879379.75', 'job_endpoint': u'localhost:33959'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:44951.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:37103
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {12=java.util.concurrent.CompletableFuture@56727f22[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@be5e7fc[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@67eeac24[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@73936a52[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@365d806d[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@12235b5d[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@be4ab1[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@6897610e[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f7d06894b90> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1506926777
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 22, 2019 11:49:55 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@451c6e7a
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1506926777/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1506926777/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1506926777/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1506926777/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:36861
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1550879394.15', 'job_endpoint': u'localhost:33959'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:45929.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:40695
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1506926777/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1506926777/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1506926777/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:169)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1506926777/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--692775619 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 194.072s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 42s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/w4clxv2qzl65c
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #119
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/119/display/redirect?page=changes>
Changes:
[25622840+adude3141] [BEAM-6726] remove duplicate artifact declaration on maven publish
------------------------------------------
[...truncated 305.38 KB...]
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1129211488/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1129211488/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1129211488/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:169)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1129211488/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f0becc15b90> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1341165600
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 22, 2019 10:50:54 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@5fb8045
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1341165600/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1341165600/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1341165600/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1341165600/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:37507
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1550875853.48', 'job_endpoint': u'localhost:49703'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:34389.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:34405
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@7882de85[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@7cbd454d[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@39bfd4be[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@66d43172[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@84caddb[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@1ecd16b2[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@59902bf1[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@1e88de10[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f0becc15b90> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-731382379
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 22, 2019 10:51:09 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@64084dc8
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-731382379/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-731382379/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-731382379/MANIFEST has 0 artifact locations
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-731382379/MANIFEST -> 0 artifacts
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-3] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-3] INFO sdk_worker_main.start - Status HTTP server running at localhost:36637
[grpc-default-executor-3] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-3] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-3] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1550875867.85', 'job_endpoint': u'localhost:49703'}
[grpc-default-executor-3] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:34807.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] INFO data_plane.create_data_channel - Creating channel for localhost:32911
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-731382379/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-731382379/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-731382379/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:169)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-731382379/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-1549860106 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 194.260s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 51s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/qjg56qaa4kzza
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #118
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/118/display/redirect?page=changes>
Changes:
[relax] Missing commit: fix compilation issues and broken guava import.
------------------------------------------
[...truncated 305.33 KB...]
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1442980326/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1442980326/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1442980326/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:169)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1442980326/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f2b0b755b90> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job929805737
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 22, 2019 8:53:58 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@132d2216
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job929805737/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job929805737/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job929805737/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job929805737/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:40477
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1550868837.15', 'job_endpoint': u'localhost:44095'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:44917.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:35479
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@7b69b818[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@3e6b2911[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@419ea727[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@f9f934d[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@398043de[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@5e44d65e[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@6a57e52e[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@19a106d2[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f2b0b755b90> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1875937442
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 22, 2019 8:54:12 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@24b06981
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1875937442/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1875937442/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1875937442/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1875937442/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:34161
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1550868851.53', 'job_endpoint': u'localhost:44095'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:34999.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:33339
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1875937442/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1875937442/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1875937442/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:169)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1875937442/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--264460625 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 195.459s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 12s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/oxniofxtqj7jm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #117
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/117/display/redirect?page=changes>
Changes:
[pablo] [BEAM-6553] A Python SDK sink that supports File Loads into BQ (#7655)
[pablo] Fixes for Python 3 precommits. Improving errors and argument names.
------------------------------------------
[...truncated 306.09 KB...]
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1263864454/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1263864454/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1263864454/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:169)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1263864454/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f956a595b90> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1476063033
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 22, 2019 7:12:38 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@64093af6
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1476063033/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1476063033/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1476063033/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1476063033/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:34425
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1550862757.12', 'job_endpoint': u'localhost:54155'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:39753.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:45391
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {12=java.util.concurrent.CompletableFuture@2972977c[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@2d4d168a[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@684f9d47[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@64196719[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@596dd591[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@1cd17170[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@8606208[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@27eefdb2[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f956a595b90> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-441220322
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 22, 2019 7:12:52 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@3a978f40
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-441220322/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-441220322/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-441220322/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-441220322/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:35877
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1550862771.5', 'job_endpoint': u'localhost:54155'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:42345.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:41503
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-441220322/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-441220322/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-441220322/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:169)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-441220322/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-179556203 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 194.843s
FAILED (errors=1, skipped=17)
Segmentation fault (core dumped)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 139
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 35s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/jn36ygqblgt2k
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #116
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/116/display/redirect>
------------------------------------------
[...truncated 304.54 KB...]
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1818224515/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1818224515/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1818224515/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:169)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1818224515/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fb74f00e938> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-111699271
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 22, 2019 6:08:43 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@12c53547
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-111699271/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-111699271/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-111699271/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-111699271/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:41761
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1550858922.34', 'job_endpoint': u'localhost:40629'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:44251.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:41595
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@123b66b7[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@739b27dc[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@437d9fdf[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@bd772ea[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@4290b3f9[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@689fc9b0[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@4733201b[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@77434a35[Not completed, 1 dependents]}
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fb74f00e938> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1269622086
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 22, 2019 6:08:58 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@4e54cfbd
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1269622086/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1269622086/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1269622086/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1269622086/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:33449
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1550858936.72', 'job_endpoint': u'localhost:40629'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:44547.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:40455
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1269622086/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1269622086/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1269622086/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:169)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1269622086/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--1915416171 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 200.642s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 6s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/tunw3hhxvq2uq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #115
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/115/display/redirect?page=changes>
Changes:
[ryan.blake.williams] consolidate MetricResult implementations
------------------------------------------
[...truncated 344.88 KB...]
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1320711371/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1320711371/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1320711371/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:169)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1320711371/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f1bfac0e938> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job754134174
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 22, 2019 5:44:25 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@34ac3eb0
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job754134174/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job754134174/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job754134174/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job754134174/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:37789
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1550857463.65', 'job_endpoint': u'localhost:39201'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:36693.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:45925
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@37e4b693[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@3783de8d[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@309343df[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@1d0ef0d0[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@fcc9dcc[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@26925d0e[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@cb56fb8[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@66d7868e[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f1bfac0e938> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-403857180
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 22, 2019 5:44:39 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@db64470
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-403857180/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-403857180/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-403857180/MANIFEST has 0 artifact locations
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-403857180/MANIFEST -> 0 artifacts
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-3] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-3] INFO sdk_worker_main.start - Status HTTP server running at localhost:38139
[grpc-default-executor-3] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-3] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-3] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1550857478.04', 'job_endpoint': u'localhost:39201'}
[grpc-default-executor-3] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:33711.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:44477
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-403857180/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-403857180/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-403857180/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:169)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-403857180/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-1840330860 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 194.446s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 30s
61 actionable tasks: 56 executed, 4 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/ywrv5fwo2xrha
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #114
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/114/display/redirect>
------------------------------------------
[...truncated 304.70 KB...]
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-2012097810/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-2012097810/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-2012097810/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:169)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-2012097810/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f5127b4f938> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1578038965
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 22, 2019 12:08:53 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@305ea738
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1578038965/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1578038965/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1578038965/MANIFEST has 0 artifact locations
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1578038965/MANIFEST -> 0 artifacts
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-3] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-3] INFO sdk_worker_main.start - Status HTTP server running at localhost:41885
[grpc-default-executor-3] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-3] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-3] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1550837332.38', 'job_endpoint': u'localhost:36777'}
[grpc-default-executor-3] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:34643.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-3] INFO data_plane.create_data_channel - Creating channel for localhost:39911
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@7821a97d[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@36761118[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@697678d1[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@50639b45[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@257cba75[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@23049113[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@796ec552[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@359bc089[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f5127b4f938> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job991130779
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 22, 2019 12:09:08 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@6e0648f1
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job991130779/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job991130779/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job991130779/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job991130779/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:36999
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1550837346.76', 'job_endpoint': u'localhost:36777'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:44549.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:33387
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job991130779/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job991130779/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job991130779/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:169)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job991130779/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-233277464 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 198.774s
FAILED (errors=1, skipped=17)
Segmentation fault (core dumped)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 139
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 11s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/bx77qu3kvks66
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #113
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/113/display/redirect?page=changes>
Changes:
[robertwb] [BEAM-6638] Python ExternalTransform output mismatched (#7792)
------------------------------------------
[...truncated 304.74 KB...]
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job932849872/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job932849872/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job932849872/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:169)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job932849872/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fc92ec0f938> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-422051219
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 22, 2019 10:51:07 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@7fd9deff
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-422051219/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-422051219/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-422051219/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-422051219/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:40523
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1550832666.31', 'job_endpoint': u'localhost:53565'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:41891.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:36483
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@3623a0c0[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@21752c3c[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@7bbaa77a[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@629a909[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@2d272cac[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@253bf1f8[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@b140352[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@403e92d8[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fc92ec0f938> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1427899897
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Feb 22, 2019 10:51:22 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@5184555f
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1427899897/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1427899897/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1427899897/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1427899897/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:41819
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1550832680.7', 'job_endpoint': u'localhost:53565'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:39439.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:34831
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1427899897/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1427899897/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1427899897/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:169)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1427899897/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--912670069 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 195.508s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 11s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/2n3c266c4mdii
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org