You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/03/01 06:08:51 UTC
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #168
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/168/display/redirect>
------------------------------------------
[...truncated 307.20 KB...]
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-236897036/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-236897036/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-236897036/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-236897036/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f35948d88c0> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1522899299
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 6:08:22 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@b7324cf
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1522899299/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1522899299/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1522899299/MANIFEST has 0 artifact locations
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1522899299/MANIFEST -> 0 artifacts
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-3] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-3] INFO sdk_worker_main.start - Status HTTP server running at localhost:34859
[grpc-default-executor-3] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-3] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-3] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551420501.54', 'job_endpoint': u'localhost:34005'}
[grpc-default-executor-3] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:38533.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] INFO data_plane.create_data_channel - Creating channel for localhost:33485
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@427639af[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@621263be[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@3a0550cb[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@33a4ab3d[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@40ec57a7[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@3112d397[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@21015e76[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@37eaf428[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f35948d88c0> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1105441218
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 6:08:37 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@4dd43c81
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1105441218/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1105441218/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1105441218/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1105441218/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:44013
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551420515.9', 'job_endpoint': u'localhost:34005'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:41439.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:44027
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1105441218/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1105441218/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1105441218/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1105441218/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-1682200073 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 194.976s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 37s
61 actionable tasks: 48 executed, 12 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/zd6zngr2m5rjq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #189
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/189/display/redirect>
------------------------------------------
[...truncated 306.34 KB...]
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1419934391/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1419934391/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1419934391/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1419934391/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f2dd0e588c0> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-569471537
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 04, 2019 6:08:46 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@33d2e714
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-569471537/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-569471537/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-569471537/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-569471537/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:45395
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551722925.55', 'job_endpoint': u'localhost:54895'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:38823.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:36995
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@4f956362[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@50c5cbde[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@35cf701f[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@2f3120b9[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@4bdbd84e[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@35be71d0[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@7b3fa0f0[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@5dad73c6[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f2dd0e588c0> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-730820478
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 04, 2019 6:09:01 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@3c145179
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-730820478/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-730820478/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-730820478/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-730820478/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:41779
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551722939.99', 'job_endpoint': u'localhost:54895'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:34831.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:37591
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-730820478/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-730820478/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-730820478/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-730820478/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-231398050 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 194.610s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 6s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/b2beyyqzge7tm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #188
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/188/display/redirect>
------------------------------------------
[...truncated 306.89 KB...]
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1104434866/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1104434866/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1104434866/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1104434866/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f37761548c0> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1408670191
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 04, 2019 12:08:46 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@5f4a95a2
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1408670191/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1408670191/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1408670191/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1408670191/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:44843
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551701325.39', 'job_endpoint': u'localhost:57457'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:44117.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:43041
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@6e74cccd[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@6d43ca93[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@756e8431[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@5134054f[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@196eb900[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@6a0affec[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@6b44b190[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@1aabdfca[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f37761548c0> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-2121436502
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 04, 2019 12:09:01 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@209d5f7e
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-2121436502/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-2121436502/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-2121436502/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-2121436502/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:36687
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551701339.91', 'job_endpoint': u'localhost:57457'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:45023.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:33301
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-2121436502/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-2121436502/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-2121436502/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-2121436502/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--1114543016 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 194.057s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 5s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/tc42thvjaecnc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #187
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/187/display/redirect>
------------------------------------------
[...truncated 306.65 KB...]
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-151407545/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-151407545/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-151407545/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-151407545/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f00494188c0> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1673381961
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 04, 2019 6:08:49 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@6268d8e1
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1673381961/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1673381961/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1673381961/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1673381961/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:40265
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551679727.98', 'job_endpoint': u'localhost:42681'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:34921.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:41499
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@16eca643[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@7867b6f7[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@47fbc931[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@610fa0ca[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@12a2dc16[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@57b710bb[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@4e9ce93d[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@520909d4[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f00494188c0> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1535064974
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 04, 2019 6:09:03 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@3bbbbee4
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1535064974/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1535064974/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1535064974/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1535064974/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:45687
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551679742.34', 'job_endpoint': u'localhost:42681'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:36697.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:43467
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1535064974/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1535064974/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1535064974/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1535064974/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-2130466408 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 194.091s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 6s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/4zcvycwdk7pdi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #186
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/186/display/redirect>
------------------------------------------
[...truncated 306.50 KB...]
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1126895568/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1126895568/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1126895568/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1126895568/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fb811c588c0> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-2025946265
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 04, 2019 12:08:51 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@4ff4ab68
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-2025946265/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-2025946265/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-2025946265/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-2025946265/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:39709
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551658129.78', 'job_endpoint': u'localhost:60539'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:32813.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:32893
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@26cceb30[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@65fa7c88[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@344f1521[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@2a717dc2[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@6b2596d7[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@5d8db907[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@11a7598a[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@3019a911[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fb811c588c0> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-523404522
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 04, 2019 12:09:05 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@366b663a
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-523404522/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-523404522/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-523404522/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-523404522/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:40881
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551658144.23', 'job_endpoint': u'localhost:60539'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:36781.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:45135
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-523404522/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-523404522/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-523404522/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-523404522/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-915891708 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 196.199s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 10s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/efoebh3m2su3u
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #185
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/185/display/redirect>
------------------------------------------
[...truncated 306.68 KB...]
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:0:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1263216214/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1263216214/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1263216214/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1263216214/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fe95c8958c0> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1586158284
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 03, 2019 6:08:51 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@4ba7e588
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1586158284/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1586158284/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1586158284/MANIFEST has 0 artifact locations
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1586158284/MANIFEST -> 0 artifacts
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-3] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-3] INFO sdk_worker_main.start - Status HTTP server running at localhost:35835
[grpc-default-executor-3] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-3] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-3] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551636529.94', 'job_endpoint': u'localhost:43701'}
[grpc-default-executor-3] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:38877.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-3] INFO data_plane.create_data_channel - Creating channel for localhost:44489
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@5efed054[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@38c0fbcc[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@f74e45f[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@34314dc0[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@1ce55762[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@23c4d1a9[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@b3a9f92[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@355b9c78[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fe95c8958c0> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-316739858
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 03, 2019 6:09:05 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@54a60cf2
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-316739858/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-316739858/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-316739858/MANIFEST has 0 artifact locations
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-316739858/MANIFEST -> 0 artifacts
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-3] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-3] INFO sdk_worker_main.start - Status HTTP server running at localhost:33123
[grpc-default-executor-3] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-3] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-3] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551636544.38', 'job_endpoint': u'localhost:43701'}
[grpc-default-executor-3] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:46653.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-3] INFO data_plane.create_data_channel - Creating channel for localhost:33857
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-316739858/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-316739858/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-316739858/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-316739858/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--1105481505 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 194.529s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 11s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/gukmbiw7c3ut2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #184
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/184/display/redirect>
------------------------------------------
[...truncated 306.28 KB...]
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1007156126/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1007156126/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1007156126/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1007156126/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f8fe56988c0> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job765311682
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 03, 2019 12:08:40 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@1fcd2f95
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job765311682/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job765311682/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job765311682/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job765311682/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:36283
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551614918.72', 'job_endpoint': u'localhost:52011'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:39185.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:41119
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@7df2cd54[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@38f04c8e[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@1a69f632[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@982f324[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@62f1172d[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@58dfb3c1[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@dd2168e[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@1357dfc3[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f8fe56988c0> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-843515977
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 03, 2019 12:08:54 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@1274655d
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-843515977/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-843515977/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-843515977/MANIFEST has 0 artifact locations
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-843515977/MANIFEST -> 0 artifacts
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-3] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-3] INFO sdk_worker_main.start - Status HTTP server running at localhost:42343
[grpc-default-executor-3] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-3] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-3] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551614933.16', 'job_endpoint': u'localhost:52011'}
[grpc-default-executor-3] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:37197.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] INFO data_plane.create_data_channel - Creating channel for localhost:33661
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-843515977/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-843515977/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-843515977/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-843515977/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--1770359686 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 197.100s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 59s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/5h66je7skufdu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #183
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/183/display/redirect>
------------------------------------------
[...truncated 306.44 KB...]
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:0:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-643464165/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-643464165/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-643464165/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-643464165/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f4587dd88c0> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1314863148
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 03, 2019 6:10:07 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@19e1c7e6
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1314863148/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1314863148/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1314863148/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1314863148/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:45499
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551593406.55', 'job_endpoint': u'localhost:34757'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:40813.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:37347
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@2e5667c6[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@784ad902[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@7face304[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@5097f453[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@4d62d1d0[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@634e93b7[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@7be2f819[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@14b8be5a[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f4587dd88c0> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1116500541
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 03, 2019 6:10:22 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@34e95d57
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1116500541/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1116500541/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1116500541/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1116500541/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:38069
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551593420.96', 'job_endpoint': u'localhost:34757'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:34007.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:39303
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1116500541/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1116500541/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1116500541/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1116500541/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--1530289898 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 194.760s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 10m 27s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/abcqbgvajcipw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #182
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/182/display/redirect>
------------------------------------------
[...truncated 306.71 KB...]
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job431259878/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job431259878/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job431259878/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job431259878/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f0a626188c0> ====================
[grpc-default-executor-4] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-714715337
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 03, 2019 12:09:50 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@49e2e175
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-714715337/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-714715337/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-714715337/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-714715337/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:37605
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551571789.39', 'job_endpoint': u'localhost:33085'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:34237.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:46005
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@6e8af117[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@6ab5681e[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@2fb7fb2c[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@27e9cbc7[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@1e529464[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@5fe6fa28[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@4f980463[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@26c649a4[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f0a626188c0> ====================
[grpc-default-executor-4] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job2086496908
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 03, 2019 12:10:05 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@12b315c6
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job2086496908/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job2086496908/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job2086496908/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job2086496908/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:42225
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551571803.9', 'job_endpoint': u'localhost:33085'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:43197.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:35349
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job2086496908/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job2086496908/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job2086496908/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job2086496908/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--1786389637 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 201.510s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 10m 11s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/zyck6f4vycivw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #181
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/181/display/redirect>
------------------------------------------
[...truncated 307.15 KB...]
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1888549394/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1888549394/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1888549394/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1888549394/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7ffa5b0968c0> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job741465304
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 02, 2019 6:10:48 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@6e7bde6d
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job741465304/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job741465304/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job741465304/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job741465304/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:43319
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551550246.89', 'job_endpoint': u'localhost:32863'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:36041.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:42457
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@10f6a28b[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@55f43ef1[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@39d974a5[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@646b6830[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@41ac7ccc[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@35dbc1be[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@47d5e7fc[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@78c02dde[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7ffa5b0968c0> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-337778371
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 02, 2019 6:11:02 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@1233452e
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-337778371/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-337778371/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-337778371/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-337778371/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:44309
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551550261.33', 'job_endpoint': u'localhost:32863'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:46193.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:36481
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-337778371/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-337778371/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-337778371/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-337778371/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--1056586389 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 199.407s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 11m 8s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/dk42vqd724mqg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #180
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/180/display/redirect>
------------------------------------------
[...truncated 306.69 KB...]
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:0:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job951270701/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job951270701/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job951270701/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job951270701/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f160d6968c0> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1811729838
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 02, 2019 12:08:58 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@58991d06
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1811729838/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1811729838/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1811729838/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1811729838/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:34223
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551528537.26', 'job_endpoint': u'localhost:48999'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:44519.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:37801
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@7ce96fb3[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@78d6e4f6[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@3dd46588[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@3b008f0b[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@ca3fb2f[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@439d4f19[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@5dfb9ac7[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@623c2ea4[Not completed, 1 dependents]}
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f160d6968c0> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-619824926
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 02, 2019 12:09:14 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@343a1658
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-619824926/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-619824926/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-619824926/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-619824926/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:42587
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551528552.66', 'job_endpoint': u'localhost:48999'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:43517.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:33957
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-619824926/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-619824926/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-619824926/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-619824926/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-546479620 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 201.044s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 18s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/2kl6aui2lvlao
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #179
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/179/display/redirect>
------------------------------------------
[...truncated 306.39 KB...]
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:0:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job2103096465/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job2103096465/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job2103096465/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job2103096465/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fb274c968c0> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job763591350
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 02, 2019 6:08:50 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@1553e08b
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job763591350/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job763591350/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job763591350/MANIFEST has 0 artifact locations
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job763591350/MANIFEST -> 0 artifacts
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-3] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-3] INFO sdk_worker_main.start - Status HTTP server running at localhost:39689
[grpc-default-executor-3] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-3] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-3] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551506929.34', 'job_endpoint': u'localhost:33301'}
[grpc-default-executor-3] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:33245.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] INFO data_plane.create_data_channel - Creating channel for localhost:42009
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@769e21df[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@339cb168[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@7de1a686[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@265e14a[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@5f2a800[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@53b34e27[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@23960741[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@ed4cdc8[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fb274c968c0> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1605157506
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 02, 2019 6:09:05 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@549606ee
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1605157506/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1605157506/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1605157506/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1605157506/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:39417
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551506943.7', 'job_endpoint': u'localhost:33301'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:39665.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:43843
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1605157506/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1605157506/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1605157506/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1605157506/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--846628453 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 194.279s
FAILED (errors=1, skipped=17)
Segmentation fault (core dumped)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 139
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 10s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/uor7htshja7ps
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #178
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/178/display/redirect?page=changes>
Changes:
[github] [BEAM-6711] Fix bq_to_table test for google (#7968)
------------------------------------------
[...truncated 306.94 KB...]
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1007841899/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1007841899/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1007841899/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1007841899/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f886e9188c0> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job574117779
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 02, 2019 2:41:37 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@debf151
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job574117779/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job574117779/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job574117779/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job574117779/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:40153
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551494495.78', 'job_endpoint': u'localhost:49725'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:39597.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:38139
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@13405381[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@6fb5e81[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@128763e4[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@67cc58a9[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@7681d38a[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@2a52948d[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@3634a60[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@66f43b5[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f886e9188c0> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job601193413
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 02, 2019 2:41:51 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@44df53f0
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job601193413/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job601193413/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job601193413/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job601193413/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:32793
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551494510.24', 'job_endpoint': u'localhost:49725'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:41729.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:42011
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job601193413/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job601193413/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job601193413/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job601193413/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--646973125 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 194.660s
FAILED (errors=1, skipped=17)
Segmentation fault (core dumped)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 139
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 21s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/ecut4gsiorflg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #177
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/177/display/redirect>
------------------------------------------
[...truncated 306.80 KB...]
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job509185328/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job509185328/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job509185328/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job509185328/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f93257188c0> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1438802598
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 02, 2019 12:08:26 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@5fbb25f9
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1438802598/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1438802598/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1438802598/MANIFEST has 0 artifact locations
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1438802598/MANIFEST -> 0 artifacts
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-3] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-3] INFO sdk_worker_main.start - Status HTTP server running at localhost:39631
[grpc-default-executor-3] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-3] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-3] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551485305.09', 'job_endpoint': u'localhost:40419'}
[grpc-default-executor-3] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:40209.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:38281
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@1cc7db74[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@59c55688[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@32117224[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@68d6ad11[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@4ae8d704[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@39eaa9c7[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@d36c8c[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@5d30f7a2[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f93257188c0> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job409102089
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 02, 2019 12:08:40 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@2fb6dfa3
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job409102089/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job409102089/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job409102089/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job409102089/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:41917
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551485319.47', 'job_endpoint': u'localhost:40419'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:45553.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:32843
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job409102089/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job409102089/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job409102089/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job409102089/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-1087677945 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 198.019s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 45s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/75a5qbzwsnpoi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #176
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/176/display/redirect?page=changes>
Changes:
[amaliujia] add missing bytes
------------------------------------------
[...truncated 307.65 KB...]
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job74531220/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job74531220/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job74531220/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job74531220/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f5492a988c0> ====================
[grpc-default-executor-4] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1372670292
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 9:44:11 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@6a4eb44c
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1372670292/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1372670292/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1372670292/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1372670292/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:38759
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551476650.22', 'job_endpoint': u'localhost:52957'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:42099.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:44575
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@41d6590c[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@45e9c5ee[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@eb5337[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@424c78ea[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@31215796[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@3a6c22e9[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@60c4ac78[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@416e03a2[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f5492a988c0> ====================
[grpc-default-executor-4] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job2067205821
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 9:44:26 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@78e3a217
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job2067205821/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job2067205821/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job2067205821/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job2067205821/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:41299
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551476664.72', 'job_endpoint': u'localhost:52957'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:45821.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:45793
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job2067205821/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job2067205821/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job2067205821/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job2067205821/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-108555339 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 196.053s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 23s
61 actionable tasks: 47 executed, 13 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/2jbcewgrytylg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #175
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/175/display/redirect?page=changes>
Changes:
[kcweaver] [BEAM-6725] share some Flink job invocation code with Samza runner
------------------------------------------
[...truncated 309.69 KB...]
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job418498950/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job418498950/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job418498950/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job418498950/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f40ff6548c0> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-250223245
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 9:22:38 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@71be447e
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-250223245/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-250223245/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-250223245/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-250223245/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:37573
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551475357.36', 'job_endpoint': u'localhost:56755'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:39151.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:35203
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@7f152830[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@7b2ab30a[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@3e28220b[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@59de2cbc[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@fdcdb1f[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@21c08b0d[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@5e07dd44[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@7614a1f4[Not completed, 1 dependents]}
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-4] ERROR sdk_worker_main.main - Python sdk harness failed:
Traceback (most recent call last):
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker_main.py", line 145, in main
sdk_pipeline_options.view_as(pipeline_options.ProfilingOptions))
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 126, in run
for work_request in control_stub.Control(get_responses()):
File "/usr/local/lib/python2.7/site-packages/grpc/_channel.py", line 366, in next
return self._next()
File "/usr/local/lib/python2.7/site-packages/grpc/_channel.py", line 346, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Runner closed connection"
debug_error_string = "{"created":"@1551475361.846554711","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1099,"grpc_message":"Runner closed connection","grpc_status":1}"
>
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f40ff6548c0> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-534217427
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 9:22:54 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@5d5ed98e
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-534217427/MANIFEST
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-534217427/MANIFEST
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-534217427/MANIFEST has 0 artifact locations
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-534217427/MANIFEST -> 0 artifacts
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-4] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-4] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-4] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-4] INFO sdk_worker_main.start - Status HTTP server running at localhost:36305
[grpc-default-executor-4] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-4] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551475372.79', 'job_endpoint': u'localhost:56755'}
[grpc-default-executor-4] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:38305.
[grpc-default-executor-4] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-4] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:38093
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-534217427/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-534217427/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-534217427/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-534217427/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-1065704641 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 206.548s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 11m 0s
61 actionable tasks: 48 executed, 12 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/p7bhtzo73m3zu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #174
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/174/display/redirect?page=changes>
Changes:
[kenn] [BEAM-6554] Adjust Jenkins directory for spotbugs report
------------------------------------------
[...truncated 306.78 KB...]
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job173396926/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job173396926/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job173396926/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job173396926/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f6f926d48c0> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1197672518
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 7:22:14 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@11d6ca6c
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1197672518/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1197672518/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1197672518/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1197672518/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:43533
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551468133.6', 'job_endpoint': u'localhost:50237'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:46101.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:35607
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@4a6634d8[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@597b494f[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@4651fad[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@21627173[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@5a594173[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@59eb5a46[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@75dfbea1[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@4704a080[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f6f926d48c0> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job608233033
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 7:22:29 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@42189e49
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job608233033/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job608233033/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job608233033/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job608233033/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:34675
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551468148.02', 'job_endpoint': u'localhost:50237'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:44673.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:32843
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job608233033/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job608233033/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job608233033/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job608233033/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-45886662 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 195.327s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 51s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/k3wzrtves4bqa
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #173
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/173/display/redirect>
------------------------------------------
[...truncated 306.39 KB...]
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-552277700/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-552277700/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-552277700/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-552277700/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fe45c6588c0> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1420465981
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 6:08:42 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@3f1bc202
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1420465981/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1420465981/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1420465981/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1420465981/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:33725
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551463720.75', 'job_endpoint': u'localhost:36281'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:39101.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:43473
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {12=java.util.concurrent.CompletableFuture@6251464f[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@1237f39b[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@53790245[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@6af5e92f[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@27eb900[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@2ff829ff[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@34887d6f[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fe45c6588c0> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-2113517767
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 6:08:56 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@7da4042
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-2113517767/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-2113517767/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-2113517767/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-2113517767/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:35705
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551463735.13', 'job_endpoint': u'localhost:36281'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:41181.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:46267
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-2113517767/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-2113517767/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-2113517767/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-2113517767/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-422074365 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 195.258s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 2s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/erw3pio3nakk6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #172
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/172/display/redirect?page=changes>
Changes:
[ehudm] Allow setting dataflow_endpoint for Python ITs
------------------------------------------
[...truncated 306.46 KB...]
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job219193627/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job219193627/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job219193627/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job219193627/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f3fe13d88c0> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job788620100
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 5:54:17 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@7b84c260
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job788620100/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job788620100/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job788620100/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job788620100/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:41619
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551462856.14', 'job_endpoint': u'localhost:42411'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:39877.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:34303
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@2d086831[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@71a65021[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@6a895b18[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@58ab064a[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@360ca48e[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@75e8cd36[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@55990908[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@5500cca7[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f3fe13d88c0> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-485656148
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 5:54:31 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@20ca584a
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-485656148/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-485656148/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-485656148/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-485656148/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:35431
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551462870.6', 'job_endpoint': u'localhost:42411'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:35523.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:35821
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-485656148/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-485656148/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-485656148/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-485656148/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-845552830 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 194.303s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 58s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/3p7emctc4qe7a
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #171
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/171/display/redirect?page=changes>
Changes:
[github] Merge pull request #7353: [BEAM-4461] Support inner and outer style
------------------------------------------
[...truncated 308.20 KB...]
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-769404131/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-769404131/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-769404131/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-769404131/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fa1e40558c0> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1457883014
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 3:15:48 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@79ca9d1e
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1457883014/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1457883014/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1457883014/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1457883014/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:33885
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551453347.56', 'job_endpoint': u'localhost:40721'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:34589.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:43195
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@7b390ec2[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@7598056d[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@63124ced[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@4c0bc907[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@7f77915a[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@4af140b4[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@3b751823[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@2924bdbb[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fa1e40558c0> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1658928814
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 3:16:03 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@94de74a
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1658928814/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1658928814/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1658928814/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1658928814/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:33181
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551453362.01', 'job_endpoint': u'localhost:40721'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:44823.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:35091
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1658928814/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1658928814/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1658928814/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1658928814/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-1946223284 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 195.171s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 13s
61 actionable tasks: 50 executed, 10 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/ljjn6b7anrfqg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #170
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/170/display/redirect>
------------------------------------------
[...truncated 306.22 KB...]
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:0:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1535888643/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1535888643/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1535888643/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1535888643/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f3ac59168c0> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1625843654
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 12:08:39 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@7cba47fd
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1625843654/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1625843654/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1625843654/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1625843654/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:36791
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551442118.01', 'job_endpoint': u'localhost:35385'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:44737.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:36643
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@5b551266[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@1a34f3f5[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@4e76a5c0[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@2cae4c4b[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@5f1bad9a[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@628d56d7[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@192ea7e3[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@47bc6c99[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f3ac59168c0> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-438215540
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 12:08:53 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@5ebc6222
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-438215540/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-438215540/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-438215540/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-438215540/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:33261
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551442132.45', 'job_endpoint': u'localhost:35385'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:39473.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:35859
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-438215540/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-438215540/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-438215540/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-438215540/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-371792397 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 197.284s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 56s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/u2umlq32japdm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #169
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/169/display/redirect?page=changes>
Changes:
[ttanay100] Fix link to Design Principles in PTransform Style Guide
[ttanay100] Change text as well
------------------------------------------
[...truncated 306.56 KB...]
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job925593003/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job925593003/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job925593003/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job925593003/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fdf434588c0> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-762797282
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 11:38:57 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@5dfca085
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-762797282/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-762797282/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-762797282/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-762797282/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:38021
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1551440336.33', 'job_endpoint': u'localhost:52373'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:37837.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:45875
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@549adfd1[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@d6962dd[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@1fc14ccc[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@4df85d88[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@4f9e77b1[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@9279b15[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@1c9511d1[Not completed, 1 dependents]}
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fdf434588c0> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1583090287
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 01, 2019 11:39:12 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@7b862de9
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:693)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1583090287/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1583090287/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1583090287/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1583090287/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:39991
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1551440350.76', 'job_endpoint': u'localhost:52373'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:44893.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for .
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:42491
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1583090287/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1583090287/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1583090287/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1583090287/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 300, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 357, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 414, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-405028259 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 30 tests in 194.209s
FAILED (errors=1, skipped=17)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 390
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 7s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/cmdu46l4trjis
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org