You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/03/16 12:10:45 UTC
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #305
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/305/display/redirect>
------------------------------------------
[...truncated 307.90 KB...]
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-553462138/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-553462138/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-553462138/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-553462138/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f13dd99dde8> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job652392678
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 16, 2019 12:10:15 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@6b498030
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job652392678/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job652392678/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job652392678/MANIFEST has 0 artifact locations
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job652392678/MANIFEST -> 0 artifacts
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-3] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-3] INFO sdk_worker_main.start - Status HTTP server running at localhost:34785
[grpc-default-executor-3] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-3] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-3] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1552738214.38', 'job_endpoint': u'localhost:39575'}
[grpc-default-executor-3] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:35213.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:39733.
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] INFO data_plane.create_data_channel - Creating channel for localhost:42277
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@56ad240a[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@5292aa07[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@17902e31[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@197f34cd[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@26cdde9c[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@61c89ad0[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@77bfd17e[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@17064a18[Not completed, 1 dependents]}
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f13dd99dde8> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-409315637
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 16, 2019 12:10:30 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@25475ece
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-409315637/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-409315637/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-409315637/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-409315637/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:39213
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1552738228.75', 'job_endpoint': u'localhost:39575'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:33173.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:46695.
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:37027
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-4] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-409315637/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-409315637/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-409315637/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-409315637/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 361, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 428, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-69685803 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 31 tests in 196.359s
FAILED (errors=1, skipped=18)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 10m 33s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/pfbqvafc6nqsi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #355
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/355/display/redirect?page=changes>
Changes:
[migryz] Fix pyhamcrest import missing
------------------------------------------
[...truncated 172.44 KB...]
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_no_subtransform_composite (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 530, in test_no_subtransform_composite
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 76, in test_pardo
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_metrics (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 103, in test_pardo_metrics
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 141, in test_pardo_side_and_main_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 130, in test_pardo_side_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_read (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 136, in test_read
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_register_finalizations (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 838, in test_register_finalizations
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_reshuffle (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 420, in test_reshuffle
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 305, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 351, in _run_pardo_state_timers
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowing (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 457, in test_windowing
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
----------------------------------------------------------------------
Ran 33 tests in 0.133s
FAILED (errors=16, skipped=16)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 57s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/n7wbprsmn2egi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #354
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/354/display/redirect?page=changes>
Changes:
[iemejia] Revert "Review: Add some comments & tests"
[iemejia] Revert "[BEAM-6292] PasswordDecrypter: Delay decryption / Avoid
------------------------------------------
[...truncated 172.87 KB...]
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_no_subtransform_composite (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 530, in test_no_subtransform_composite
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 76, in test_pardo
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_metrics (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 103, in test_pardo_metrics
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 141, in test_pardo_side_and_main_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 130, in test_pardo_side_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_read (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 136, in test_read
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_register_finalizations (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 838, in test_register_finalizations
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_reshuffle (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 420, in test_reshuffle
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 305, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 351, in _run_pardo_state_timers
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowing (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 457, in test_windowing
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
----------------------------------------------------------------------
Ran 33 tests in 0.123s
FAILED (errors=16, skipped=16)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 50s
61 actionable tasks: 48 executed, 12 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/dym5nbkwfkvu6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #353
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/353/display/redirect?page=changes>
Changes:
[jeff] [BEAM-5638] Exception handling for Java MapElements and FlatMapElements
------------------------------------------
[...truncated 211.89 KB...]
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_no_subtransform_composite (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 530, in test_no_subtransform_composite
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 76, in test_pardo
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_metrics (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 103, in test_pardo_metrics
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 141, in test_pardo_side_and_main_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 130, in test_pardo_side_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_read (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 136, in test_read
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_register_finalizations (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 838, in test_register_finalizations
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_reshuffle (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 420, in test_reshuffle
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 305, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 351, in _run_pardo_state_timers
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowing (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 457, in test_windowing
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
----------------------------------------------------------------------
Ran 33 tests in 0.122s
FAILED (errors=16, skipped=16)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 15s
61 actionable tasks: 56 executed, 4 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/hioo4pf3f2him
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #352
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/352/display/redirect?page=changes>
Changes:
[github] Correct spark version used by the spark runner in the website
------------------------------------------
[...truncated 172.72 KB...]
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_no_subtransform_composite (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 530, in test_no_subtransform_composite
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 76, in test_pardo
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_metrics (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 103, in test_pardo_metrics
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 141, in test_pardo_side_and_main_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 130, in test_pardo_side_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_read (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 136, in test_read
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_register_finalizations (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 838, in test_register_finalizations
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_reshuffle (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 420, in test_reshuffle
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 305, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 351, in _run_pardo_state_timers
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowing (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 457, in test_windowing
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
----------------------------------------------------------------------
Ran 33 tests in 0.121s
FAILED (errors=16, skipped=16)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 1s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/xt7c7sgu3332m
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #351
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/351/display/redirect>
------------------------------------------
[...truncated 173.35 KB...]
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_no_subtransform_composite (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 530, in test_no_subtransform_composite
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 76, in test_pardo
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_metrics (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 103, in test_pardo_metrics
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 141, in test_pardo_side_and_main_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 130, in test_pardo_side_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_read (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 136, in test_read
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_register_finalizations (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 838, in test_register_finalizations
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_reshuffle (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 420, in test_reshuffle
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 305, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 351, in _run_pardo_state_timers
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowing (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 457, in test_windowing
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
----------------------------------------------------------------------
Ran 33 tests in 0.192s
FAILED (errors=16, skipped=16)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 57s
61 actionable tasks: 47 executed, 13 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/mhrbsflhwfitk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #350
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/350/display/redirect?page=changes>
Changes:
[kcweaver] [BEAM-6865] DefaultJobBundleFactory: create using default
------------------------------------------
[...truncated 174.72 KB...]
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 530, in test_no_subtransform_composite
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 76, in test_pardo
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_metrics (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 103, in test_pardo_metrics
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 141, in test_pardo_side_and_main_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 130, in test_pardo_side_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_read (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 136, in test_read
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_register_finalizations (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 838, in test_register_finalizations
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_reshuffle (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 420, in test_reshuffle
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 305, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 351, in _run_pardo_state_timers
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowing (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 457, in test_windowing
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
----------------------------------------------------------------------
Ran 33 tests in 0.116s
FAILED (errors=16, skipped=16)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 29s
61 actionable tasks: 48 executed, 12 from cache, 1 up-to-date
Publishing build scan...
Publishing failed.
The response from https://scans-in.gradle.com/in/5.2.1/2.1 was not from the build scan server.
Your network environment may be interfering, or the service may be unavailable.
If you believe this to be in error, please report this problem via https://gradle.com/scans/help/plugin and include the following via copy/paste:
----------
Gradle version: 5.2.1
Plugin version: 2.1
Request URL: https://scans-in.gradle.com/in/5.2.1/2.1
Request ID: ca20dbe4-2ac6-442d-9002-2b2160d7a22c
Response status code: 503
Response content type: text/html; charset=utf-8
Response server type: cloudflare
----------
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #349
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/349/display/redirect?page=changes>
Changes:
[robertwb] [BEAM-6778] Enable Bundle Finalization in Python SDK harness over FnApi
------------------------------------------
[...truncated 172.70 KB...]
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_no_subtransform_composite (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 530, in test_no_subtransform_composite
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 76, in test_pardo
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_metrics (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 103, in test_pardo_metrics
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 141, in test_pardo_side_and_main_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 130, in test_pardo_side_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_read (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 136, in test_read
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_register_finalizations (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 838, in test_register_finalizations
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_reshuffle (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 420, in test_reshuffle
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 305, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 351, in _run_pardo_state_timers
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowing (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 457, in test_windowing
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
----------------------------------------------------------------------
Ran 33 tests in 0.120s
FAILED (errors=16, skipped=16)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 48s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/wtzyyzw3r5egg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #348
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/348/display/redirect>
------------------------------------------
[...truncated 169.12 KB...]
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_group_by_key (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 410, in test_group_by_key
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_no_subtransform_composite (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 529, in test_no_subtransform_composite
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 75, in test_pardo
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_metrics (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 102, in test_pardo_metrics
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 140, in test_pardo_side_and_main_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 129, in test_pardo_side_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_read (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 136, in test_read
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_reshuffle (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 419, in test_reshuffle
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 350, in _run_pardo_state_timers
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowing (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 456, in test_windowing
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
----------------------------------------------------------------------
Ran 31 tests in 0.116s
FAILED (errors=14, skipped=16)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 7s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/ledc3b42q354u
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #347
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/347/display/redirect>
------------------------------------------
[...truncated 169.81 KB...]
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_group_by_key (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 410, in test_group_by_key
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_no_subtransform_composite (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 529, in test_no_subtransform_composite
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 75, in test_pardo
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_metrics (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 102, in test_pardo_metrics
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 140, in test_pardo_side_and_main_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 129, in test_pardo_side_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_read (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 136, in test_read
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_reshuffle (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 419, in test_reshuffle
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 350, in _run_pardo_state_timers
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowing (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 456, in test_windowing
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
----------------------------------------------------------------------
Ran 31 tests in 0.109s
FAILED (errors=14, skipped=16)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 35s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/gy6qum6qilkya
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #346
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/346/display/redirect?page=changes>
Changes:
[boyuanz] Reset Datasource counter to 0 in FinishBundle
[boyuanz] Reset count to 0 after all operations have finished bundle
------------------------------------------
[...truncated 170.05 KB...]
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_group_by_key (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 410, in test_group_by_key
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_no_subtransform_composite (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 529, in test_no_subtransform_composite
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 75, in test_pardo
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_metrics (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 102, in test_pardo_metrics
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 140, in test_pardo_side_and_main_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 129, in test_pardo_side_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_read (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 136, in test_read
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_reshuffle (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 419, in test_reshuffle
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 350, in _run_pardo_state_timers
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowing (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 456, in test_windowing
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
----------------------------------------------------------------------
Ran 31 tests in 0.201s
FAILED (errors=14, skipped=16)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 30s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/xrrqndbreb3bg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #345
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/345/display/redirect?page=changes>
Changes:
[ajhalaria] Create a custom hash paritioner that deals with arrays during combines
------------------------------------------
[...truncated 169.44 KB...]
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_group_by_key (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 410, in test_group_by_key
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_no_subtransform_composite (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 529, in test_no_subtransform_composite
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 75, in test_pardo
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_metrics (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 102, in test_pardo_metrics
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 140, in test_pardo_side_and_main_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 129, in test_pardo_side_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_read (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 136, in test_read
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_reshuffle (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 419, in test_reshuffle
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 350, in _run_pardo_state_timers
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowing (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 456, in test_windowing
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
----------------------------------------------------------------------
Ran 31 tests in 0.124s
FAILED (errors=14, skipped=16)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 1s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/opzt25ylmrocg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #344
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/344/display/redirect?page=changes>
Changes:
[tweise] [flink] debug logging for state access
[github] [BEAM-6866]: SamzaRunner: support timers in ParDo (#8092)
------------------------------------------
[...truncated 169.68 KB...]
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_group_by_key (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 410, in test_group_by_key
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_no_subtransform_composite (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 529, in test_no_subtransform_composite
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 75, in test_pardo
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_metrics (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 102, in test_pardo_metrics
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 140, in test_pardo_side_and_main_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 129, in test_pardo_side_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_read (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 136, in test_read
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_reshuffle (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 419, in test_reshuffle
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 350, in _run_pardo_state_timers
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowing (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 456, in test_windowing
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
----------------------------------------------------------------------
Ran 31 tests in 0.119s
FAILED (errors=14, skipped=16)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 52s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/75m4uiikcqkba
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #343
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/343/display/redirect>
------------------------------------------
[...truncated 169.41 KB...]
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_group_by_key (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 410, in test_group_by_key
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_no_subtransform_composite (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 529, in test_no_subtransform_composite
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 75, in test_pardo
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_metrics (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 102, in test_pardo_metrics
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 140, in test_pardo_side_and_main_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 129, in test_pardo_side_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_read (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 136, in test_read
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_reshuffle (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 419, in test_reshuffle
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 350, in _run_pardo_state_timers
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowing (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 456, in test_windowing
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
----------------------------------------------------------------------
Ran 31 tests in 0.120s
FAILED (errors=14, skipped=16)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 27s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/mv2gcpnwy3cai
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #342
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/342/display/redirect?page=changes>
Changes:
[iemejia] [BEAM-6854] Update amazon-web-services aws-sdk dependency to version
------------------------------------------
[...truncated 169.83 KB...]
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_group_by_key (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 410, in test_group_by_key
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_no_subtransform_composite (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 529, in test_no_subtransform_composite
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 75, in test_pardo
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_metrics (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 102, in test_pardo_metrics
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 140, in test_pardo_side_and_main_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 129, in test_pardo_side_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_read (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 136, in test_read
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_reshuffle (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 419, in test_reshuffle
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 350, in _run_pardo_state_timers
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowing (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 456, in test_windowing
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
----------------------------------------------------------------------
Ran 31 tests in 0.113s
FAILED (errors=14, skipped=16)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 31s
61 actionable tasks: 48 executed, 12 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/2c7p56rddxuj6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #341
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/341/display/redirect>
------------------------------------------
[...truncated 169.85 KB...]
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_group_by_key (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 410, in test_group_by_key
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_no_subtransform_composite (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 529, in test_no_subtransform_composite
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 75, in test_pardo
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_metrics (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 102, in test_pardo_metrics
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 140, in test_pardo_side_and_main_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 129, in test_pardo_side_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_read (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 136, in test_read
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_reshuffle (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 419, in test_reshuffle
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 350, in _run_pardo_state_timers
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowing (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 456, in test_windowing
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
----------------------------------------------------------------------
Ran 31 tests in 0.113s
FAILED (errors=14, skipped=16)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 23s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/fyc24xtyw3bmc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #340
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/340/display/redirect?page=changes>
Changes:
[michal.walenia] [BEAM-6627] Refactor metric gathering mechanism to be more flexible
[michal.walenia] [BEAM-6627] Added metrics to ParquetIOIT
[michal.walenia] [BEAM-6627] Added metrics to AvroIOIT
[michal.walenia] [BEAM-6627] Added metrics to TFRecordIOIT, refactored namespace names
[michal.walenia] [BEAM-6627] Added metrics to XmlIOIT
[michal.walenia] [BEAM-6627] Added metric reporting to all file based test jobs
------------------------------------------
[...truncated 169.39 KB...]
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_group_by_key (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 410, in test_group_by_key
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_no_subtransform_composite (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 529, in test_no_subtransform_composite
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 75, in test_pardo
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_metrics (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 102, in test_pardo_metrics
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 140, in test_pardo_side_and_main_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 129, in test_pardo_side_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_read (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 136, in test_read
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_reshuffle (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 419, in test_reshuffle
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 350, in _run_pardo_state_timers
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowing (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 456, in test_windowing
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
----------------------------------------------------------------------
Ran 31 tests in 0.113s
FAILED (errors=14, skipped=16)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 7m 2s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/w6jghep45nnuy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #339
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/339/display/redirect?page=changes>
Changes:
[kcweaver] [BEAM-6864] Pass JobInfo to PortablePipelineRunner.run
------------------------------------------
[...truncated 169.87 KB...]
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_group_by_key (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 410, in test_group_by_key
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_no_subtransform_composite (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 529, in test_no_subtransform_composite
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 75, in test_pardo
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_metrics (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 102, in test_pardo_metrics
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 140, in test_pardo_side_and_main_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 129, in test_pardo_side_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_read (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 136, in test_read
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_reshuffle (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 419, in test_reshuffle
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 350, in _run_pardo_state_timers
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowing (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 456, in test_windowing
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
----------------------------------------------------------------------
Ran 31 tests in 0.112s
FAILED (errors=14, skipped=16)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 33s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/2psbeoqbaew42
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #338
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/338/display/redirect?page=changes>
Changes:
[jeff] [BEAM-6770] Correct zstd-jni dependency scope to tests only
------------------------------------------
[...truncated 169.87 KB...]
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_group_by_key (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 410, in test_group_by_key
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_no_subtransform_composite (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 529, in test_no_subtransform_composite
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 75, in test_pardo
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_metrics (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 102, in test_pardo_metrics
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 140, in test_pardo_side_and_main_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 129, in test_pardo_side_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_read (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 136, in test_read
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_reshuffle (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 419, in test_reshuffle
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 350, in _run_pardo_state_timers
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowing (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 456, in test_windowing
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
----------------------------------------------------------------------
Ran 31 tests in 0.213s
FAILED (errors=14, skipped=16)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 7m 24s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/oloaqbr3xtzvc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #337
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/337/display/redirect>
------------------------------------------
[...truncated 169.61 KB...]
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_group_by_key (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 410, in test_group_by_key
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_no_subtransform_composite (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 529, in test_no_subtransform_composite
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 75, in test_pardo
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_metrics (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 102, in test_pardo_metrics
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 140, in test_pardo_side_and_main_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 129, in test_pardo_side_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_read (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 136, in test_read
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_reshuffle (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 419, in test_reshuffle
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 350, in _run_pardo_state_timers
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowing (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 456, in test_windowing
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
----------------------------------------------------------------------
Ran 31 tests in 0.131s
FAILED (errors=14, skipped=16)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 7m 27s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/t2k2ffxuwrxxk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #336
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/336/display/redirect?page=changes>
Changes:
[katarzyna.kucharczyk] [BEAM-6175] Extract reader and publisher from MetricsMonitor in Python
[katarzyna.kucharczyk] [BEAM-6175] Extracted common class for all load tests
------------------------------------------
[...truncated 169.40 KB...]
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_group_by_key (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 410, in test_group_by_key
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_no_subtransform_composite (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 529, in test_no_subtransform_composite
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 75, in test_pardo
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_metrics (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 102, in test_pardo_metrics
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 140, in test_pardo_side_and_main_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 129, in test_pardo_side_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_read (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 136, in test_read
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_reshuffle (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 419, in test_reshuffle
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 350, in _run_pardo_state_timers
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowing (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 456, in test_windowing
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
----------------------------------------------------------------------
Ran 31 tests in 0.136s
FAILED (errors=14, skipped=16)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 46s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/qmj3mliqnkip2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #335
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/335/display/redirect>
------------------------------------------
[...truncated 169.63 KB...]
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_group_by_key (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 410, in test_group_by_key
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_no_subtransform_composite (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 529, in test_no_subtransform_composite
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 75, in test_pardo
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_metrics (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 102, in test_pardo_metrics
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 140, in test_pardo_side_and_main_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 129, in test_pardo_side_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_read (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 136, in test_read
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_reshuffle (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 419, in test_reshuffle
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 350, in _run_pardo_state_timers
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowing (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 456, in test_windowing
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
----------------------------------------------------------------------
Ran 31 tests in 0.115s
FAILED (errors=14, skipped=16)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 32s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/6ri3ljrnysjte
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #334
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/334/display/redirect?page=changes>
Changes:
[juta.staes] [BEAM-6619] [BEAM-6593] fix autocomplete it test
------------------------------------------
[...truncated 169.18 KB...]
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_group_by_key (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 410, in test_group_by_key
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_no_subtransform_composite (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 529, in test_no_subtransform_composite
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 75, in test_pardo
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_metrics (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 102, in test_pardo_metrics
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 140, in test_pardo_side_and_main_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 129, in test_pardo_side_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_read (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 136, in test_read
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_reshuffle (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 419, in test_reshuffle
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 350, in _run_pardo_state_timers
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowing (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 456, in test_windowing
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
----------------------------------------------------------------------
Ran 31 tests in 0.117s
FAILED (errors=14, skipped=16)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 42s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/v2zrutwmcszps
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #333
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/333/display/redirect>
------------------------------------------
[...truncated 170.03 KB...]
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_group_by_key (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 410, in test_group_by_key
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_no_subtransform_composite (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 529, in test_no_subtransform_composite
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 75, in test_pardo
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_metrics (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 102, in test_pardo_metrics
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 140, in test_pardo_side_and_main_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 129, in test_pardo_side_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_read (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 136, in test_read
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_reshuffle (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 419, in test_reshuffle
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 350, in _run_pardo_state_timers
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowing (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 456, in test_windowing
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
----------------------------------------------------------------------
Ran 31 tests in 0.116s
FAILED (errors=14, skipped=16)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 50s
61 actionable tasks: 48 executed, 12 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/x6vav52xtzl34
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #332
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/332/display/redirect?page=changes>
Changes:
[kyle.winkelman] [BEAM-6851] Support recursive globs in HadoopFileSystem.
------------------------------------------
[...truncated 169.69 KB...]
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_group_by_key (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 410, in test_group_by_key
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_no_subtransform_composite (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 529, in test_no_subtransform_composite
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 75, in test_pardo
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_metrics (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 102, in test_pardo_metrics
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 140, in test_pardo_side_and_main_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 129, in test_pardo_side_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_read (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 136, in test_read
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_reshuffle (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 419, in test_reshuffle
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 350, in _run_pardo_state_timers
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowing (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 456, in test_windowing
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
----------------------------------------------------------------------
Ran 31 tests in 0.146s
FAILED (errors=14, skipped=16)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 11s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/lkkxr34wefj4s
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #331
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/331/display/redirect?page=changes>
Changes:
[mxm] [BEAM-6730] Expose Java SDK's GenerateSequence to Python
[mxm] [BEAM-6730] Support Read translation in streaming portable Flink Runner
[mxm] [BEAM-6730] Support Read translation in batch portable Flink Runner
[mxm] [BEAM-6730] Add portable Read translation test
[mxm] [BEAM-6730] Use generic payload to configure external transforms
[mxm] [BEAM-6730] Add Java GenerateSequence expansion test
[mxm] [BEAM-6730] Add Python GenerateSequence integration test
[mxm] [BEAM-6730] Add test for GenerateSequence's external builder
------------------------------------------
[...truncated 171.09 KB...]
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_group_by_key (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 410, in test_group_by_key
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_no_subtransform_composite (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 529, in test_no_subtransform_composite
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 75, in test_pardo
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_metrics (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 102, in test_pardo_metrics
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 140, in test_pardo_side_and_main_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_pardo_side_outputs (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 129, in test_pardo_side_outputs
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_read (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 136, in test_read
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_reshuffle (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 419, in test_reshuffle
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 350, in _run_pardo_state_timers
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
======================================================================
ERROR: test_windowing (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 456, in test_windowing
with self.create_pipeline() as p:
File "apache_beam/runners/portability/portable_runner_test.py", line 182, in create_pipeline
return beam.Pipeline(self.get_runner(), self.create_options())
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/apache_beam/runners/portability/java_reference_runner_test.py",> line 79, in create_options
options = super(JavaReferenceRunnerTest, self).create_options()
File "apache_beam/runners/portability/portable_runner_test.py", line 175, in create_options
options.view_as(PortableOptions).job_endpoint = self._get_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 139, in _get_job_endpoint
cls._job_endpoint = cls._create_job_endpoint()
File "apache_beam/runners/portability/portable_runner_test.py", line 145, in _create_job_endpoint
return cls._start_local_runner_subprocess_job_service()
File "apache_beam/runners/portability/portable_runner_test.py", line 108, in _start_local_runner_subprocess_job_service
cls._subprocess_command(job_port, expansion_port))
TypeError: _subprocess_command() takes exactly 2 arguments (3 given)
----------------------------------------------------------------------
Ran 31 tests in 0.117s
FAILED (errors=14, skipped=16)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 36s
61 actionable tasks: 51 executed, 9 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/4e5km6yco53ew
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #330
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/330/display/redirect?page=changes>
Changes:
[lukasz.gajowy] [BEAM-6848] Fix incorrectly passed args to job
------------------------------------------
[...truncated 307.01 KB...]
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:0:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-2090870867/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-2090870867/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-2090870867/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-2090870867/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7ff0bb622de8> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-449499344
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 19, 2019 3:50:34 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@108ae49
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-449499344/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-449499344/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-449499344/MANIFEST has 0 artifact locations
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-449499344/MANIFEST -> 0 artifacts
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-3] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-3] INFO sdk_worker_main.start - Status HTTP server running at localhost:41519
[grpc-default-executor-3] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-3] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-3] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1553010632.71', 'job_endpoint': u'localhost:53261'}
[grpc-default-executor-3] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:36553.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:33805.
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] INFO data_plane.create_data_channel - Creating channel for localhost:43879
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@189ebbd[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@f4e15fc[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@b7180cd[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@4e731fc7[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@e9d1b7[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@7ff7d5a3[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@78874578[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@2e5ce088[Not completed, 1 dependents]}
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7ff0bb622de8> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job2081823835
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 19, 2019 3:50:48 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@2cc85cf6
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job2081823835/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job2081823835/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job2081823835/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job2081823835/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:44267
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1553010647.08', 'job_endpoint': u'localhost:53261'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:35071.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:40111.
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:34671
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job2081823835/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job2081823835/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job2081823835/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job2081823835/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 361, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 428, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--2103757121 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 31 tests in 194.144s
FAILED (errors=1, skipped=18)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 7s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/563uz6vgr66ii
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #329
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/329/display/redirect?page=changes>
Changes:
[github] Update default test in run_integration_test.sh
------------------------------------------
[...truncated 307.44 KB...]
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job535527487/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job535527487/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job535527487/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job535527487/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f95366a2de8> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1015334173
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 19, 2019 3:32:20 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@376d03ac
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1015334173/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1015334173/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1015334173/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1015334173/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:36549
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1553009539.2', 'job_endpoint': u'localhost:51403'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:40837.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:41241.
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:39757
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {12=java.util.concurrent.CompletableFuture@7e8bfa93[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@7ab4719a[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@3fb6f0a8[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@2fbd26fe[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@ec30ef8[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@5722861b[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@5f990fe7[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@1955483c[Not completed, 1 dependents]}
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f95366a2de8> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-2131041640
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 19, 2019 3:32:34 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@66437783
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-2131041640/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-2131041640/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-2131041640/MANIFEST has 0 artifact locations
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-2131041640/MANIFEST -> 0 artifacts
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-3] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-3] INFO sdk_worker_main.start - Status HTTP server running at localhost:33131
[grpc-default-executor-3] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-3] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-3] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1553009553.58', 'job_endpoint': u'localhost:51403'}
[grpc-default-executor-3] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:36979.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:34935.
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-3] INFO data_plane.create_data_channel - Creating channel for localhost:33763
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-2131041640/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-2131041640/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-2131041640/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-2131041640/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 361, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 428, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--1122035103 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 31 tests in 195.385s
FAILED (errors=1, skipped=18)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 2s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/3ww572jhrxrbq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #328
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/328/display/redirect?page=changes>
Changes:
[katarzyna.kucharczyk] [BEAM-5995] Add fanout and reiteration in GBK load test in Python
[katarzyna.kucharczyk] [BEAM-5995] Add fanout to Combine load test in Python
[lukasz.gajowy] [BEAM-6703] Added a Jenkins job definition for Java 11 enabled Dataflow
------------------------------------------
[...truncated 307.98 KB...]
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1605352689/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1605352689/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1605352689/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1605352689/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f5df1be2de8> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1605474216
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 19, 2019 1:39:20 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@1173e410
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1605474216/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1605474216/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1605474216/MANIFEST has 0 artifact locations
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1605474216/MANIFEST -> 0 artifacts
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-3] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-3] INFO sdk_worker_main.start - Status HTTP server running at localhost:37951
[grpc-default-executor-3] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-3] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-3] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1553002758.97', 'job_endpoint': u'localhost:44557'}
[grpc-default-executor-3] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:35511.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:33289.
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-3] INFO data_plane.create_data_channel - Creating channel for localhost:45495
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@896287[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@1c84aab5[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@78849554[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@4d4cfc8e[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@69a32fa[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@3f72e19e[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@6380fd11[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@4902c563[Not completed, 1 dependents]}
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f5df1be2de8> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1358420993
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 19, 2019 1:39:34 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@5a6adb3c
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1358420993/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1358420993/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1358420993/MANIFEST has 0 artifact locations
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1358420993/MANIFEST -> 0 artifacts
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-3] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-3] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-3] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-3] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1553002773.37', 'job_endpoint': u'localhost:44557'}
[grpc-default-executor-3] INFO sdk_worker_main.start - Status HTTP server running at localhost:36925
[grpc-default-executor-3] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:34411.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:33197.
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-3] INFO data_plane.create_data_channel - Creating channel for localhost:46247
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1358420993/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1358420993/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1358420993/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1358420993/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 361, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 428, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-1017500218 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 31 tests in 201.459s
FAILED (errors=1, skipped=18)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 47s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/7xzu7fs3od3vo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #327
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/327/display/redirect?page=changes>
Changes:
[katarzyna.kucharczyk] [BEAM-6848] changed datatset key name in load test builder. Added
------------------------------------------
[...truncated 307.19 KB...]
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1665608634/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1665608634/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1665608634/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1665608634/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fba81d9bde8> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1824527574
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 19, 2019 12:59:25 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@5aee67c7
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1824527574/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1824527574/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1824527574/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1824527574/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:42505
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1553000363.82', 'job_endpoint': u'localhost:52997'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:33367.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:43345.
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:42889
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@6fa21042[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@81da544[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@5e073aec[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@7052d145[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@f8def0d[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@6a5f5c3d[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@de8cbc0[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@6b56fbc1[Not completed, 1 dependents]}
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fba81d9bde8> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1315303049
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 19, 2019 12:59:40 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@5c17d5df
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1315303049/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1315303049/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1315303049/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1315303049/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:41149
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1553000379.18', 'job_endpoint': u'localhost:52997'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:35359.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:46451.
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:45023
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1315303049/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1315303049/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1315303049/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1315303049/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 361, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 428, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-1660371073 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 31 tests in 205.795s
FAILED (errors=1, skipped=18)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 10m 5s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/pnwgonpzytsfy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #326
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/326/display/redirect>
------------------------------------------
[...truncated 307.60 KB...]
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1308723867/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1308723867/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1308723867/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1308723867/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f8366091de8> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job2131883794
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 19, 2019 12:14:21 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@64b542b5
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job2131883794/MANIFEST
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job2131883794/MANIFEST
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job2131883794/MANIFEST has 0 artifact locations
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job2131883794/MANIFEST -> 0 artifacts
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-4] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-4] INFO sdk_worker_main.start - Status HTTP server running at localhost:38241
[grpc-default-executor-4] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-4] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-4] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-4] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1552997660.02', 'job_endpoint': u'localhost:56675'}
[grpc-default-executor-4] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:37263.
[grpc-default-executor-4] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-4] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-4] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:34043.
[grpc-default-executor-4] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-4] INFO data_plane.create_data_channel - Creating channel for localhost:36401
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {12=java.util.concurrent.CompletableFuture@1ed5808d[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@5bd70d33[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@205e77b7[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@6ac6f6f3[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@58a5d2ce[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@3bf8f27c[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@6848c97b[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@35e4cbef[Not completed, 1 dependents]}
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f8366091de8> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job415620299
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 19, 2019 12:14:35 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@13dcac27
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job415620299/MANIFEST
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job415620299/MANIFEST
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job415620299/MANIFEST has 0 artifact locations
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job415620299/MANIFEST -> 0 artifacts
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-4] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-4] INFO sdk_worker_main.start - Status HTTP server running at localhost:45185
[grpc-default-executor-4] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-4] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-4] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-4] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1552997674.37', 'job_endpoint': u'localhost:56675'}
[grpc-default-executor-4] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:34843.
[grpc-default-executor-4] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-4] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-4] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:44123.
[grpc-default-executor-4] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-4] INFO data_plane.create_data_channel - Creating channel for localhost:45639
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-4] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-4] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-4] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-4] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-4] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-4] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-4] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job415620299/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job415620299/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job415620299/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job415620299/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 361, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 428, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--683965110 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 31 tests in 194.491s
FAILED (errors=1, skipped=18)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 31s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/bpo2f5uurjtpo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #325
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/325/display/redirect?page=changes>
Changes:
[michal.walenia] [BEAM-6703] Added a Jenkins job to test Dataflow portability API with
[michal.walenia] [BEAM-6703] Changed job type to phrase triggered only
[michal.walenia] [BEAM-6703] Added README entry with cron and phrase triggered jobs
[michal.walenia] [BEAM-6703] Changed job type to include cron trigger
------------------------------------------
[...truncated 308.24 KB...]
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job394973381/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job394973381/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job394973381/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job394973381/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f5ad7a98de8> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1141506977
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 19, 2019 10:23:48 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@30c3722c
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1141506977/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1141506977/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1141506977/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1141506977/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:46337
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1552991027.19', 'job_endpoint': u'localhost:34401'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:40607.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:42791.
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:36117
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@4beda471[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@75c13f34[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@7aec6d38[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@d2aa8c6[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@2bc25b3e[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@5786e9ed[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@4e9adb88[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@162e2605[Not completed, 1 dependents]}
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f5ad7a98de8> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job8697773
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 19, 2019 10:24:02 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@69c751cf
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job8697773/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job8697773/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job8697773/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job8697773/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:45809
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1552991041.57', 'job_endpoint': u'localhost:34401'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:33365.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:34795.
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:41903
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job8697773/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job8697773/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job8697773/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job8697773/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 361, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 428, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--554809977 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 31 tests in 200.620s
FAILED (errors=1, skipped=18)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 10m 23s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/mrfftgos34gn4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #324
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/324/display/redirect>
------------------------------------------
[...truncated 307.99 KB...]
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job463716759/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job463716759/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job463716759/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job463716759/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f9187cd9de8> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-2067278661
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 19, 2019 6:09:07 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@78cb5491
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-2067278661/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-2067278661/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-2067278661/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-2067278661/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:45153
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1552975746.14', 'job_endpoint': u'localhost:50861'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:39155.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:45131.
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:39187
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@622d591f[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@6b3eba24[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@741a7889[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@4d70203c[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@459d7d2c[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@5b6c1021[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@7c15e5f5[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@30285b8b[Not completed, 1 dependents]}
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f9187cd9de8> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-543559922
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 19, 2019 6:09:21 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@56f088a9
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-543559922/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-543559922/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-543559922/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-543559922/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:46651
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1552975760.54', 'job_endpoint': u'localhost:50861'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:33193.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:36437.
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:44929
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-543559922/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-543559922/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-543559922/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-543559922/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 361, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 428, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-1305758933 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 31 tests in 195.937s
FAILED (errors=1, skipped=18)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 23s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/fwq4vyo32g4va
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #323
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/323/display/redirect?page=changes>
Changes:
[heejong] [BEAM-6443] decrease the number of thread for BigQuery streaming
------------------------------------------
[...truncated 308.02 KB...]
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:0:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-719701998/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-719701998/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-719701998/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-719701998/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f4f23723de8> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job802140936
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 19, 2019 4:27:55 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@63e7ce89
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job802140936/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job802140936/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job802140936/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job802140936/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:38907
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1552969674.42', 'job_endpoint': u'localhost:34131'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:41817.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:45651.
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:44489
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@3985acc6[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@37f0c986[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@3138aecc[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@387f86c9[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@2c08fe9c[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@1d05ae62[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@69bf2dc0[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@2d32b7f0[Not completed, 1 dependents]}
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f4f23723de8> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1148901057
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 19, 2019 4:28:10 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@1b3cbb72
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1148901057/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1148901057/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1148901057/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1148901057/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:33541
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1552969688.78', 'job_endpoint': u'localhost:34131'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:35613.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:39867.
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:37195
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1148901057/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1148901057/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1148901057/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1148901057/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 361, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 428, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-1855745813 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 31 tests in 193.864s
FAILED (errors=1, skipped=18)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 27s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/xnxonuvxsmi4e
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #322
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/322/display/redirect?page=changes>
Changes:
[melissapa] [BEAM-6827] Update Python dependencies page for 2.10.0, 2.11.0
[echauchot] Remove Cassandra PasswordDecrypter fix (tagged for 2.12) from high level
------------------------------------------
[...truncated 307.79 KB...]
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:0:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1605141724/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1605141724/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1605141724/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1605141724/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f63f9f18de8> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job64350179
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 19, 2019 12:56:10 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@39c8047a
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job64350179/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job64350179/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job64350179/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job64350179/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:37557
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1552956969.08', 'job_endpoint': u'localhost:54165'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:41481.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:33305.
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:38923
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@4cc105af[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@4206e247[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@46396edf[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@33be87c[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@471379c9[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@3272afb6[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@3fb060b1[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@63141733[Not completed, 1 dependents]}
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f63f9f18de8> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-450046303
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 19, 2019 12:56:24 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@29884278
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-450046303/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-450046303/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-450046303/MANIFEST has 0 artifact locations
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-450046303/MANIFEST -> 0 artifacts
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-3] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-3] INFO sdk_worker_main.start - Status HTTP server running at localhost:42171
[grpc-default-executor-3] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-3] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-3] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1552956983.46', 'job_endpoint': u'localhost:54165'}
[grpc-default-executor-3] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:41893.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:38677.
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:39867
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-450046303/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-450046303/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-450046303/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-450046303/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 361, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 428, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--1491772520 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 31 tests in 194.352s
FAILED (errors=1, skipped=18)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 9s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/mrke43norgpd2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #321
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/321/display/redirect>
------------------------------------------
[...truncated 307.70 KB...]
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job602352226/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job602352226/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job602352226/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job602352226/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fe13c191de8> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1848565840
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 19, 2019 12:18:25 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@648efeee
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1848565840/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1848565840/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1848565840/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1848565840/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:41893
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1552954704.28', 'job_endpoint': u'localhost:33327'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:39905.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:34909.
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:40615
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@75dc4268[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@75e63b50[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@24fd5c4f[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@3d42fac6[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@2a9a3004[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@6ee2b2bc[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@20b3840b[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@a0dde11[Not completed, 1 dependents]}
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fe13c191de8> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-486836456
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 19, 2019 12:18:39 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@77e2d878
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-486836456/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-486836456/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-486836456/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-486836456/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:40481
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1552954718.65', 'job_endpoint': u'localhost:33327'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:42837.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:34689.
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:33081
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-486836456/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-486836456/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-486836456/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-486836456/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 361, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 428, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-331301666 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 31 tests in 194.149s
FAILED (errors=1, skipped=18)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 13s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/ixcu5nmvab7v2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #320
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/320/display/redirect?page=changes>
Changes:
[github] Fixing minor type
------------------------------------------
[...truncated 309.61 KB...]
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-840085552/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-840085552/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-840085552/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-840085552/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f091eae2de8> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1914373663
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 18, 2019 10:41:44 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@54326cb1
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1914373663/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1914373663/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1914373663/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1914373663/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:43305
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1552948902.8', 'job_endpoint': u'localhost:35299'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:41421.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:40913.
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:37675
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@528a6819[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@3d0f6376[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@2aa61c22[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@6ce6b6a1[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@6d2dd184[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@2b7f1b84[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@31a255c5[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@68a8aeee[Not completed, 1 dependents]}
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] ERROR sdk_worker_main.main - Python sdk harness failed:
Traceback (most recent call last):
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker_main.py", line 145, in main
sdk_pipeline_options.view_as(pipeline_options.ProfilingOptions))
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 127, in run
for work_request in control_stub.Control(get_responses()):
File "/usr/local/lib/python2.7/site-packages/grpc/_channel.py", line 366, in next
return self._next()
File "/usr/local/lib/python2.7/site-packages/grpc/_channel.py", line 346, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Runner closed connection"
debug_error_string = "{"created":"@1552948906.814048401","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1099,"grpc_message":"Runner closed connection","grpc_status":1}"
>
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f091eae2de8> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job70917465
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 18, 2019 10:41:58 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@2d48c31b
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job70917465/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job70917465/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job70917465/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job70917465/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:42041
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1552948917.21', 'job_endpoint': u'localhost:35299'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:36923.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:43353.
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:42335
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job70917465/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job70917465/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job70917465/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job70917465/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 361, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 428, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--706517120 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 31 tests in 205.908s
FAILED (errors=1, skipped=18)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 7s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/gsuh5px4lm2cc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #319
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/319/display/redirect>
------------------------------------------
[...truncated 335.32 KB...]
details = "Socket closed"
debug_error_string = "{"created":"@1552932914.852304488","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 400, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1552932914.852335169","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 400, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1552932914.852380228","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 400, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1552932914.852312464","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 400, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1552932914.852367279","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 400, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1552932914.852359222","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 400, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1552932914.852296070","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 400, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1552932914.852287410","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 400, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1552932914.852373813","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 400, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1552932914.852351722","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 400, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1552932914.852327810","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 400, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1552932914.852266099","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 400, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1552932914.852343622","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 1s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/iovtfsho5ymdi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #318
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/318/display/redirect?page=changes>
Changes:
[echauchot] [BEAM-6052] Fix the bug of checkForErrors, add update response parse
[echauchot] [BEAM-6052] Refactor testPartialUpdateWithErrors and related
[echauchot] [BEAM-6279] instead of stopping extra nodes of the test cluster to have
[echauchot] [BEAM-6052] Fix setIndexMapping
[echauchot] [BEAM-6052] Fix testWritePartialUpdateWithErrors insert only one invalid
------------------------------------------
[...truncated 307.69 KB...]
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1146585573/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1146585573/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1146585573/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1146585573/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fa5308ddde8> ====================
[grpc-default-executor-4] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-136422199
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 18, 2019 4:17:46 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@7b7288f9
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-136422199/MANIFEST
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-136422199/MANIFEST
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-136422199/MANIFEST has 0 artifact locations
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-136422199/MANIFEST -> 0 artifacts
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-4] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-4] INFO sdk_worker_main.start - Status HTTP server running at localhost:41897
[grpc-default-executor-4] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-4] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-4] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-4] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1552925865.32', 'job_endpoint': u'localhost:49547'}
[grpc-default-executor-4] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:39473.
[grpc-default-executor-4] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-4] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-4] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:39567.
[grpc-default-executor-4] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-4] INFO data_plane.create_data_channel - Creating channel for localhost:33243
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@393d4bdc[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@723bd87d[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@8ceb0a4[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@a227da0[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@5912b493[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@75c677fc[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@8f0a270[Not completed, 1 dependents]}
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fa5308ddde8> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1592807942
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 18, 2019 4:18:01 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@6dd39310
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1592807942/MANIFEST
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1592807942/MANIFEST
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1592807942/MANIFEST has 0 artifact locations
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1592807942/MANIFEST -> 0 artifacts
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-4] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-4] INFO sdk_worker_main.start - Status HTTP server running at localhost:37629
[grpc-default-executor-4] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-4] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-4] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-4] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1552925879.69', 'job_endpoint': u'localhost:49547'}
[grpc-default-executor-4] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:43331.
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-3] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:40219.
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-3] INFO data_plane.create_data_channel - Creating channel for localhost:34523
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1592807942/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1592807942/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1592807942/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1592807942/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 361, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 428, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--1704700620 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 31 tests in 195.488s
FAILED (errors=1, skipped=18)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 0s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/vrvotmxdrfacy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #317
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/317/display/redirect?page=changes>
Changes:
[iemejia] [BEAM-5115] Make ValueProvider API consistent between XmlIO and
------------------------------------------
[...truncated 308.29 KB...]
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-4] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-4] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-4] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-4] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-4] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-4] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-4] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-900832266/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-900832266/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-900832266/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-900832266/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f9780d94de8> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-278339013
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 18, 2019 1:40:41 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@621c5999
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-278339013/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-278339013/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-278339013/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-278339013/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:45977
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1552916440.3', 'job_endpoint': u'localhost:48375'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:45137.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:45309.
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:43013
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@7451b68a[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@766424c[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@2402114d[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@903ac36[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@701fae7a[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@455ee617[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@71e20f88[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@65946f9e[Not completed, 1 dependents]}
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f9780d94de8> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job454216392
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 18, 2019 1:40:56 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@4fcde882
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job454216392/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job454216392/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job454216392/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job454216392/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:39489
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1552916454.67', 'job_endpoint': u'localhost:48375'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:32785.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:38311.
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:46415
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-4] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-4] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-4] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job454216392/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job454216392/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job454216392/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job454216392/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 361, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 428, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--1930085362 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 31 tests in 194.408s
FAILED (errors=1, skipped=18)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 53s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/vbhbtiw5u5x2m
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #316
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/316/display/redirect>
------------------------------------------
[...truncated 306.72 KB...]
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-931992531/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-931992531/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-931992531/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-931992531/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fd222260de8> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job494286853
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 18, 2019 12:10:51 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@5832081c
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job494286853/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job494286853/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job494286853/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job494286853/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:35615
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1552911050.38', 'job_endpoint': u'localhost:51649'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:34333.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:38605.
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:46351
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@2c57b3d4[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@3fbd1588[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@32f3ae3f[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@39c1b6c5[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@28196b3a[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@7fdf2ae4[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@50f2e176[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@64b10233[Not completed, 1 dependents]}
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fd222260de8> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-2128889088
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 18, 2019 12:11:06 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@1badf743
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-2128889088/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-2128889088/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-2128889088/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-2128889088/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:46239
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1552911064.72', 'job_endpoint': u'localhost:51649'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:44245.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:45021.
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:45831
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-2128889088/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-2128889088/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-2128889088/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-2128889088/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 361, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 428, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--411459255 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 31 tests in 193.899s
FAILED (errors=1, skipped=18)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 31s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/fyu5khn4ieorm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #315
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/315/display/redirect?page=changes>
Changes:
[mxm] [BEAM-6751] Add KafkaIO EOS support to Flink via @RequiresStableInput
[mxm] Add @NonnullByDefault annotation to stableinput package
------------------------------------------
[...truncated 306.91 KB...]
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-1] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-1] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job113570652/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job113570652/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job113570652/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job113570652/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f73c595dde8> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1663459681
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 18, 2019 11:42:37 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@457d314d
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1663459681/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1663459681/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1663459681/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1663459681/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:37217
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1552909355.77', 'job_endpoint': u'localhost:55715'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:34455.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:33355.
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:46833
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {12=java.util.concurrent.CompletableFuture@5693551f[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@17a1e5f0[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@7110c98[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@58c4ab41[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@143326eb[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@ca5cff8[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@35f7738[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@7e3c5ab1[Not completed, 1 dependents]}
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f73c595dde8> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-781431785
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 18, 2019 11:42:51 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@7400894a
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-781431785/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-781431785/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-781431785/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-781431785/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:39531
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1552909370.12', 'job_endpoint': u'localhost:55715'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:40949.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:39995.
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:41961
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-1] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-781431785/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-781431785/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-781431785/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-781431785/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 361, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 428, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-329925774 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 31 tests in 192.835s
FAILED (errors=1, skipped=18)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 24s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/gqrsfw6n2sc7q
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #314
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/314/display/redirect?page=changes>
Changes:
[robinyqiu] Disable support of @RequiresStableInput on Dataflow runner until we have
[robinyqiu] Use 2 spaces for indentation in Groovy file
------------------------------------------
[...truncated 308.89 KB...]
[grpc-default-executor-5] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1712782379/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1712782379/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1712782379/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1712782379/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f3d94cd5de8> ====================
[grpc-default-executor-4] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job674053072
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 18, 2019 11:29:36 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@fd41de5
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job674053072/MANIFEST
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job674053072/MANIFEST
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job674053072/MANIFEST has 0 artifact locations
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job674053072/MANIFEST -> 0 artifacts
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-4] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-4] INFO sdk_worker_main.start - Status HTTP server running at localhost:41247
[grpc-default-executor-4] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-4] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-4] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-4] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1552908574.58', 'job_endpoint': u'localhost:50303'}
[grpc-default-executor-4] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:43393.
[grpc-default-executor-4] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-4] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-4] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:42429.
[grpc-default-executor-4] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-4] INFO data_plane.create_data_channel - Creating channel for localhost:42289
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {12=java.util.concurrent.CompletableFuture@2d7d9764[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@4e27a747[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@1e2233d2[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@6834b27d[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@2933cea8[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@5a5d5956[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@556e5d6c[Not completed, 1 dependents]}
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
[grpc-default-executor-4] ERROR data_plane._read_inputs - Failed to read inputs in the data plane
Traceback (most recent call last):
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/data_plane.py", line 271, in _read_inputs
for elements in elements_iterator:
File "/usr/local/lib/python2.7/site-packages/grpc/_channel.py", line 366, in next
return self._next()
File "/usr/local/lib/python2.7/site-packages/grpc/_channel.py", line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1552908579.898706271","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1099,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f3d94cd5de8> ====================
[grpc-default-executor-5] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1966048831
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 18, 2019 11:29:52 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@3c55c961
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1966048831/MANIFEST
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1966048831/MANIFEST
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1966048831/MANIFEST has 0 artifact locations
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1966048831/MANIFEST -> 0 artifacts
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-4] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-4] INFO sdk_worker_main.start - Status HTTP server running at localhost:46597
[grpc-default-executor-4] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-4] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-4] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-4] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1552908590.33', 'job_endpoint': u'localhost:50303'}
[grpc-default-executor-4] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:40859.
[grpc-default-executor-4] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-4] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-4] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:45357.
[grpc-default-executor-4] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-4] INFO data_plane.create_data_channel - Creating channel for localhost:37717
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-4] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-4] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-4] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-4] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-4] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-4] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-4] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1966048831/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1966048831/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1966048831/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1966048831/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 361, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 428, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--60816939 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 31 tests in 225.327s
FAILED (errors=1, skipped=18)
Segmentation fault (core dumped)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 139
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 19s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/ynxqzwkvtu56u
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #313
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/313/display/redirect?page=changes>
Changes:
[robertwb] Remove unused Flink assignWindows translator and workarounds.
------------------------------------------
[...truncated 345.63 KB...]
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:0:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-264553895/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-264553895/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-264553895/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-264553895/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f8dc141bde8> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1858876825
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 18, 2019 8:14:12 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@683ea524
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1858876825/MANIFEST
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1858876825/MANIFEST
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1858876825/MANIFEST has 0 artifact locations
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1858876825/MANIFEST -> 0 artifacts
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-4] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-4] INFO sdk_worker_main.start - Status HTTP server running at localhost:34145
[grpc-default-executor-4] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-4] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-4] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-4] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1552896850.88', 'job_endpoint': u'localhost:33249'}
[grpc-default-executor-4] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:36927.
[grpc-default-executor-4] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-4] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-4] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:37297.
[grpc-default-executor-4] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-4] INFO data_plane.create_data_channel - Creating channel for localhost:40785
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {12=java.util.concurrent.CompletableFuture@60fd258a[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@64c2ad4d[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@21c02fb1[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@19f30e9a[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@10aba95b[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@6172d6c6[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@41efd0fe[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@40e99187[Not completed, 1 dependents]}
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f8dc141bde8> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-61518627
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 18, 2019 8:14:26 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@73abaa73
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-61518627/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-61518627/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-61518627/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-61518627/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:38533
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1552896865.25', 'job_endpoint': u'localhost:33249'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:43079.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:32953.
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:42319
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-4] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-4] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-61518627/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-61518627/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-61518627/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-61518627/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 361, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 428, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--2014150409 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 31 tests in 194.503s
FAILED (errors=1, skipped=18)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 14s
61 actionable tasks: 51 executed, 9 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/jeva754cxfssk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #312
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/312/display/redirect>
------------------------------------------
[...truncated 311.11 KB...]
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job475432287/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f124869dde8> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job294170079
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 18, 2019 6:09:21 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@50eee1ba
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job294170079/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job294170079/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job294170079/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job294170079/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:43459
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1552889359.76', 'job_endpoint': u'localhost:41541'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:38067.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:44739.
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:38531
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-4] ERROR data_plane._read_inputs - Failed to read inputs in the data plane
Traceback (most recent call last):
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/data_plane.py", line 271, in _read_inputs
for elements in elements_iterator:
File "/usr/local/lib/python2.7/site-packages/grpc/_channel.py", line 366, in next
return self._next()
File "/usr/local/lib/python2.7/site-packages/grpc/_channel.py", line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1552889364.296014749","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1099,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@4ff7306c[Completed normally], 12=java.util.concurrent.CompletableFuture@af5b7f6[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@359dda0f[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@3bb53fa4[Not completed, 1 dependents]}
[grpc-default-executor-2] ERROR sdk_worker_main.main - Python sdk harness failed:
Traceback (most recent call last):
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker_main.py", line 145, in main
sdk_pipeline_options.view_as(pipeline_options.ProfilingOptions))
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 127, in run
for work_request in control_stub.Control(get_responses()):
File "/usr/local/lib/python2.7/site-packages/grpc/_channel.py", line 366, in next
return self._next()
File "/usr/local/lib/python2.7/site-packages/grpc/_channel.py", line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Runner closed connection"
debug_error_string = "{"created":"@1552889364.303522053","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1099,"grpc_message":"Runner closed connection","grpc_status":1}"
>
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f124869dde8> ====================
[grpc-default-executor-0] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1864770918
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 18, 2019 6:09:36 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@759a262e
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1864770918/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1864770918/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1864770918/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1864770918/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:43061
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1552889375.18', 'job_endpoint': u'localhost:41541'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:39791.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-4] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:41891.
[grpc-default-executor-4] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-4] INFO data_plane.create_data_channel - Creating channel for localhost:46553
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-4] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-4] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-4] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-4] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-4] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-4] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-4] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1864770918/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1864770918/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1864770918/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1864770918/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 361, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 428, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-663782795 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 31 tests in 219.421s
FAILED (errors=1, skipped=18)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 39s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/nlr4q7vwuhhbo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #311
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/311/display/redirect>
------------------------------------------
[...truncated 335.41 KB...]
details = "Socket closed"
debug_error_string = "{"created":"@1552867835.260984023","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 400, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1552867835.260905956","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 400, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1552867835.260976213","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 400, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1552867835.260934232","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 400, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1552867835.260924486","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 400, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1552867835.260942494","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 400, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1552867835.260951124","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 400, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1552867835.260897837","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 400, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1552867835.260967065","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 400, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1552867835.260867751","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 400, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1552867835.260914697","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 400, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1552867835.260959499","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 400, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1552867835.260888649","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 10m 27s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/xabemoingrjcg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #310
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/310/display/redirect>
------------------------------------------
[...truncated 307.55 KB...]
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:0:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-2061876931/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-2061876931/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-2061876931/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-2061876931/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f8a16f1dde8> ====================
[grpc-default-executor-4] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job982429780
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 17, 2019 6:10:00 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@6c103ee6
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job982429780/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job982429780/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job982429780/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job982429780/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:42673
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1552846198.74', 'job_endpoint': u'localhost:47399'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:36813.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:42337.
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:41807
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@40d27cfa[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@17867612[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@6443b3ff[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@ef4e65f[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@5d927ed7[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@7980a591[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@253d15[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@294ae550[Not completed, 1 dependents]}
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f8a16f1dde8> ====================
[grpc-default-executor-4] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job28845161
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 17, 2019 6:10:14 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@61903635
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job28845161/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job28845161/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job28845161/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job28845161/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:39145
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1552846213.12', 'job_endpoint': u'localhost:47399'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:41537.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:40221.
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:45187
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job28845161/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job28845161/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job28845161/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job28845161/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 361, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 428, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--708722979 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 31 tests in 195.730s
FAILED (errors=1, skipped=18)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 10m 19s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/lwz3ogzib6eng
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #309
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/309/display/redirect>
------------------------------------------
[...truncated 308.00 KB...]
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:0:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-4] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-4] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-4] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-4] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-4] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-1] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-525092101/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-525092101/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-525092101/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-525092101/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fa1a11ddde8> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job149621205
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 17, 2019 12:10:22 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@3a17aab6
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job149621205/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job149621205/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job149621205/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job149621205/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:44119
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1552824621.44', 'job_endpoint': u'localhost:46041'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:39555.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:39155.
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-4] INFO data_plane.create_data_channel - Creating channel for localhost:39923
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {12=java.util.concurrent.CompletableFuture@354ca058[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@4e30b5ad[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@11a7c52d[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@30b0a29e[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@602e8ab0[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@2b78d6c5[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@4d9f02a[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@31c8067d[Not completed, 1 dependents]}
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7fa1a11ddde8> ====================
[grpc-default-executor-1] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1851026049
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 17, 2019 12:10:37 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@67f99fb
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1851026049/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1851026049/MANIFEST
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1851026049/MANIFEST has 0 artifact locations
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1851026049/MANIFEST -> 0 artifacts
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-2] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-2] INFO sdk_worker_main.start - Status HTTP server running at localhost:35407
[grpc-default-executor-2] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-2] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-2] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1552824635.82', 'job_endpoint': u'localhost:46041'}
[grpc-default-executor-2] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:40813.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:46403.
[grpc-default-executor-2] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:38313
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-4] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-4] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1851026049/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1851026049/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1851026049/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1851026049/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 361, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 428, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job--1883071444 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 31 tests in 195.621s
FAILED (errors=1, skipped=18)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 10m 41s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/vuojsay4pkdvu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #308
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/308/display/redirect>
------------------------------------------
[...truncated 308.07 KB...]
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job346651543/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job346651543/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job346651543/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job346651543/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f8e4dcdbde8> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-656135189
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 17, 2019 6:10:11 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@3f94d721
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-656135189/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-656135189/MANIFEST
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-656135189/MANIFEST has 0 artifact locations
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-656135189/MANIFEST -> 0 artifacts
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-1] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-1] INFO sdk_worker_main.start - Status HTTP server running at localhost:46101
[grpc-default-executor-1] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-1] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-1] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-1] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1552803010.07', 'job_endpoint': u'localhost:46939'}
[grpc-default-executor-1] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:42887.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-1] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:35099.
[grpc-default-executor-1] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-1] INFO data_plane.create_data_channel - Creating channel for localhost:36387
[grpc-default-executor-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-1] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {11=java.util.concurrent.CompletableFuture@6ac8dce8[Not completed, 1 dependents], 12=java.util.concurrent.CompletableFuture@2d3b7ef[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@1c6acf97[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@2b6ae8d7[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@7694ece[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@181afd03[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@52c68fe0[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@2e16f93f[Not completed, 1 dependents]}
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f8e4dcdbde8> ====================
[grpc-default-executor-2] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job-1816480557
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 17, 2019 6:10:25 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@adad9e8
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1816480557/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job-1816480557/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1816480557/MANIFEST has 0 artifact locations
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job-1816480557/MANIFEST -> 0 artifacts
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-3] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-3] INFO sdk_worker_main.start - Status HTTP server running at localhost:34987
[grpc-default-executor-3] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-3] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-3] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1552803024.44', 'job_endpoint': u'localhost:46939'}
[grpc-default-executor-3] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:39325.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-3] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:36885.
[grpc-default-executor-3] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-3] INFO data_plane.create_data_channel - Creating channel for localhost:36611
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-3] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-3] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-3] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-3] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-3] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-3] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-3] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-3] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-3] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job-1816480557/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job-1816480557/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job-1816480557/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job-1816480557/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 361, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 428, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-843643405 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 31 tests in 194.868s
FAILED (errors=1, skipped=18)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 10m 28s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/cttg7vjc5izck
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #307
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/307/display/redirect>
------------------------------------------
[...truncated 307.42 KB...]
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_18:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_25:0:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_28:0
[grpc-default-executor-0] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-0] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-0] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-0] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-0] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-0] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1215128333/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1215128333/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1215128333/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1215128333/
.sINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f001a05ade8> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1423640049
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 17, 2019 12:10:05 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@e87ff3d
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1423640049/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1423640049/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1423640049/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1423640049/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:37507
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowed_pardo_state_timers_1552781404.35', 'job_endpoint': u'localhost:54255'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:40151.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:44899.
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_22:0:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-0] INFO data_plane.create_data_channel - Creating channel for localhost:42807
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_13:0
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[direct-runner-worker] ERROR org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClient - FnApiControlClient closed, clearing outstanding requests {12=java.util.concurrent.CompletableFuture@7d9c7bdf[Not completed, 1 dependents], 13=java.util.concurrent.CompletableFuture@46925122[Not completed, 1 dependents], 14=java.util.concurrent.CompletableFuture@4c1125a0[Not completed, 1 dependents], 15=java.util.concurrent.CompletableFuture@670eaf5f[Not completed, 1 dependents], 16=java.util.concurrent.CompletableFuture@79d262e2[Not completed, 1 dependents], 17=java.util.concurrent.CompletableFuture@2d1d27bb[Not completed, 1 dependents], 19=java.util.concurrent.CompletableFuture@68e43b9d[Not completed, 1 dependents], 10=java.util.concurrent.CompletableFuture@7a820589[Not completed, 1 dependents]}
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
EINFO:root:Using latest locally built Python SDK docker image.
INFO:root:==================== <function lift_combiners at 0x7f001a05ade8> ====================
[grpc-default-executor-3] ERROR org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService - Encountered Unexpected Exception for Invocation job1701849196
java.lang.IllegalArgumentException: Can't get the number of an unknown enum value.
at org.apache.beam.model.jobmanagement.v1.JobApi$JobState$Enum.getNumber(JobApi.java:8585)
at org.apache.beam.model.jobmanagement.v1.JobApi$GetJobStateResponse$Builder.setState(JobApi.java:5768)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:237)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Mar 17, 2019 12:10:20 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@5e8f68ea
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p13p1.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:172)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:358)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.getStateStream(ReferenceRunnerJobService.java:249)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:770)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:707)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[direct-runner-worker] WARN org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.environment.DockerCommand - Unable to pull docker image jenkins-docker-apache.bintray.io/beam/python:latest, cause: Received exit code 1 for command 'docker pull jenkins-docker-apache.bintray.io/beam/python:latest'. stderr: Error response from daemon: unknown: Repo 'apache' was not found
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1701849196/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Loading manifest for retrieval token /tmp/beam-artifact-staging/job1701849196/MANIFEST
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1701849196/MANIFEST has 0 artifact locations
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/job1701849196/MANIFEST -> 0 artifacts
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-0] INFO sdk_worker_main.main - Logging handler created.
[grpc-default-executor-0] INFO sdk_worker_main.start - Status HTTP server running at localhost:46459
[grpc-default-executor-0] INFO sdk_worker_main.main - semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN sdk_worker_main._load_main_session - No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail.
[grpc-default-executor-0] WARN pipeline_options.get_all_options - Discarding unparseable args: [u'--enforce_encodability', u'--direct_runner_use_stacked_bundle', u'--enforce_immutability', u'--pipeline_type_check', u'--block_on_run']
[grpc-default-executor-0] INFO sdk_worker_main.main - Python sdk harness started with pipeline_options: {'experiments': [u'beam_fn_api'], 'environment_type': u'DOCKER', 'sdk_location': u'container', 'job_name': u'test_windowing_1552781418.72', 'job_endpoint': u'localhost:54255'}
[grpc-default-executor-0] INFO sdk_worker.__init__ - Creating insecure control channel for localhost:41543.
[grpc-default-executor-0] INFO sdk_worker.__init__ - Control channel established.
[grpc-default-executor-2] INFO sdk_worker.__init__ - Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - Creating insecure state channel for localhost:46121.
[grpc-default-executor-0] INFO sdk_worker.create_state_handler - State channel established.
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_4:0
[grpc-default-executor-2] INFO data_plane.create_data_channel - Creating channel for localhost:43277
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-0] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_7:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[grpc-default-executor-2] WARN bundle_processor.create_operation - No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[grpc-default-executor-2] INFO sdk_worker.run - No more requests from control plane
[grpc-default-executor-2] INFO sdk_worker.run - SDK Harness waiting for in-flight requests to complete
[grpc-default-executor-2] INFO data_plane.close - Closing all cached grpc data channels.
[grpc-default-executor-2] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[grpc-default-executor-2] INFO sdk_worker.close - Closing all cached gRPC state handlers.
[grpc-default-executor-2] INFO sdk_worker.run - Done consuming work.
[grpc-default-executor-2] INFO sdk_worker_main.main - Python sdk harness exiting.
[grpc-default-executor-2] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.logging.GrpcLoggingService - Logging client hanged up.
[reference-runner-pipeline-1] WARN org.apache.beam.repackaged.beam_runners_direct_java.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/job1701849196/MANIFEST has 0 artifact locations
[reference-runner-pipeline-1] INFO org.apache.beam.sdk.io.LocalFileSystem - Ignoring failed deletion of file /tmp/beam-artifact-staging/job1701849196/artifacts/ which already does not exist: {}
java.nio.file.NoSuchFileException: /tmp/beam-artifact-staging/job1701849196/artifacts
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
at java.nio.file.Files.delete(Files.java:1126)
at org.apache.beam.sdk.io.LocalFileSystem.delete(LocalFileSystem.java:185)
at org.apache.beam.sdk.io.FileSystems.delete(FileSystems.java:379)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:168)
at org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService.lambda$run$3(ReferenceRunnerJobService.java:194)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[reference-runner-pipeline-1] INFO org.apache.beam.repackaged.beam_runners_direct_java.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/job1701849196/
.
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.JavaReferenceRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 304, in test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 361, in _run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 428, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline job-1577701426 failed in state FAILED: unknown error
----------------------------------------------------------------------
Ran 31 tests in 198.452s
FAILED (errors=1, skipped=18)
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 10m 23s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/q5hgqbme626my
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_PVR_Reference #306
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/306/display/redirect>
------------------------------------------
[...truncated 335.19 KB...]
details = "Socket closed"
debug_error_string = "{"created":"@1552759854.668524625","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 400, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1552759854.668496875","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 400, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1552759854.668579079","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 400, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1552759854.668590940","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 400, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1552759854.668572929","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 400, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1552759854.668566988","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 400, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1552759854.668532837","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 400, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1552759854.668585068","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 400, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1552759854.668540705","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 400, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1552759854.668559627","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 400, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1552759854.668553054","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 400, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1552759854.668546435","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/portability/portable_runner.py", line 400, in read_messages
for message in self._message_stream:
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1552759854.668516591","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1039,"grpc_message":"Socket closed","grpc_status":14}"
>
> Task :beam-sdks-python:javaReferenceRunnerValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Reference/ws/src/sdks/python/build.gradle'> line: 391
* What went wrong:
Execution failed for task ':beam-sdks-python:javaReferenceRunnerValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 10m 46s
61 actionable tasks: 46 executed, 14 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/5p7y3lkhoc42y
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org