You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/10/04 00:11:10 UTC
Build failed in Jenkins: beam_PostCommit_Python_VR_Samza #304
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/304/display/redirect>
Changes:
------------------------------------------
[...truncated 3.06 MB...]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-1] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633306261.2036214_40008827-f19c-4e6e-8423-07afdce51ca4.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
[grpc-default-executor-1] ERROR org.apache.beam.runners.jobsubmission.InMemoryJobService - Encountered Unexpected Exception for Invocation test_windowing_1633306261.2036214_40008827-f19c-4e6e-8423-07afdce51ca4
java.lang.IllegalStateException: Stream is already completed, no further calls are allowed
at org.apache.beam.vendor.grpc.v1p36p0.com.google.common.base.Preconditions.checkState(Preconditions.java:508)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onNext(ServerCalls.java:360)
at org.apache.beam.sdk.fn.stream.SynchronizedStreamObserver.onNext(SynchronizedStreamObserver.java:46)
at org.apache.beam.runners.jobsubmission.InMemoryJobService.lambda$getMessageStream$2(InMemoryJobService.java:434)
at org.apache.beam.runners.jobsubmission.JobInvocation.addStateListener(JobInvocation.java:218)
at org.apache.beam.runners.jobsubmission.InMemoryJobService.getMessageStream(InMemoryJobService.java:450)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:972)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:331)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:797)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Oct 04, 2021 12:11:01 AM org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@1a81a849
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p36p0.com.google.common.base.Preconditions.checkState(Preconditions.java:508)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.ServerCallImpl.closeInternal(ServerCallImpl.java:209)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:202)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onError(ServerCalls.java:374)
at org.apache.beam.runners.jobsubmission.InMemoryJobService.getMessageStream(InMemoryJobService.java:458)
at org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:972)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:331)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:797)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Staging artifacts for job_32435fed-674d-4ede-a50a-5db3e392fae4.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Resolving artifacts for job_32435fed-674d-4ede-a50a-5db3e392fae4.ref_Environment_default_environment_1.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Getting 0 artifacts for job_32435fed-674d-4ede-a50a-5db3e392fae4.null.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Artifacts fully staged for job_32435fed-674d-4ede-a50a-5db3e392fae4.
[grpc-default-executor-1] INFO org.apache.beam.runners.jobsubmission.JobInvocation - Starting job invocation test_windowing_1633306261.7813234_f67eb973-7022-4992-a613-e4e3afba9dd4
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - Portable pipeline to run:
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-1] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633306261.7813234_f67eb973-7022-4992-a613-e4e3afba9dd4.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
------------------------------ Captured log call -------------------------------
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
=============================== warnings summary ===============================
target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/pytest_samza-runner-test.xml> -
======== 29 failed, 7 passed, 14 skipped, 1 warnings in 126.62 seconds =========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> samza-runner-test apache_beam/runners/portability/samza_runner_test.py '--samza_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/runners/samza/job-server/build/libs/beam-runners-samza-job-server-2.34.0-SNAPSHOT.jar> --environment_type=LOOPBACK' (exited with code 1)
[0m[1msamza-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: samza-runner-test: commands failed
[0m
> Task :sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK FAILED
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 10m 33s
66 actionable tasks: 43 executed, 23 from cache
Publishing build scan...
https://gradle.com/s/wsrxai44lppok
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Python_VR_Samza
#309
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/309/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Samza #308
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/308/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #15618 from [BEAM-12968] [Playground] Create README
[noreply] Merge pull request #15626 from [BEAM-12963] [Playground] Create base
[noreply] Merge pull request #15566 from [BEAM-12925] Correct behavior retrieving
[noreply] [BEAM-12911] Update schema translation (Java, Python) to log more
[noreply] Update CHANGES.md for JdbcIO breaking change (#15651)
[noreply] [BEAM-12513] Add Go SDK metrics content to BPG. (#15650)
[noreply] [BEAM-12996] Improve Error Logging in ConfigBuilder (#15646)
------------------------------------------
[...truncated 2.99 MB...]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-1] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633393292.424646_0b71ad4e-f39f-4889-a03a-aeab4a7e9fb2.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Staging artifacts for job_0a25d418-0b3e-4421-a626-1009ab0e21da.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Resolving artifacts for job_0a25d418-0b3e-4421-a626-1009ab0e21da.ref_Environment_default_environment_1.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Getting 0 artifacts for job_0a25d418-0b3e-4421-a626-1009ab0e21da.null.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Artifacts fully staged for job_0a25d418-0b3e-4421-a626-1009ab0e21da.
[grpc-default-executor-1] INFO org.apache.beam.runners.jobsubmission.JobInvocation - Starting job invocation test_windowing_1633393292.7630796_87d33929-4987-456a-8c24-ab4934b4dc3f
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - Portable pipeline to run:
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-0] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633393292.7630796_87d33929-4987-456a-8c24-ab4934b4dc3f.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
------------------------------ Captured log call -------------------------------
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
=============================== warnings summary ===============================
target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/pytest_samza-runner-test.xml> -
========= 29 failed, 7 passed, 14 skipped, 1 warnings in 61.59 seconds =========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> samza-runner-test apache_beam/runners/portability/samza_runner_test.py '--samza_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/runners/samza/job-server/build/libs/beam-runners-samza-job-server-2.34.0-SNAPSHOT.jar> --environment_type=LOOPBACK' (exited with code 1)
[0m[1msamza-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: samza-runner-test: commands failed
[0m
> Task :sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK FAILED
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 56s
66 actionable tasks: 45 executed, 21 from cache
Publishing build scan...
https://gradle.com/s/bjphlycb622lw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Samza #307
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/307/display/redirect?page=changes>
Changes:
[noreply] [BEAM-11516] Upgrade to pylint 2.11.1, fix warnings (#15612)
[noreply] [BEAM-12979, BEAM-11097] Change cache to store ReStreams, clean up to…
[noreply] [BEAM-3304, BEAM-12513] Trigger changes and Windowing. (#15644)
------------------------------------------
[...truncated 3.03 MB...]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-0] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633371042.1640692_906e026a-c2f4-44fe-99e0-e137be658208.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Staging artifacts for job_8afbe5b2-f43d-42d9-9194-04ca9828d995.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Resolving artifacts for job_8afbe5b2-f43d-42d9-9194-04ca9828d995.ref_Environment_default_environment_1.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Getting 0 artifacts for job_8afbe5b2-f43d-42d9-9194-04ca9828d995.null.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Artifacts fully staged for job_8afbe5b2-f43d-42d9-9194-04ca9828d995.
[grpc-default-executor-0] INFO org.apache.beam.runners.jobsubmission.JobInvocation - Starting job invocation test_windowing_1633371042.4542806_73136856-d62c-4567-ab2a-63b149b4999d
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - Portable pipeline to run:
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
7 -> 8 [style=solid label="20:0"]
6 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
7 -> 8 [style=solid label="20:0"]
6 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-1] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633371042.4542806_73136856-d62c-4567-ab2a-63b149b4999d.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
------------------------------ Captured log call -------------------------------
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
=============================== warnings summary ===============================
target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/pytest_samza-runner-test.xml> -
========= 29 failed, 7 passed, 14 skipped, 1 warnings in 74.36 seconds =========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> samza-runner-test apache_beam/runners/portability/samza_runner_test.py '--samza_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/runners/samza/job-server/build/libs/beam-runners-samza-job-server-2.34.0-SNAPSHOT.jar> --environment_type=LOOPBACK' (exited with code 1)
[0m[1msamza-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: samza-runner-test: commands failed
[0m
> Task :sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK FAILED
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 15s
66 actionable tasks: 43 executed, 23 from cache
Publishing build scan...
https://gradle.com/s/qwenkynl5scd2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Samza #306
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/306/display/redirect>
Changes:
------------------------------------------
[...truncated 3.00 MB...]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-0] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633349328.3275442_7eb86eb2-955c-4eb1-976a-ff94872c9a35.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Staging artifacts for job_931bee59-7e14-44e1-b256-318bb66574ba.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Resolving artifacts for job_931bee59-7e14-44e1-b256-318bb66574ba.ref_Environment_default_environment_1.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Getting 0 artifacts for job_931bee59-7e14-44e1-b256-318bb66574ba.null.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Artifacts fully staged for job_931bee59-7e14-44e1-b256-318bb66574ba.
[grpc-default-executor-0] INFO org.apache.beam.runners.jobsubmission.JobInvocation - Starting job invocation test_windowing_1633349328.645207_9420d6b2-eb93-47e3-8a6c-b85048cb9908
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - Portable pipeline to run:
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-1] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633349328.645207_9420d6b2-eb93-47e3-8a6c-b85048cb9908.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
------------------------------ Captured log call -------------------------------
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
=============================== warnings summary ===============================
target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/pytest_samza-runner-test.xml> -
========= 29 failed, 7 passed, 14 skipped, 1 warnings in 77.67 seconds =========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> samza-runner-test apache_beam/runners/portability/samza_runner_test.py '--samza_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/runners/samza/job-server/build/libs/beam-runners-samza-job-server-2.34.0-SNAPSHOT.jar> --environment_type=LOOPBACK' (exited with code 1)
[0m[1msamza-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: samza-runner-test: commands failed
[0m
> Task :sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK FAILED
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 17s
66 actionable tasks: 43 executed, 23 from cache
Publishing build scan...
https://gradle.com/s/r2iung2szlltc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Samza #305
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/305/display/redirect>
Changes:
------------------------------------------
[...truncated 3.00 MB...]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-1] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633327655.7079155_b5e82f3b-be05-4d77-a886-b01a3afb0663.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Staging artifacts for job_2fc0dda0-f2e4-4a98-9730-a50509f566ce.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Resolving artifacts for job_2fc0dda0-f2e4-4a98-9730-a50509f566ce.ref_Environment_default_environment_1.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Getting 0 artifacts for job_2fc0dda0-f2e4-4a98-9730-a50509f566ce.null.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService - Artifacts fully staged for job_2fc0dda0-f2e4-4a98-9730-a50509f566ce.
[grpc-default-executor-0] INFO org.apache.beam.runners.jobsubmission.JobInvocation - Starting job invocation test_windowing_1633327656.0016282_888390fe-a1b8-499f-88c1-3b9dd5029b4e
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - Portable pipeline to run:
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaPipelineRunner - digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.SamzaRunner - Portable pipeline to run DOT graph:
digraph {
rankdir=LR
0 [label="Create/Impulse\nbeam:transform:impulse:v1"]
1 [label="14Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
0 -> 1 [style=solid label="1"]
2 [label="Create/MaybeReshuffle/Reshuffle\nbeam:transform:reshuffle:v1"]
1 -> 2 [style=solid label="2"]
3 [label="48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
2 -> 3 [style=solid label="7"]
4 [label="assert_that/Create/Impulse\nbeam:transform:impulse:v1"]
5 [label="GroupByKey\nbeam:transform:group_by_key:v1"]
3 -> 5 [style=solid label="10"]
6 [label="26assert_that/Create/Impulse.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
4 -> 6 [style=solid label="13"]
7 [label="10GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
5 -> 7 [style=solid label="11"]
8 [label="unzipped_flatten:0\nbeam:transform:flatten:v1"]
6 -> 8 [style=solid label="20:0"]
7 -> 8 [style=solid label="20:1"]
9 [label="assert_that/Group/CoGroupByKeyImpl/GroupByKey\nbeam:transform:group_by_key:v1"]
8 -> 9 [style=solid label="20"]
10 [label="45assert_that/Group/CoGroupByKeyImpl/GroupByKey.None/beam:env:external:v1:0\nbeam:runner:executable_stage:v1"]
9 -> 10 [style=solid label="21"]
}
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.ConfigBuilder - Execution environment is LOCAL
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:impulse:v1
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the key serde for stream ref_PCollection_PCollection_1. Keys will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.samza.application.descriptors.ApplicationDescriptorImpl - Using NoOpSerde as the value serde for stream ref_PCollection_PCollection_1. Values will not be (de)serialized
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:runner:executable_stage:v1
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.util.HashIdGenerator - Name 14Create/Impulse.None/beam:env:external:v1:0 is mapped to id 58c56
[samza-runner-job-invoker-1] INFO org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator - Translating transform urn: beam:transform:reshuffle:v1
[samza-runner-job-invoker-0] ERROR org.apache.beam.runners.jobsubmission.JobInvocation - Error during job invocation test_windowing_1633327656.0016282_888390fe-a1b8-499f-88c1-3b9dd5029b4e.
java.lang.RuntimeException: Failed to invoke samza job
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:82)
at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.samza.config.ConfigException: Could not load ApplicationRunner class org.apache.samza.runtime.LocalApplicationRunner
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:74)
at org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:193)
at org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
... 7 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor17.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.samza.runtime.ApplicationRunners.getApplicationRunner(ApplicationRunners.java:68)
... 10 more
Caused by: java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
at org.apache.beam.runners.samza.translation.ReshuffleTranslator.translatePortable(ReshuffleTranslator.java:85)
at org.apache.beam.runners.samza.translation.SamzaPortablePipelineTranslator.translate(SamzaPortablePipelineTranslator.java:73)
at org.apache.beam.runners.samza.SamzaRunner.lambda$runPortablePipeline$0(SamzaRunner.java:107)
at org.apache.samza.application.descriptors.StreamApplicationDescriptorImpl.<init>(StreamApplicationDescriptorImpl.java:81)
at org.apache.samza.application.descriptors.ApplicationDescriptorUtil.getAppDescriptor(ApplicationDescriptorUtil.java:45)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:132)
at org.apache.samza.runtime.LocalApplicationRunner.<init>(LocalApplicationRunner.java:104)
... 14 more
ERROR:root:java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
------------------------------ Captured log call -------------------------------
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
ERROR root:portable_runner.py:567 java.lang.ClassCastException: org.apache.beam.sdk.coders.ByteArrayCoder cannot be cast to org.apache.beam.sdk.coders.KvCoder
=============================== warnings summary ===============================
target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/pytest_samza-runner-test.xml> -
========= 29 failed, 7 passed, 14 skipped, 1 warnings in 60.75 seconds =========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> samza-runner-test apache_beam/runners/portability/samza_runner_test.py '--samza_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/runners/samza/job-server/build/libs/beam-runners-samza-job-server-2.34.0-SNAPSHOT.jar> --environment_type=LOOPBACK' (exited with code 1)
[0m[1msamza-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: samza-runner-test: commands failed
[0m
> Task :sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK FAILED
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 7m 5s
66 actionable tasks: 43 executed, 23 from cache
Publishing build scan...
https://gradle.com/s/4kr2zlt55alty
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org